2024-09-15T23:45:58.512 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T23:45:58.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:45:58.613 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362 branch: squid description: fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/fstop} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906362' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi meta: - desc: 1 ceph cluster with 1 mon, 1 mgr, 3 osds, 2 mds, 2 clients mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.b - osd.0 - osd.1 - osd.2 - client.0 - client.1 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdSsq9fCfu3Uz1gXWupXNYPxXyF0gy6fqdgg+2lDiBazItjRtN9/MDYXQZB/0+y8R9R/9pM5+YQm/2T5ftfYmI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_fstop teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T23:45:58.613 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T23:45:58.614 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T23:45:58.614 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T23:45:58.616 INFO:teuthology.task.internal:Checking packages... 2024-09-15T23:45:58.636 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T23:45:58.636 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T23:45:58.637 INFO:teuthology.packaging:ref: None 2024-09-15T23:45:58.637 INFO:teuthology.packaging:tag: None 2024-09-15T23:45:58.637 INFO:teuthology.packaging:branch: squid 2024-09-15T23:45:58.637 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:45:58.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T23:45:58.835 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T23:45:58.837 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T23:45:58.844 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T23:45:58.844 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T23:45:58.853 INFO:teuthology.task.internal:Saving configuration 2024-09-15T23:45:58.869 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T23:45:58.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T23:45:58.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:41:10.269199', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdSsq9fCfu3Uz1gXWupXNYPxXyF0gy6fqdgg+2lDiBazItjRtN9/MDYXQZB/0+y8R9R/9pM5+YQm/2T5ftfYmI='} 2024-09-15T23:45:58.910 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T23:45:58.919 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1'] 2024-09-15T23:45:58.919 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T23:45:58.956 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a9dfb3be0>, signals=[15]) 2024-09-15T23:45:58.957 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T23:45:58.964 INFO:teuthology.task.internal:Opening connections... 2024-09-15T23:45:58.964 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:45:58.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:45:59.046 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T23:45:59.053 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-15T23:45:59.127 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-15T23:45:59.128 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-15T23:45:59.185 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:45:59.186 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:45:59.187 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-15T23:45:59.205 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T23:45:59.213 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T23:45:59.220 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T23:45:59.220 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:45:59.242 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T23:45:59.254 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T23:45:59.254 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:45:59.385 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T23:45:59.415 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T23:45:59.435 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T23:45:59.435 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T23:45:59.435 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:45:59.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:45:59.452 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-15T23:45:59.511 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-503.el9.x86_64 2024-09-15T23:45:59.511 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-503.el9.x86_64 2024-09-15T23:45:59.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2024-09-15T23:46:01.770 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-15T23:46:05.005 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 20 MB 00:02 2024-09-15T23:46:09.321 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T23:46:11.114 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-15T23:46:12.268 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-15T23:46:17.681 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-15T23:46:19.746 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T23:46:19.746 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T23:46:19.832 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-15T23:46:19.842 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2024-09-15T23:46:19.843 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages 2024-09-15T23:46:19.844 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:46:19.844 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 79 M 2024-09-15T23:46:19.844 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 126 M 2024-09-15T23:46:19.844 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-15T23:46:20.091 INFO:teuthology.orchestra.run.smithi121.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 176 kB/s | 23 kB 00:00 2024-09-15T23:46:20.349 INFO:teuthology.orchestra.run.smithi121.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-15T23:46:20.800 INFO:teuthology.orchestra.run.smithi121.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-15T23:46:21.359 INFO:teuthology.orchestra.run.smithi121.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 23 MB/s | 29 MB 00:01 2024-09-15T23:46:21.359 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:46:21.359 INFO:teuthology.orchestra.run.smithi121.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-15T23:46:22.039 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-15T23:46:22.400 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-15T23:46:22.400 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-15T23:46:23.340 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-15T23:46:23.340 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-15T23:46:25.790 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-15T23:46:26.448 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:46:26.525 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:46:29.335 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:46:29.463 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:46:34.312 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:46:34.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:46:39.238 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:47:17.471 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:47:17.510 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:47:17.858 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:47:17.858 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:47:17.858 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:47:17.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:47:18.710 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-15T23:47:19.077 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:47:19.178 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:47:19.179 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:47:19.179 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T23:47:19.179 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:47:19.179 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:47:19.180 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T23:47:19.180 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:47:19.180 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:47:19.240 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:47:19.240 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:47:19.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2024-09-15T23:47:19.285 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2024-09-15T23:47:19.285 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2024-09-15T23:47:19.286 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.06 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 82.el9 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:Group : Unspecified 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 8274670 2024-09-15T23:47:19.287 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : builder@centos.org 2024-09-15T23:47:19.288 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T23:47:19.289 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T23:47:19.290 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T23:47:19.290 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2024-09-15T23:47:19.290 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:47:19.290 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T23:47:19.292 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T23:47:19.292 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 5.14.0-505.el9.x86_64 2024-09-15T23:47:19.292 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T23:47:19.929 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2024-09-15T23:47:21.262 INFO:teuthology.orchestra.run.smithi121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T23:47:21.295 INFO:teuthology.orchestra.run.smithi121.stderr:done 2024-09-15T23:47:21.298 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-15T23:47:21.313 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.XLbpM2tZCc 2024-09-15T23:47:21.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XLbpM2tZCc 2024-09-15T23:47:21.381 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.XLbpM2tZCc 2024-09-15T23:47:21.523 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.XLbpM2tZCc is 6KB 2024-09-15T23:47:21.574 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.XLbpM2tZCc 2024-09-15T23:47:21.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T23:47:21.651 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T23:47:21.651 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T23:47:21.651 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T23:47:21.651 INFO:teuthology.orchestra.run.smithi121.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T23:47:21.653 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T23:47:21.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2024-09-15T23:47:51.853 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T23:47:51.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:47:51.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:48:10.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-15T23:48:19.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:48:19.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:48:22.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-15T23:48:34.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:48:34.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:48:37.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-15T23:48:52.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:48:52.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:48:55.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.121 2024-09-15T23:49:13.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:49:13.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:49:13.785 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-15T23:49:14.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:49:14.123 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T23:49:14.124 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2024-09-15T23:49:14.140 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-505.el9.x86_64 2024-09-15T23:49:14.140 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T23:49:14.140 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:49:14.140 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T23:49:15.141 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T23:49:15.141 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T23:49:15.209 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2024-09-15T23:49:15.244 DEBUG:teuthology.parallel:result is None 2024-09-15T23:49:15.245 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T23:49:15.252 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T23:49:15.252 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:49:15.269 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T23:49:15.292 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T23:49:15.304 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T23:49:15.304 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:49:15.368 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T23:49:15.374 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T23:49:15.375 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:49:15.411 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:49:15.421 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:49:15.423 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T23:49:15.430 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T23:49:15.430 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:49:15.489 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T23:49:15.498 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T23:49:15.498 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:49:15.544 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:49:15.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:49:15.669 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:49:15.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:49:15.789 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:49:15.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:49:15.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-15T23:49:15.935 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:49:16.212 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T23:49:16.219 INFO:teuthology.task.internal:Starting timer... 2024-09-15T23:49:16.219 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T23:49:16.231 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T23:49:16.239 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T23:49:16.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-15T23:49:16.281 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-15T23:49:16.284 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T23:49:16.284 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-15T23:49:16.322 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-15T23:49:16.322 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-09-15T23:49:16.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:49:16.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:49:16.385 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T23:49:16.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:49:16.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T23:49:16.467 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T23:49:16.478 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T23:49:16.480 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T23:52:57.087 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-09-15T23:52:57.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:52:57.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:52:57.167 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-15T23:52:57.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-15T23:52:57.245 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T23:52:57.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T23:52:57.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:52:57.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:52:57.314 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:52:57.328 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:52:57.352 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-15T23:52:57.363 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-15T23:52:57.376 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:52:57.390 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:52:57.446 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:52:57.450 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:52:57.450 INFO:teuthology.run_tasks:Running task install... 2024-09-15T23:52:57.458 DEBUG:teuthology.task.install:project ceph 2024-09-15T23:52:57.459 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T23:52:57.459 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T23:52:57.459 INFO:teuthology.task.install:Using flavor: default 2024-09-15T23:52:57.464 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T23:52:57.464 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T23:52:57.465 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:52:57.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:52:57.611 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:52:57.611 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:52:57.720 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:52:57.720 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:52:57.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:52:57.747 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:52:57.747 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:52:57.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:52:57.890 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:52:57.954 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-15T23:52:57.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-15T23:52:58.192 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-15T23:52:58.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:52:58.771 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 311 kB/s | 83 kB 00:00 2024-09-15T23:52:59.063 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-15T23:52:59.331 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T23:53:03.222 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-15T23:53:08.497 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-15T23:53:12.773 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T23:53:14.382 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-15T23:53:15.311 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-15T23:53:20.733 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-15T23:53:23.095 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:53:23.096 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:53:23.109 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:53:23.110 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:53:23.111 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:53:23.112 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:53:23.114 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:53:23.117 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:53:23.118 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:53:23.181 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-15T23:53:23.194 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:53:23.195 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:53:23.196 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:53:23.197 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:53:23.198 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:53:23.199 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:53:23.200 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:53:23.201 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:53:23.202 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:53:23.203 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:53:23.204 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:53:23.205 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-15T23:53:23.206 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 8 Packages 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 226 M 2024-09-15T23:53:23.207 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-15T23:53:23.743 INFO:teuthology.orchestra.run.smithi121.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-15T23:53:23.927 INFO:teuthology.orchestra.run.smithi121.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-15T23:53:23.985 INFO:teuthology.orchestra.run.smithi121.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T23:53:24.186 INFO:teuthology.orchestra.run.smithi121.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.4 MB/s | 5.4 MB 00:00 2024-09-15T23:53:24.252 INFO:teuthology.orchestra.run.smithi121.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 8.9 MB/s | 2.4 MB 00:00 2024-09-15T23:53:24.361 INFO:teuthology.orchestra.run.smithi121.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-15T23:53:24.669 INFO:teuthology.orchestra.run.smithi121.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-15T23:53:25.054 INFO:teuthology.orchestra.run.smithi121.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T23:53:25.103 INFO:teuthology.orchestra.run.smithi121.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 514 kB/s | 25 kB 00:00 2024-09-15T23:53:25.362 INFO:teuthology.orchestra.run.smithi121.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 17 MB/s | 17 MB 00:01 2024-09-15T23:53:25.479 INFO:teuthology.orchestra.run.smithi121.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T23:53:25.504 INFO:teuthology.orchestra.run.smithi121.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.6 MB/s | 228 kB 00:00 2024-09-15T23:53:25.521 INFO:teuthology.orchestra.run.smithi121.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 649 kB/s | 27 kB 00:00 2024-09-15T23:53:25.546 INFO:teuthology.orchestra.run.smithi121.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 758 kB/s | 32 kB 00:00 2024-09-15T23:53:25.588 INFO:teuthology.orchestra.run.smithi121.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-15T23:53:25.614 INFO:teuthology.orchestra.run.smithi121.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T23:53:25.639 INFO:teuthology.orchestra.run.smithi121.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:53:25.664 INFO:teuthology.orchestra.run.smithi121.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 9.9 MB/s | 506 kB 00:00 2024-09-15T23:53:25.706 INFO:teuthology.orchestra.run.smithi121.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 1.1 MB/s | 45 kB 00:00 2024-09-15T23:53:25.790 INFO:teuthology.orchestra.run.smithi121.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.6 MB/s | 136 kB 00:00 2024-09-15T23:53:25.924 INFO:teuthology.orchestra.run.smithi121.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-15T23:53:25.951 INFO:teuthology.orchestra.run.smithi121.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.0 MB/s | 161 kB 00:00 2024-09-15T23:53:25.974 INFO:teuthology.orchestra.run.smithi121.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 6.3 MB/s | 320 kB 00:00 2024-09-15T23:53:26.000 INFO:teuthology.orchestra.run.smithi121.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.8 MB/s | 300 kB 00:00 2024-09-15T23:53:26.025 INFO:teuthology.orchestra.run.smithi121.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T23:53:26.042 INFO:teuthology.orchestra.run.smithi121.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 2.0 MB/s | 85 kB 00:00 2024-09-15T23:53:26.093 INFO:teuthology.orchestra.run.smithi121.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-15T23:53:26.217 INFO:teuthology.orchestra.run.smithi121.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-15T23:53:26.243 INFO:teuthology.orchestra.run.smithi121.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 212 kB/s | 32 kB 00:00 2024-09-15T23:53:26.268 INFO:teuthology.orchestra.run.smithi121.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T23:53:26.435 INFO:teuthology.orchestra.run.smithi121.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 19 MB/s | 3.6 MB 00:00 2024-09-15T23:53:26.510 INFO:teuthology.orchestra.run.smithi121.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.3 MB/s | 249 kB 00:00 2024-09-15T23:53:26.644 INFO:teuthology.orchestra.run.smithi121.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-15T23:53:26.669 INFO:teuthology.orchestra.run.smithi121.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 311 kB/s | 49 kB 00:00 2024-09-15T23:53:26.694 INFO:teuthology.orchestra.run.smithi121.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T23:53:26.736 INFO:teuthology.orchestra.run.smithi121.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T23:53:26.770 INFO:teuthology.orchestra.run.smithi121.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-15T23:53:26.795 INFO:teuthology.orchestra.run.smithi121.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 311 kB/s | 18 kB 00:00 2024-09-15T23:53:26.929 INFO:teuthology.orchestra.run.smithi121.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-15T23:53:27.421 INFO:teuthology.orchestra.run.smithi121.stdout:(40/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 21 MB/s | 49 MB 00:02 2024-09-15T23:53:27.446 INFO:teuthology.orchestra.run.smithi121.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 370 kB/s | 191 kB 00:00 2024-09-15T23:53:27.488 INFO:teuthology.orchestra.run.smithi121.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-15T23:53:27.571 INFO:teuthology.orchestra.run.smithi121.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-15T23:53:27.647 INFO:teuthology.orchestra.run.smithi121.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-15T23:53:27.672 INFO:teuthology.orchestra.run.smithi121.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-15T23:53:27.731 INFO:teuthology.orchestra.run.smithi121.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-15T23:53:27.781 INFO:teuthology.orchestra.run.smithi121.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-15T23:53:27.906 INFO:teuthology.orchestra.run.smithi121.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-15T23:53:27.940 INFO:teuthology.orchestra.run.smithi121.stdout:(49/156): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-15T23:53:27.965 INFO:teuthology.orchestra.run.smithi121.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-15T23:53:27.999 INFO:teuthology.orchestra.run.smithi121.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-15T23:53:28.024 INFO:teuthology.orchestra.run.smithi121.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-15T23:53:28.049 INFO:teuthology.orchestra.run.smithi121.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-15T23:53:28.083 INFO:teuthology.orchestra.run.smithi121.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-15T23:53:28.108 INFO:teuthology.orchestra.run.smithi121.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-15T23:53:28.134 INFO:teuthology.orchestra.run.smithi121.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-15T23:53:28.167 INFO:teuthology.orchestra.run.smithi121.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-15T23:53:28.192 INFO:teuthology.orchestra.run.smithi121.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-15T23:53:28.234 INFO:teuthology.orchestra.run.smithi121.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T23:53:28.268 INFO:teuthology.orchestra.run.smithi121.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-15T23:53:28.293 INFO:teuthology.orchestra.run.smithi121.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-15T23:53:28.318 INFO:teuthology.orchestra.run.smithi121.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-15T23:53:28.344 INFO:teuthology.orchestra.run.smithi121.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-15T23:53:28.369 INFO:teuthology.orchestra.run.smithi121.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T23:53:28.394 INFO:teuthology.orchestra.run.smithi121.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-15T23:53:28.453 INFO:teuthology.orchestra.run.smithi121.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.0 MB/s | 3.0 MB 00:00 2024-09-15T23:53:28.537 INFO:teuthology.orchestra.run.smithi121.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 30 MB/s | 4.9 MB 00:00 2024-09-15T23:53:28.578 INFO:teuthology.orchestra.run.smithi121.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T23:53:28.645 INFO:teuthology.orchestra.run.smithi121.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-15T23:53:28.671 INFO:teuthology.orchestra.run.smithi121.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-15T23:53:28.696 INFO:teuthology.orchestra.run.smithi121.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-15T23:53:28.749 INFO:teuthology.orchestra.run.smithi121.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T23:53:28.780 INFO:teuthology.orchestra.run.smithi121.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-15T23:53:28.864 INFO:teuthology.orchestra.run.smithi121.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-15T23:53:28.889 INFO:teuthology.orchestra.run.smithi121.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-15T23:53:28.914 INFO:teuthology.orchestra.run.smithi121.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-15T23:53:28.964 INFO:teuthology.orchestra.run.smithi121.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-15T23:53:28.989 INFO:teuthology.orchestra.run.smithi121.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-15T23:53:29.015 INFO:teuthology.orchestra.run.smithi121.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-15T23:53:29.040 INFO:teuthology.orchestra.run.smithi121.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-15T23:53:29.066 INFO:teuthology.orchestra.run.smithi121.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-15T23:53:29.158 INFO:teuthology.orchestra.run.smithi121.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-15T23:53:29.183 INFO:teuthology.orchestra.run.smithi121.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-15T23:53:29.208 INFO:teuthology.orchestra.run.smithi121.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T23:53:29.237 INFO:teuthology.orchestra.run.smithi121.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T23:53:29.259 INFO:teuthology.orchestra.run.smithi121.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-15T23:53:29.284 INFO:teuthology.orchestra.run.smithi121.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T23:53:29.309 INFO:teuthology.orchestra.run.smithi121.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T23:53:29.334 INFO:teuthology.orchestra.run.smithi121.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-15T23:53:29.368 INFO:teuthology.orchestra.run.smithi121.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-15T23:53:29.393 INFO:teuthology.orchestra.run.smithi121.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 919 kB/s | 54 kB 00:00 2024-09-15T23:53:29.469 INFO:teuthology.orchestra.run.smithi121.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-15T23:53:29.494 INFO:teuthology.orchestra.run.smithi121.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-15T23:53:29.519 INFO:teuthology.orchestra.run.smithi121.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-15T23:53:29.544 INFO:teuthology.orchestra.run.smithi121.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T23:53:29.570 INFO:teuthology.orchestra.run.smithi121.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-15T23:53:29.595 INFO:teuthology.orchestra.run.smithi121.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-15T23:53:29.620 INFO:teuthology.orchestra.run.smithi121.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-15T23:53:29.646 INFO:teuthology.orchestra.run.smithi121.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T23:53:29.663 INFO:teuthology.orchestra.run.smithi121.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-15T23:53:29.688 INFO:teuthology.orchestra.run.smithi121.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T23:53:29.713 INFO:teuthology.orchestra.run.smithi121.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-15T23:53:29.789 INFO:teuthology.orchestra.run.smithi121.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-15T23:53:29.981 INFO:teuthology.orchestra.run.smithi121.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-15T23:53:30.023 INFO:teuthology.orchestra.run.smithi121.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-09-15T23:53:30.065 INFO:teuthology.orchestra.run.smithi121.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-15T23:53:30.081 INFO:teuthology.orchestra.run.smithi121.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 345 kB/s | 19 kB 00:00 2024-09-15T23:53:30.107 INFO:teuthology.orchestra.run.smithi121.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.4 MB/s | 26 kB 00:00 2024-09-15T23:53:30.140 INFO:teuthology.orchestra.run.smithi121.stdout:(109/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.9 MB/s | 308 kB 00:00 2024-09-15T23:53:30.157 INFO:teuthology.orchestra.run.smithi121.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-15T23:53:30.183 INFO:teuthology.orchestra.run.smithi121.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-15T23:53:30.208 INFO:teuthology.orchestra.run.smithi121.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-15T23:53:30.258 INFO:teuthology.orchestra.run.smithi121.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-15T23:53:30.283 INFO:teuthology.orchestra.run.smithi121.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T23:53:30.317 INFO:teuthology.orchestra.run.smithi121.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-15T23:53:30.342 INFO:teuthology.orchestra.run.smithi121.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-15T23:53:30.368 INFO:teuthology.orchestra.run.smithi121.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-15T23:53:30.393 INFO:teuthology.orchestra.run.smithi121.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T23:53:30.435 INFO:teuthology.orchestra.run.smithi121.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-15T23:53:30.460 INFO:teuthology.orchestra.run.smithi121.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-15T23:53:30.485 INFO:teuthology.orchestra.run.smithi121.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T23:53:30.544 INFO:teuthology.orchestra.run.smithi121.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-15T23:53:30.569 INFO:teuthology.orchestra.run.smithi121.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-15T23:53:30.595 INFO:teuthology.orchestra.run.smithi121.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-15T23:53:30.620 INFO:teuthology.orchestra.run.smithi121.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T23:53:30.645 INFO:teuthology.orchestra.run.smithi121.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-15T23:53:30.679 INFO:teuthology.orchestra.run.smithi121.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 329 kB/s | 19 kB 00:00 2024-09-15T23:53:30.704 INFO:teuthology.orchestra.run.smithi121.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 334 kB/s | 20 kB 00:00 2024-09-15T23:53:30.738 INFO:teuthology.orchestra.run.smithi121.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-15T23:53:30.763 INFO:teuthology.orchestra.run.smithi121.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T23:53:30.789 INFO:teuthology.orchestra.run.smithi121.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:53:30.831 INFO:teuthology.orchestra.run.smithi121.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-15T23:53:30.856 INFO:teuthology.orchestra.run.smithi121.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-15T23:53:30.881 INFO:teuthology.orchestra.run.smithi121.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-15T23:53:30.906 INFO:teuthology.orchestra.run.smithi121.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T23:53:30.932 INFO:teuthology.orchestra.run.smithi121.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-15T23:53:30.957 INFO:teuthology.orchestra.run.smithi121.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-15T23:53:30.982 INFO:teuthology.orchestra.run.smithi121.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T23:53:31.008 INFO:teuthology.orchestra.run.smithi121.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-15T23:53:31.033 INFO:teuthology.orchestra.run.smithi121.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-15T23:53:31.058 INFO:teuthology.orchestra.run.smithi121.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T23:53:31.100 INFO:teuthology.orchestra.run.smithi121.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-15T23:53:31.125 INFO:teuthology.orchestra.run.smithi121.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-15T23:53:31.151 INFO:teuthology.orchestra.run.smithi121.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-15T23:53:31.167 INFO:teuthology.orchestra.run.smithi121.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-15T23:53:31.201 INFO:teuthology.orchestra.run.smithi121.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T23:53:31.226 INFO:teuthology.orchestra.run.smithi121.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T23:53:31.285 INFO:teuthology.orchestra.run.smithi121.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T23:53:31.444 INFO:teuthology.orchestra.run.smithi121.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-15T23:53:31.635 INFO:teuthology.orchestra.run.smithi121.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-15T23:53:31.744 INFO:teuthology.orchestra.run.smithi121.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-15T23:53:31.869 INFO:teuthology.orchestra.run.smithi121.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.0 MB/s | 2.3 MB 00:00 2024-09-15T23:53:31.895 INFO:teuthology.orchestra.run.smithi121.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-15T23:53:31.986 INFO:teuthology.orchestra.run.smithi121.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.3 MB/s | 1.8 MB 00:00 2024-09-15T23:53:32.128 INFO:teuthology.orchestra.run.smithi121.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-15T23:53:32.745 INFO:teuthology.orchestra.run.smithi121.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-09-15T23:53:32.753 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:53:32.753 INFO:teuthology.orchestra.run.smithi121.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-15T23:53:33.990 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-15T23:53:34.143 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-15T23:53:34.143 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-15T23:53:36.366 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-15T23:53:36.366 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-15T23:53:42.712 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-15T23:53:42.798 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:53:42.837 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:53:42.898 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:53:42.940 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:53:42.966 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:53:43.015 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:53:43.411 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:53:43.478 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:53:43.599 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:53:43.637 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:53:43.729 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:53:43.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:53:43.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:53:43.981 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:53:44.008 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:53:44.112 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:53:44.134 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:53:44.181 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:53:44.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:53:44.233 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:53:44.421 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:53:44.589 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:53:44.725 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:53:44.845 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:53:44.927 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:53:45.157 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:53:45.278 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:53:45.372 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:53:45.408 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:53:45.443 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:53:45.516 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:53:45.560 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:53:45.600 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:53:45.644 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:53:45.685 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:53:45.712 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:53:45.782 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:53:45.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:53:45.866 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:53:45.909 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:53:45.987 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:53:46.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:53:46.063 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:53:46.091 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:53:46.161 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:53:46.214 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:53:46.289 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:53:46.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:53:46.475 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:53:46.997 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:53:47.080 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:53:47.108 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:53:47.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:53:47.181 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:53:47.223 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:53:47.378 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:53:47.426 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:53:47.480 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:53:47.557 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:53:47.585 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:53:47.629 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:53:47.676 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:53:47.721 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:53:47.764 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:53:47.806 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:53:47.942 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:53:47.991 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:53:48.032 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:53:48.134 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:53:48.166 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:53:48.351 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:53:48.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:53:48.515 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:53:48.612 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:53:48.740 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:53:48.772 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:53:48.808 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:53:48.845 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:53:48.882 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:53:48.913 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:53:48.943 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:53:48.969 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:53:49.003 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:53:49.044 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:53:49.079 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:53:49.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:53:49.221 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:53:49.261 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:53:49.362 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:53:49.411 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:53:50.130 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:53:50.175 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:53:50.209 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:53:50.307 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:53:50.364 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:53:50.409 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:53:50.495 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:53:50.537 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:53:50.719 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:53:50.751 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:53:50.837 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:53:51.496 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:53:51.615 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:53:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:53:52.958 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:53:52.985 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:53:53.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:53:53.327 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:53:53.365 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:53:53.456 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:53:53.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:53:53.522 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:53:54.001 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:53:54.060 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:53:54.131 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:53:54.161 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:53:56.467 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:53:56.500 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:53:57.053 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:53:57.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:53:57.193 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:53:57.193 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:53:57.193 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:53:57.193 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:53:57.230 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:54:08.680 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-15T23:54:08.681 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:08.851 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:54:08.866 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:54:08.867 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:10.362 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:54:10.389 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:54:10.390 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:10.390 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:54:10.390 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:54:10.390 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:54:10.390 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:10.622 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:54:10.646 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:11.081 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:54:11.105 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:11.211 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:54:11.268 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:54:11.323 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:54:11.510 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:54:11.556 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:54:11.644 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:54:11.744 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:54:11.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:54:11.935 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:54:11.972 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:54:12.000 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:54:12.445 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:54:12.465 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:54:12.497 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:54:12.559 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:54:12.589 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:54:13.628 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:54:13.665 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:54:14.625 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:54:14.657 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:54:14.759 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:54:14.917 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:54:14.942 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:54:14.966 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:15.010 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:54:15.022 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:54:15.118 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:54:15.182 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:54:16.114 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:54:16.145 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:54:16.169 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:54:16.169 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:16.170 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:54:16.170 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:54:16.170 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:54:16.170 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:16.213 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:54:16.237 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:54:16.237 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:16.237 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:54:16.237 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:16.289 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:54:16.312 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:54:16.312 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:16.312 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:54:16.313 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:54:16.313 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:54:16.313 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:16.614 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:54:16.638 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:21.201 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:54:21.242 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:54:21.285 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:54:21.315 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:54:21.351 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:54:21.538 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:54:21.589 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:54:21.621 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:54:21.649 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:54:21.695 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:54:22.285 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:54:22.327 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:54:22.347 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:54:23.180 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:54:23.274 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:54:23.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:54:23.426 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:54:23.452 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:54:23.477 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:54:23.511 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:54:23.512 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:54:23.624 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:54:23.624 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:54:23.721 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:54:23.746 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:54:23.751 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:54:23.752 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:54:23.940 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:54:23.940 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:54:24.024 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:54:24.089 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:54:29.834 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:54:29.835 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:54:29.836 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:54:29.837 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:54:29.838 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:54:29.839 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:54:29.840 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:54:29.841 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:54:29.842 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:54:29.843 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:54:29.844 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:54:29.845 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:54:29.846 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:54:29.847 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:54:29.847 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:54:29.847 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:54:32.640 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:54:32.640 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:54:32.641 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.642 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:54:32.643 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.644 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:54:32.645 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:54:32.646 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:54:32.647 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:54:32.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:54:32.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:54:32.650 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:54:32.651 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:54:32.652 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:32.653 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-15T23:54:33.071 DEBUG:teuthology.parallel:result is None 2024-09-15T23:54:33.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:54:33.210 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:54:33.233 INFO:teuthology.orchestra.run.smithi121.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:54:33.233 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:54:33.234 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:54:33.235 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T23:54:33.235 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:33.236 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:54:33.301 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T23:54:33.301 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:33.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:54:33.365 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:54:33.431 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T23:54:33.431 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:33.431 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:54:33.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:54:33.564 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T23:54:33.564 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:33.564 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:54:33.629 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:54:33.694 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T23:54:33.911 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T23:54:33.911 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2024-09-15T23:54:33.937 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T23:54:33.937 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T23:54:34.004 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T23:54:34.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T23:54:34.278 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T23:54:34.279 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T23:54:34.279 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T23:54:34.279 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:34.279 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T23:54:34.296 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:34.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T23:54:34.439 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T23:54:34.439 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T23:54:34.440 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362', 'branch': 'squid', 'description': 'fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/fstop}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906362', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'meta': [{'desc': '1 ceph cluster with 1 mon, 1 mgr, 3 osds, 2 mds, 2 clients'}], 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdSsq9fCfu3Uz1gXWupXNYPxXyF0gy6fqdgg+2lDiBazItjRtN9/MDYXQZB/0+y8R9R/9pM5+YQm/2T5ftfYmI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_fstop']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T23:54:34.440 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T23:54:34.490 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T23:54:34.555 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:34.556 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:54:34.611 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:54:34.612 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-15 23:54:24.441743103 +0000 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-15 23:52:38.629838849 +0000 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-15 23:52:38.629838849 +0000 2024-09-15T23:54:34.667 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-15 23:52:38.629838849 +0000 2024-09-15T23:54:34.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:54:34.730 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-15T23:54:34.730 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-15T23:54:34.730 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000197931 s, 2.6 MB/s 2024-09-15T23:54:34.731 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:54:34.788 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-15T23:54:34.844 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:54:34.844 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:54:34.844 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-15 23:54:24.441743103 +0000 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-15 23:52:38.946835108 +0000 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-15 23:52:38.946835108 +0000 2024-09-15T23:54:34.845 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-15 23:52:38.946835108 +0000 2024-09-15T23:54:34.845 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:54:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-15T23:54:34.908 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-15T23:54:34.908 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000160819 s, 3.2 MB/s 2024-09-15T23:54:34.909 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:54:34.966 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-15 23:54:24.441743103 +0000 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-15 23:52:39.285831108 +0000 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-15 23:52:39.285831108 +0000 2024-09-15T23:54:35.021 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-15 23:52:39.285831108 +0000 2024-09-15T23:54:35.022 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:54:35.084 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-15T23:54:35.084 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-15T23:54:35.085 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.00017614 s, 2.9 MB/s 2024-09-15T23:54:35.086 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:54:35.142 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-15T23:54:35.196 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-15 23:54:24.441743103 +0000 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-15 23:52:39.608827296 +0000 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-15 23:52:39.608827296 +0000 2024-09-15T23:54:35.197 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-15 23:52:39.608827296 +0000 2024-09-15T23:54:35.197 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:54:35.260 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-15T23:54:35.260 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-15T23:54:35.260 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000191223 s, 2.7 MB/s 2024-09-15T23:54:35.261 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:54:35.317 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T23:54:35.317 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T23:54:35.318 INFO:tasks.ceph:Generating config... 2024-09-15T23:54:35.319 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T23:54:35.319 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T23:54:35.319 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T23:54:35.319 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T23:54:35.319 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T23:54:35.319 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T23:54:35.319 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T23:54:35.319 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T23:54:35.319 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T23:54:35.319 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T23:54:35.320 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T23:54:35.321 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T23:54:35.321 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T23:54:35.322 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T23:54:35.322 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T23:54:35.322 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T23:54:35.322 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T23:54:35.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T23:54:35.402 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T23:54:35.405 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T23:54:35.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:54:35.513 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.121')] 2024-09-15T23:54:35.513 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.121'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T23:54:35.514 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:35.514 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:54:35.568 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.121 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:35.647 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: generated fsid 822f5905-71ec-4c9e-8017-14fcc3976ad1 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:setting min_mon_release = quincy 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:epoch 0 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:fsid 822f5905-71ec-4c9e-8017-14fcc3976ad1 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:last_changed 2024-09-15T23:54:35.647587+0000 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:created 2024-09-15T23:54:35.647587+0000 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:min_mon_release 17 (quincy) 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:election_strategy: 1 2024-09-15T23:54:35.648 INFO:teuthology.orchestra.run.smithi121.stdout:0: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.a 2024-09-15T23:54:35.649 INFO:teuthology.orchestra.run.smithi121.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-15T23:54:35.650 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:54:35.705 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 822f5905-71ec-4c9e-8017-14fcc3976ad1... 2024-09-15T23:54:35.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:54:35.788 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2024-09-15T23:54:35.788 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2024-09-15T23:54:35.788 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.789 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2024-09-15T23:54:35.790 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2024-09-15T23:54:35.791 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = 172.21.15.121 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 822f5905-71ec-4c9e-8017-14fcc3976ad1 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.792 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2024-09-15T23:54:35.793 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-15T23:54:35.794 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-15T23:54:35.795 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:54:35.796 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:54:35.797 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: mon down mkfs grace = 300 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: mon op complaint time = 120 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on pool no app = False 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: client mount timeout = 600 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: debug client = 20 2024-09-15T23:54:35.798 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout:[mds] 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds = 20 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug mds balancer = 20 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug frag = True 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: mds debug scatterstat = True 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: mds op complaint time = 180 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: mds verify scatter = True 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: osd op complaint time = 180 2024-09-15T23:54:35.799 INFO:teuthology.orchestra.run.smithi121.stdout: rados mon op timeout = 900 2024-09-15T23:54:35.800 INFO:teuthology.orchestra.run.smithi121.stdout: rados osd op timeout = 900 2024-09-15T23:54:35.800 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T23:54:35.801 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T23:54:35.895 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T23:54:35.895 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:35.895 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T23:54:35.910 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:35.910 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T23:54:35.966 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:54:35.966 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:35.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T23:54:35.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:54:36.040 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:36.040 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:36.095 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T23:54:36.095 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T23:54:36.095 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:54:36.185 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:54:36.187 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T23:54:36.187 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:54:36.238 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:54:36.240 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T23:54:36.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:54:36.356 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:54:36.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T23:54:36.384 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T23:54:36.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T23:54:36.464 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T23:54:36.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T23:54:36.557 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T23:54:36.570 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T23:54:36.570 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-15T23:54:36.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T23:54:36.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T23:54:36.635 INFO:tasks.ceph:role: osd.0 2024-09-15T23:54:36.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:54:36.635 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:54:36.708 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:54:37.201 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-15T23:54:37.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-15T23:54:37.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T23:54:37.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T23:54:37.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T23:54:37.405 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T23:54:37.405 INFO:tasks.ceph:role: osd.1 2024-09-15T23:54:37.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:54:37.405 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T23:54:37.478 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:54:37.478 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:54:37.478 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:54:37.478 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:54:37.479 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:54:37.936 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-15T23:54:37.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-15T23:54:37.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T23:54:38.013 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T23:54:38.085 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T23:54:38.151 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-15T23:54:38.152 INFO:tasks.ceph:role: osd.2 2024-09-15T23:54:38.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:54:38.152 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:54:38.225 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:54:38.226 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:54:38.226 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:54:38.226 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:54:38.226 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:54:38.717 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2024-09-15T23:54:38.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2024-09-15T23:54:38.719 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T23:54:38.811 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T23:54:38.844 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:38.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:38.946+0000 7f79ed21b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T23:54:38.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:38.950+0000 7f79ed21b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T23:54:38.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:38.950+0000 7f79ed21b640 -1 bdev(0x55e69331b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T23:54:38.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:38.950+0000 7f79ed21b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T23:54:42.614 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T23:54:42.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:42.735+0000 7f859b727640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T23:54:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:42.736+0000 7f859b727640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T23:54:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:42.736+0000 7f859b727640 -1 bdev(0x55effb6ff800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T23:54:42.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:42.736+0000 7f859b727640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T23:54:46.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T23:54:46.674 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:46.764+0000 7f95ac82c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T23:54:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:46.764+0000 7f95ac82c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T23:54:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:46.764+0000 7f95ac82c640 -1 bdev(0x55f88130f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T23:54:46.765 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:46.764+0000 7f95ac82c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T23:54:50.410 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T23:54:50.437 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T23:54:50.438 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.438 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T23:54:50.504 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.504 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T23:54:50.570 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T23:54:50.635 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T23:54:50.700 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.700 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T23:54:50.766 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T23:54:50.831 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.832 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T23:54:50.887 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:50.887 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T23:54:50.943 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T23:54:50.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T23:54:51.007 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr.x] 2024-09-15T23:54:51.008 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmGfgJCxAAO99Xwfzdn6pwAplxw70kOQ== 2024-09-15T23:54:51.008 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.a] 2024-09-15T23:54:51.008 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmrl0yDhAAmges61AkNVATl3fkDcJtCA== 2024-09-15T23:54:51.008 INFO:teuthology.orchestra.run.smithi121.stdout:[mds.b] 2024-09-15T23:54:51.008 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dm1c5EFRAAQjii6dloQtB9r6b+oDUlfA== 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.0] 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC+c+dmWS98OBAABYXXLJEiQ32Ch8sOdjmGMQ== 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.1] 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDCc+dmae/mKxAAb1MVakHG7AWyXTfjXcC5Ww== 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:[osd.2] 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQDGc+dm0fWaLRAAVx8jT36dFL/hVkUBD+L4uA== 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg== 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:[client.1] 2024-09-15T23:54:51.009 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmOA9CIRAA3IDTN3uPbSBxbM2AFlMv4w== 2024-09-15T23:54:51.011 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:54:51.101 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:54:51.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:54:51.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:54:51.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:54:51.311 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:54:51.361 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:54:51.415 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:54:51.469 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T23:54:51.469 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T23:54:51.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:54:51.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T23:54:51.614 DEBUG:teuthology.orchestra.run.smithi121:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:54:51.669 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T23:54:51.670 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T23:54:51.670 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T23:54:51.712 INFO:tasks.ceph.mon.a:Started 2024-09-15T23:54:51.712 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T23:54:51.713 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T23:54:51.713 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T23:54:51.716 INFO:tasks.ceph.mgr.x:Started 2024-09-15T23:54:51.717 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T23:54:51.717 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.814+0000 7f7c22477640 1 Processor -- start 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.814+0000 7f7c22477640 1 -- start start 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.814+0000 7f7c22477640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.814+0000 7f7c22477640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c1c0a6d10 con 0x7f7c1c0a7140 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.814+0000 7f7c22477640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7c1c06e230 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7c1c0a7140 0x7f7c1c0a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:47748/0 (socket says 172.21.15.121:47748) 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43880/0 (socket says 172.21.15.121:43880) 2024-09-15T23:54:51.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1bfff640 1 -- 172.21.15.121:0/3414711214 learned_addr learned my addr 172.21.15.121:0/3414711214 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:54:51.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1b7fe640 1 -- 172.21.15.121:0/3414711214 >> v1:172.21.15.121:6789/0 conn(0x7f7c1c0a7140 legacy=0x7f7c1c0a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1affd640 1 -- 172.21.15.121:0/3414711214 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577241123 0 0) 0x7f7c1c0a6d10 con 0x7f7c1c0a7140 2024-09-15T23:54:51.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.815+0000 7f7c1b7fe640 1 -- 172.21.15.121:0/3414711214 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c0a3ae0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.816+0000 7f7c1b7fe640 1 --2- 172.21.15.121:0/3414711214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009720 tx=0x7f7c1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cabd8b8d997157 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c1affd640 1 -- 172.21.15.121:0/3414711214 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10037070 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c1affd640 1 -- 172.21.15.121:0/3414711214 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1002ad90 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c1affd640 1 -- 172.21.15.121:0/3414711214 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c10032590 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 -- 172.21.15.121:0/3414711214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 msgr2=0x7f7c1c13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 --2- 172.21.15.121:0/3414711214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009720 tx=0x7f7c1002a110 comp rx=0 tx=0).stop 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 -- 172.21.15.121:0/3414711214 shutdown_connections 2024-09-15T23:54:51.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 --2- 172.21.15.121:0/3414711214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c13eef0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 -- 172.21.15.121:0/3414711214 >> 172.21.15.121:0/3414711214 conn(0x7f7c1c0ac370 msgr2=0x7f7c1c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 -- 172.21.15.121:0/3414711214 shutdown_connections 2024-09-15T23:54:51.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.817+0000 7f7c22477640 1 -- 172.21.15.121:0/3414711214 wait complete. 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.818+0000 7f7c22477640 1 Processor -- start 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.818+0000 7f7c22477640 1 -- start start 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c22477640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c22477640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c0a7fc0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c1bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c1bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43888/0 (socket says 172.21.15.121:43888) 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c1bfff640 1 -- 172.21.15.121:0/2821286541 learned_addr learned my addr 172.21.15.121:0/2821286541 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c1bfff640 1 -- 172.21.15.121:0/2821286541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c0a0340 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c1bfff640 1 --2- 172.21.15.121:0/2821286541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c420 tx=0x7f7c0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c018070 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0074d0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c004950 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c0a11d0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c0a0030 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c0c01b070 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.819+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c0c01c3b0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.820+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c0a2980 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.822+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7c0c022080 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.883+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7c1c0732e0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.883+0000 7f7c18ff9640 1 -- 172.21.15.121:0/2821286541 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f7c0c004bd0 con 0x7f7c1c0a4ab0 2024-09-15T23:54:51.884 INFO:teuthology.orchestra.run.smithi121.stderr:adjusted tunables profile to default 2024-09-15T23:54:51.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 msgr2=0x7f7c1c1ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:51.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 --2- 172.21.15.121:0/2821286541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c420 tx=0x7f7c0c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 shutdown_connections 2024-09-15T23:54:51.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 --2- 172.21.15.121:0/2821286541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c1c0a4ab0 0x7f7c1c1ce5b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:51.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 >> 172.21.15.121:0/2821286541 conn(0x7f7c1c0ac370 msgr2=0x7f7c1c137180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:51.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 shutdown_connections 2024-09-15T23:54:51.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:51.884+0000 7f7c22477640 1 -- 172.21.15.121:0/2821286541 wait complete. 2024-09-15T23:54:51.896 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T23:54:51.896 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T23:54:51.896 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:51.896 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T23:54:51.920 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:51.921 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T23:54:51.985 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:54:51.985 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T23:54:52.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 39561d8c-cc1b-4bfc-9d5f-d5cb4747937b 0 2024-09-15T23:54:52.096 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.095+0000 7f8524fb5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:54:52.140 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.139+0000 7f8524fb5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:54:52.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.188+0000 7ff37fbbd640 1 Processor -- start 2024-09-15T23:54:52.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.188+0000 7ff37fbbd640 1 -- start start 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37fbbd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff37809df00 0x7ff37813cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37fbbd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37809d620 con 0x7ff378137f90 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37fbbd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff37809f3a0 con 0x7ff37809df00 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37d158640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff37809df00 0x7ff37813cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37d158640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff37809df00 0x7ff37813cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59580/0 (socket says 172.21.15.121:59580) 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37d959640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff378137f90 0x7ff378138370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48236/0 (socket says 172.21.15.121:48236) 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.189+0000 7ff37d158640 1 -- 172.21.15.121:0/1801885219 learned_addr learned my addr 172.21.15.121:0/1801885219 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.190+0000 7ff37d158640 1 -- 172.21.15.121:0/1801885219 >> v1:172.21.15.121:6789/0 conn(0x7ff378137f90 legacy=0x7ff378138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.190+0000 7ff37c957640 1 -- 172.21.15.121:0/1801885219 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423549972 0 0) 0x7ff37809d620 con 0x7ff378137f90 2024-09-15T23:54:52.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.190+0000 7ff37d158640 1 -- 172.21.15.121:0/1801885219 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37809fef0 con 0x7ff37809df00 2024-09-15T23:54:52.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.190+0000 7ff37d158640 1 --2- 172.21.15.121:0/1801885219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37813cd80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097f0 tx=0x7ff37402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ad6eb3e5cbe718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37c957640 1 -- 172.21.15.121:0/1801885219 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff374037070 con 0x7ff37809df00 2024-09-15T23:54:52.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37c957640 1 -- 172.21.15.121:0/1801885219 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff374032440 con 0x7ff37809df00 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37c957640 1 -- 172.21.15.121:0/1801885219 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37402ae60 con 0x7ff37809df00 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37fbbd640 1 -- 172.21.15.121:0/1801885219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 msgr2=0x7ff37813cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37fbbd640 1 --2- 172.21.15.121:0/1801885219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37813cd80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff3740097f0 tx=0x7ff37402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37fbbd640 1 -- 172.21.15.121:0/1801885219 shutdown_connections 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37fbbd640 1 --2- 172.21.15.121:0/1801885219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37813cd80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.191+0000 7ff37fbbd640 1 -- 172.21.15.121:0/1801885219 >> 172.21.15.121:0/1801885219 conn(0x7ff378070d60 msgr2=0x7ff378073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.192+0000 7ff37fbbd640 1 -- 172.21.15.121:0/1801885219 shutdown_connections 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.192+0000 7ff37fbbd640 1 -- 172.21.15.121:0/1801885219 wait complete. 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.192+0000 7ff37fbbd640 1 Processor -- start 2024-09-15T23:54:52.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.192+0000 7ff37fbbd640 1 -- start start 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37fbbd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37fbbd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff37809e7d0 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37d959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37d959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59584/0 (socket says 172.21.15.121:59584) 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37d959640 1 -- 172.21.15.121:0/137112763 learned_addr learned my addr 172.21.15.121:0/137112763 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37d959640 1 -- 172.21.15.121:0/137112763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37806e660 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff37d959640 1 --2- 172.21.15.121:0/137112763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c420 tx=0x7ff36800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff368018070 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.193+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3680074d0 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff378121060 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff368004950 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3780a9870 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff36801b070 con 0x7ff37809df00 2024-09-15T23:54:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff36801c3b0 con 0x7ff37809df00 2024-09-15T23:54:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.194+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff378121400 con 0x7ff37809df00 2024-09-15T23:54:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.197+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff368022020 con 0x7ff37809df00 2024-09-15T23:54:52.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.266+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "39561d8c-cc1b-4bfc-9d5f-d5cb4747937b", "id": 0} v 0) -- 0x7ff37806bbb0 con 0x7ff37809df00 2024-09-15T23:54:52.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.267+0000 7ff36e7fc640 1 -- 172.21.15.121:0/137112763 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "39561d8c-cc1b-4bfc-9d5f-d5cb4747937b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff368004af0 con 0x7ff37809df00 2024-09-15T23:54:52.268 INFO:teuthology.orchestra.run.smithi121.stdout:0 2024-09-15T23:54:52.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 msgr2=0x7ff37806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 --2- 172.21.15.121:0/137112763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c420 tx=0x7ff36800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 shutdown_connections 2024-09-15T23:54:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 --2- 172.21.15.121:0/137112763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff37809df00 0x7ff37806ccc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 >> 172.21.15.121:0/137112763 conn(0x7ff378070d60 msgr2=0x7ff37809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 shutdown_connections 2024-09-15T23:54:52.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.268+0000 7ff37fbbd640 1 -- 172.21.15.121:0/137112763 wait complete. 2024-09-15T23:54:52.280 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d 1 2024-09-15T23:54:52.286 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.286+0000 7f8524fb5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:54:52.340 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.339+0000 7f8524fb5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:54:52.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.383+0000 7ff9c73e4640 1 Processor -- start 2024-09-15T23:54:52.384 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.383+0000 7ff9c73e4640 1 -- start start 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c73e4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9c0136af0 0x7ff9c0136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c73e4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c00a2250 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c73e4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff9c01368f0 con 0x7ff9c0136af0 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c5180640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff9c0136af0 0x7ff9c0136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c497f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff9c00a2ef0 0x7ff9c00a48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48240/0 (socket says 172.21.15.121:48240) 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c497f640 1 -- 172.21.15.121:0/3340787975 learned_addr learned my addr 172.21.15.121:0/3340787975 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c5180640 1 -- 172.21.15.121:0/3340787975 >> v1:172.21.15.121:6789/0 conn(0x7ff9c00a2ef0 legacy=0x7ff9c00a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.384+0000 7ff9c5180640 1 -- 172.21.15.121:0/3340787975 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c00a0510 con 0x7ff9c0136af0 2024-09-15T23:54:52.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.385+0000 7ff9c5180640 1 --2- 172.21.15.121:0/3340787975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0136af0 0x7ff9c0136ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009720 tx=0x7ff9bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c3aadfe3037cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.385+0000 7ff9b3fff640 1 -- 172.21.15.121:0/3340787975 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc037070 con 0x7ff9c0136af0 2024-09-15T23:54:52.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.385+0000 7ff9b3fff640 1 -- 172.21.15.121:0/3340787975 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc02ad90 con 0x7ff9c0136af0 2024-09-15T23:54:52.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.385+0000 7ff9b3fff640 1 -- 172.21.15.121:0/3340787975 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc032590 con 0x7ff9c0136af0 2024-09-15T23:54:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3340787975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0136af0 msgr2=0x7ff9c0136ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 --2- 172.21.15.121:0/3340787975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0136af0 0x7ff9c0136ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009720 tx=0x7ff9bc02a110 comp rx=0 tx=0).stop 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3340787975 shutdown_connections 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 --2- 172.21.15.121:0/3340787975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c0136af0 0x7ff9c0136ed0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3340787975 >> 172.21.15.121:0/3340787975 conn(0x7ff9c00a94e0 msgr2=0x7ff9c00a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3340787975 shutdown_connections 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.386+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3340787975 wait complete. 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c73e4640 1 Processor -- start 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c73e4640 1 -- start start 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c73e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c73e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00a2510 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c5180640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c5180640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59608/0 (socket says 172.21.15.121:59608) 2024-09-15T23:54:52.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.387+0000 7ff9c5180640 1 -- 172.21.15.121:0/3605870701 learned_addr learned my addr 172.21.15.121:0/3605870701 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9c5180640 1 -- 172.21.15.121:0/3605870701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c0123120 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9c5180640 1 --2- 172.21.15.121:0/3605870701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009840 tx=0x7ff9bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc041070 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc03c460 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc037040 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0122590 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c0133f30 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9bc044070 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.388+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff9bc046ce0 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.389+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c0120a30 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.391+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff9bc046450 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.461+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d", "id": 1} v 0) -- 0x7ff9c0137770 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.462+0000 7ff9b1ffb640 1 -- 172.21.15.121:0/3605870701 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff9bc03c990 con 0x7ff9c00a2ef0 2024-09-15T23:54:52.463 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 msgr2=0x7ff9c011f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 --2- 172.21.15.121:0/3605870701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009840 tx=0x7ff9bc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 shutdown_connections 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 --2- 172.21.15.121:0/3605870701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c00a2ef0 0x7ff9c011f500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 >> 172.21.15.121:0/3605870701 conn(0x7ff9c00a94e0 msgr2=0x7ff9c006bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 shutdown_connections 2024-09-15T23:54:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.463+0000 7ff9c73e4640 1 -- 172.21.15.121:0/3605870701 wait complete. 2024-09-15T23:54:52.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 78d985e1-bd6a-4bcb-851b-1537c4898a3b 2 2024-09-15T23:54:52.498 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.497+0000 7f8524fb5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:54:52.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd357dd6640 1 Processor -- start 2024-09-15T23:54:52.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd357dd6640 1 -- start start 2024-09-15T23:54:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd357dd6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd35009f950 0x7fd3501349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd357dd6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35009f170 con 0x7fd35009e420 2024-09-15T23:54:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd357dd6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd35009db70 con 0x7fd35009f950 2024-09-15T23:54:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd355b72640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd35009f950 0x7fd3501349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd355371640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd35009e420 0x7fd350137940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48242/0 (socket says 172.21.15.121:48242) 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.573+0000 7fd355371640 1 -- 172.21.15.121:0/1735110167 learned_addr learned my addr 172.21.15.121:0/1735110167 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.574+0000 7fd355b72640 1 -- 172.21.15.121:0/1735110167 >> v1:172.21.15.121:6789/0 conn(0x7fd35009e420 legacy=0x7fd350137940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.574+0000 7fd355b72640 1 -- 172.21.15.121:0/1735110167 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35009ee60 con 0x7fd35009f950 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.574+0000 7fd355b72640 1 --2- 172.21.15.121:0/1735110167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009f950 0x7fd3501349e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009720 tx=0x7fd34c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d370aa59c831e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.574+0000 7fd354b70640 1 -- 172.21.15.121:0/1735110167 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c037070 con 0x7fd35009f950 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd354b70640 1 -- 172.21.15.121:0/1735110167 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c02ae20 con 0x7fd35009f950 2024-09-15T23:54:52.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd354b70640 1 -- 172.21.15.121:0/1735110167 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c032590 con 0x7fd35009f950 2024-09-15T23:54:52.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 -- 172.21.15.121:0/1735110167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009f950 msgr2=0x7fd3501349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 --2- 172.21.15.121:0/1735110167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009f950 0x7fd3501349e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009720 tx=0x7fd34c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 -- 172.21.15.121:0/1735110167 shutdown_connections 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 --2- 172.21.15.121:0/1735110167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009f950 0x7fd3501349e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 -- 172.21.15.121:0/1735110167 >> 172.21.15.121:0/1735110167 conn(0x7fd350070cc0 msgr2=0x7fd3500730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 -- 172.21.15.121:0/1735110167 shutdown_connections 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.575+0000 7fd357dd6640 1 -- 172.21.15.121:0/1735110167 wait complete. 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.576+0000 7fd357dd6640 1 Processor -- start 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.576+0000 7fd357dd6640 1 -- start start 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd357dd6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd357dd6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd35009e0c0 con 0x7fd35009e420 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd355b72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd355b72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59630/0 (socket says 172.21.15.121:59630) 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd355b72640 1 -- 172.21.15.121:0/52200160 learned_addr learned my addr 172.21.15.121:0/52200160 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:52.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd355b72640 1 -- 172.21.15.121:0/52200160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3500a65d0 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd355b72640 1 --2- 172.21.15.121:0/52200160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd34c02a1e0 tx=0x7fd34c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c042070 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34c03e590 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd34c037040 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3500a6f30 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3500a5f20 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.577+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd34c045070 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.578+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd34c047d20 con 0x7fd35009e420 2024-09-15T23:54:52.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.578+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3501352e0 con 0x7fd35009e420 2024-09-15T23:54:52.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.580+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd34c02ae20 con 0x7fd35009e420 2024-09-15T23:54:52.614 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.613+0000 7f8524fb5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:54:52.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.649+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd new", "uuid": "78d985e1-bd6a-4bcb-851b-1537c4898a3b", "id": 2} v 0) -- 0x7fd35006bbb0 con 0x7fd35009e420 2024-09-15T23:54:52.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.650+0000 7fd3467fc640 1 -- 172.21.15.121:0/52200160 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78d985e1-bd6a-4bcb-851b-1537c4898a3b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd34c047b10 con 0x7fd35009e420 2024-09-15T23:54:52.651 INFO:teuthology.orchestra.run.smithi121.stdout:2 2024-09-15T23:54:52.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 msgr2=0x7fd3500a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 --2- 172.21.15.121:0/52200160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd34c02a1e0 tx=0x7fd34c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 shutdown_connections 2024-09-15T23:54:52.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 --2- 172.21.15.121:0/52200160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35009e420 0x7fd3500a2b30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 >> 172.21.15.121:0/52200160 conn(0x7fd350070cc0 msgr2=0x7fd350130c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 shutdown_connections 2024-09-15T23:54:52.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.651+0000 7fd357dd6640 1 -- 172.21.15.121:0/52200160 wait complete. 2024-09-15T23:54:52.662 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T23:54:52.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T23:54:52.705 INFO:tasks.ceph.osd.0:Started 2024-09-15T23:54:52.705 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T23:54:52.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T23:54:52.708 INFO:tasks.ceph.osd.1:Started 2024-09-15T23:54:52.708 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T23:54:52.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T23:54:52.710 INFO:tasks.ceph.osd.2:Started 2024-09-15T23:54:52.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:52.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.834+0000 7fddee99f640 1 Processor -- start 2024-09-15T23:54:52.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fddee99f640 1 -- start start 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fddee99f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdde80a5a70 0x7fdde809f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fddee99f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde806cd00 con 0x7fdde80a5360 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fddee99f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdde80a6880 con 0x7fdde80a5a70 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fdded99d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdde80a5a70 0x7fdde809f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fdded19c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdde80a5360 0x7fdde8139b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48292/0 (socket says 172.21.15.121:48292) 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.835+0000 7fdded19c640 1 -- 172.21.15.121:0/1310994219 learned_addr learned my addr 172.21.15.121:0/1310994219 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fddec99b640 1 -- 172.21.15.121:0/1310994219 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788620088 0 0) 0x7fdde806cd00 con 0x7fdde80a5360 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fddec99b640 1 -- 172.21.15.121:0/1310994219 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd4003520 con 0x7fdde80a5360 2024-09-15T23:54:52.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fdded99d640 1 -- 172.21.15.121:0/1310994219 >> v1:172.21.15.121:6789/0 conn(0x7fdde80a5360 legacy=0x7fdde8139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fdded99d640 1 -- 172.21.15.121:0/1310994219 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde80a5850 con 0x7fdde80a5a70 2024-09-15T23:54:52.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fdded99d640 1 --2- 172.21.15.121:0/1310994219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5a70 0x7fdde809f460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009720 tx=0x7fdddc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bf428ce0586c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fddec99b640 1 -- 172.21.15.121:0/1310994219 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdddc037070 con 0x7fdde80a5a70 2024-09-15T23:54:52.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fddec99b640 1 -- 172.21.15.121:0/1310994219 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdddc02ad90 con 0x7fdde80a5a70 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.836+0000 7fddec99b640 1 -- 172.21.15.121:0/1310994219 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdddc032570 con 0x7fdde80a5a70 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 -- 172.21.15.121:0/1310994219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5a70 msgr2=0x7fdde809f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 --2- 172.21.15.121:0/1310994219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5a70 0x7fdde809f460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009720 tx=0x7fdddc02a110 comp rx=0 tx=0).stop 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 -- 172.21.15.121:0/1310994219 shutdown_connections 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 --2- 172.21.15.121:0/1310994219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5a70 0x7fdde809f460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 -- 172.21.15.121:0/1310994219 >> 172.21.15.121:0/1310994219 conn(0x7fdde80aa3f0 msgr2=0x7fdde80aa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 -- 172.21.15.121:0/1310994219 shutdown_connections 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.837+0000 7fddee99f640 1 -- 172.21.15.121:0/1310994219 wait complete. 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.838+0000 7fddee99f640 1 Processor -- start 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.838+0000 7fddee99f640 1 -- start start 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.838+0000 7fddee99f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.838+0000 7fddee99f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80a5fd0 con 0x7fdde80a5360 2024-09-15T23:54:52.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fdded99d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fdded99d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59680/0 (socket says 172.21.15.121:59680) 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fdded99d640 1 -- 172.21.15.121:0/1549737284 learned_addr learned my addr 172.21.15.121:0/1549737284 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fdded99d640 1 -- 172.21.15.121:0/1549737284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde81228d0 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fdded99d640 1 --2- 172.21.15.121:0/1549737284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdddc02a150 tx=0x7fdddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdddc037050 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdddc043070 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde8124120 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdddc03e450 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde81225f0 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdddc03e6c0 con 0x7fdde80a5360 2024-09-15T23:54:52.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.839+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fdddc048460 con 0x7fdde80a5360 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.840+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde809f460 con 0x7fdde80a5360 2024-09-15T23:54:52.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.842+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdddc03e9b0 con 0x7fdde80a5360 2024-09-15T23:54:52.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.899+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdde806bbb0 con 0x7fdde80a5360 2024-09-15T23:54:52.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.900+0000 7fddda7fc640 1 -- 172.21.15.121:0/1549737284 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) ==== 74+0+3427 (secure 0 0 0) 0x7fdddc03ec50 con 0x7fdde80a5360 2024-09-15T23:54:52.901 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:54:52.901 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:54:52.650884+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:52.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 msgr2=0x7fdde8120ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 --2- 172.21.15.121:0/1549737284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdddc02a150 tx=0x7fdddc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 shutdown_connections 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 --2- 172.21.15.121:0/1549737284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdde80a5360 0x7fdde8120ad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 >> 172.21.15.121:0/1549737284 conn(0x7fdde80aa3f0 msgr2=0x7fdde80725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 shutdown_connections 2024-09-15T23:54:52.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:54:52.901+0000 7fddee99f640 1 -- 172.21.15.121:0/1549737284 wait complete. 2024-09-15T23:54:52.913 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T23:54:52.914 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T23:54:52.963 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:52.962+0000 7f8524fb5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:54:53.016 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:53.015+0000 7f8524fb5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:54:53.166 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:53.165+0000 7f8524fb5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:54:53.216 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:53.310 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.309+0000 7f375f445640 1 Processor -- start 2024-09-15T23:54:53.310 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.309+0000 7f375f445640 1 -- start start 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375f445640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f375809da60 0x7f375809de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375f445640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37580a1d80 con 0x7f375809fd50 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375f445640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f37580aca60 con 0x7f375809da60 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375d1e1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f375809da60 0x7f375809de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375c9e0640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f375809fd50 0x7f3758139e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48306/0 (socket says 172.21.15.121:48306) 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375c9e0640 1 -- 172.21.15.121:0/1606102196 learned_addr learned my addr 172.21.15.121:0/1606102196 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375d1e1640 1 -- 172.21.15.121:0/1606102196 >> v1:172.21.15.121:6789/0 conn(0x7f375809fd50 legacy=0x7f3758139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f375d1e1640 1 -- 172.21.15.121:0/1606102196 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375809f440 con 0x7f375809da60 2024-09-15T23:54:53.311 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.310+0000 7f374ffff640 1 -- 172.21.15.121:0/1606102196 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841897636 0 0) 0x7f37580a1d80 con 0x7f375809fd50 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.311+0000 7f375d1e1640 1 --2- 172.21.15.121:0/1606102196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f375809de40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3754009720 tx=0x7f375402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6900d64047e26273 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.311+0000 7f374ffff640 1 -- 172.21.15.121:0/1606102196 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3754037070 con 0x7f375809da60 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.311+0000 7f374ffff640 1 -- 172.21.15.121:0/1606102196 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375402ad90 con 0x7f375809da60 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.311+0000 7f374ffff640 1 -- 172.21.15.121:0/1606102196 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3754032590 con 0x7f375809da60 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 -- 172.21.15.121:0/1606102196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 msgr2=0x7f375809de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 --2- 172.21.15.121:0/1606102196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f375809de40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3754009720 tx=0x7f375402a110 comp rx=0 tx=0).stop 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 -- 172.21.15.121:0/1606102196 shutdown_connections 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 --2- 172.21.15.121:0/1606102196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f375809de40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 -- 172.21.15.121:0/1606102196 >> 172.21.15.121:0/1606102196 conn(0x7f375806da50 msgr2=0x7f375806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 -- 172.21.15.121:0/1606102196 shutdown_connections 2024-09-15T23:54:53.313 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.312+0000 7f375f445640 1 -- 172.21.15.121:0/1606102196 wait complete. 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375f445640 1 Processor -- start 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375f445640 1 -- start start 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375f445640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375f445640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37580a05c0 con 0x7f375809da60 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375d1e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375d1e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59702/0 (socket says 172.21.15.121:59702) 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.313+0000 7f375d1e1640 1 -- 172.21.15.121:0/2045801535 learned_addr learned my addr 172.21.15.121:0/2045801535 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f375d1e1640 1 -- 172.21.15.121:0/2045801535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37580a9710 con 0x7f375809da60 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f375d1e1640 1 --2- 172.21.15.121:0/2045801535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3754009720 tx=0x7f37540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3754041070 con 0x7f375809da60 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375403c460 con 0x7f375809da60 2024-09-15T23:54:53.317 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37580ab000 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3754037040 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37580aad20 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3754044070 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.314+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3754046b10 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.315+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37580a9540 con 0x7f375809da60 2024-09-15T23:54:53.318 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.317+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3754046680 con 0x7f375809da60 2024-09-15T23:54:53.393 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.392+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f375809de40 con 0x7f375809da60 2024-09-15T23:54:53.394 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.393+0000 7f374dffb640 1 -- 172.21.15.121:0/2045801535 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) ==== 74+0+3427 (secure 0 0 0) 0x7f3754046860 con 0x7f375809da60 2024-09-15T23:54:53.394 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-15T23:54:53.394 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":5,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:54:52.650884+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 msgr2=0x7f3758123bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 --2- 172.21.15.121:0/2045801535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3754009720 tx=0x7f37540046c0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 shutdown_connections 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 --2- 172.21.15.121:0/2045801535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f375809da60 0x7f3758123bb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 >> 172.21.15.121:0/2045801535 conn(0x7f375806da50 msgr2=0x7f375813a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 shutdown_connections 2024-09-15T23:54:53.395 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:53.394+0000 7f375f445640 1 -- 172.21.15.121:0/2045801535 wait complete. 2024-09-15T23:54:53.404 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-15T23:54:54.128 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.127+0000 7f8524fb5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:54:54.312 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.181+0000 7f8524fb5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:54:54.411 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-15T23:54:54.410+0000 7f732fd19640 -1 Falling back to public interface 2024-09-15T23:54:54.547 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.546+0000 7f8524fb5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:54:54.632 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.631+0000 7f8524fb5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:54:54.684 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-15T23:54:54.684+0000 7f8758f89640 -1 Falling back to public interface 2024-09-15T23:54:54.685 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-15T23:54:54.684+0000 7f9d9382e640 -1 Falling back to public interface 2024-09-15T23:54:54.685 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-15T23:54:54.684+0000 7f9d91e53640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6811/0: (98) Address already in use 2024-09-15T23:54:54.742 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.741+0000 7f8524fb5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:54:54.787 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.787+0000 7f8524fb5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:54:54.899 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.898+0000 7f8524fb5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:54:54.951 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.950+0000 7f8524fb5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:54:54.998 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:54.997+0000 7f8524fb5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:54:55.108 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.107+0000 7f8524fb5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:54:55.157 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.157+0000 7f8524fb5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:54:55.208 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.207+0000 7f8524fb5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:54:55.277 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.276+0000 7f8524fb5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:54:55.321 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.320+0000 7f8524fb5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:54:55.365 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:55.364+0000 7f8524fb5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:54:56.017 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:56.016+0000 7f8524fb5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:54:57.025 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:54:57.024+0000 7f84c587c640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-15T23:54:58.459 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-15T23:54:58.458+0000 7f732fd19640 -1 osd.0 0 log_to_monitors true 2024-09-15T23:54:58.784 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-15T23:54:58.783+0000 7f8758f89640 -1 osd.1 0 log_to_monitors true 2024-09-15T23:54:59.233 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-15T23:54:59.232+0000 7f9d9382e640 -1 osd.2 0 log_to_monitors true 2024-09-15T23:54:59.707 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:54:59.800 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.798+0000 7f6a079e8640 1 Processor -- start 2024-09-15T23:54:59.800 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.798+0000 7f6a079e8640 1 -- start start 2024-09-15T23:54:59.800 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a079e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a0009f810 0x7f6a0013bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:59.800 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a079e8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a0009fe50 con 0x7f6a00136ee0 2024-09-15T23:54:59.800 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a079e8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6a001379d0 con 0x7f6a0009f810 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a04f83640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a0009f810 0x7f6a0013bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a04f83640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a0009f810 0x7f6a0013bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59806/0 (socket says 172.21.15.121:59806) 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a05784640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6a00136ee0 0x7f6a001372c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:48312/0 (socket says 172.21.15.121:48312) 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a04f83640 1 -- 172.21.15.121:0/863704575 learned_addr learned my addr 172.21.15.121:0/863704575 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a04f83640 1 -- 172.21.15.121:0/863704575 >> v1:172.21.15.121:6789/0 conn(0x7f6a00136ee0 legacy=0x7f6a001372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:59.801 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.799+0000 7f6a04f83640 1 -- 172.21.15.121:0/863704575 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a000723f0 con 0x7f6a0009f810 2024-09-15T23:54:59.805 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.800+0000 7f6a04f83640 1 --2- 172.21.15.121:0/863704575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0013bdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce35c7fb20e4a390 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:59.806 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.800+0000 7f69f7fff640 1 -- 172.21.15.121:0/863704575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f0037070 con 0x7f6a0009f810 2024-09-15T23:54:59.806 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.800+0000 7f69f7fff640 1 -- 172.21.15.121:0/863704575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0032440 con 0x7f6a0009f810 2024-09-15T23:54:59.806 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.800+0000 7f69f7fff640 1 -- 172.21.15.121:0/863704575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f002ae60 con 0x7f6a0009f810 2024-09-15T23:54:59.806 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 -- 172.21.15.121:0/863704575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 msgr2=0x7f6a0013bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:59.806 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 --2- 172.21.15.121:0/863704575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0013bdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69f00097f0 tx=0x7f69f002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 -- 172.21.15.121:0/863704575 shutdown_connections 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 --2- 172.21.15.121:0/863704575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0013bdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 -- 172.21.15.121:0/863704575 >> 172.21.15.121:0/863704575 conn(0x7f6a0009ae60 msgr2=0x7f6a0009d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 -- 172.21.15.121:0/863704575 shutdown_connections 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.801+0000 7f6a079e8640 1 -- 172.21.15.121:0/863704575 wait complete. 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a079e8640 1 Processor -- start 2024-09-15T23:54:59.807 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a079e8640 1 -- start start 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a079e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a079e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a00072c90 con 0x7f6a0009f810 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a05784640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a05784640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59810/0 (socket says 172.21.15.121:59810) 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a05784640 1 -- 172.21.15.121:0/1876366718 learned_addr learned my addr 172.21.15.121:0/1876366718 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a05784640 1 -- 172.21.15.121:0/1876366718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00123170 con 0x7f6a0009f810 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.802+0000 7f6a05784640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e890 tx=0x7f69fc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69fc00ca80 con 0x7f6a0009f810 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc00cc20 con 0x7f6a0009f810 2024-09-15T23:54:59.808 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a001233f0 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69fc007070 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a00120ec0 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.803+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f69fc007210 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.804+0000 7f69f5ffb640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 0x7f69e403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.804+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a000a7880 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.804+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1182+0+0 (secure 0 0 0) 0x7f69fc04cc60 con 0x7f6a0009f810 2024-09-15T23:54:59.809 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.804+0000 7f6a04f83640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 0x7f69e403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:54:59.810 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.804+0000 7f6a04f83640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 0x7f69e403a6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69f0034000 tx=0x7f69f002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:54:59.811 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.809+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69fc015020 con 0x7f6a0009f810 2024-09-15T23:54:59.974 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.973+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a0006fd40 con 0x7f6a0009f810 2024-09-15T23:54:59.975 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.974+0000 7f69f5ffb640 1 -- 172.21.15.121:0/1876366718 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+3427 (secure 0 0 0) 0x7f6a00123170 con 0x7f6a0009f810 2024-09-15T23:54:59.975 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-15T23:54:59.975 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":6,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:54:59.024321+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:54:59.977 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 msgr2=0x7f69e403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 0x7f69e403a6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69f0034000 tx=0x7f69f002e000 comp rx=0 tx=0).stop 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 msgr2=0x7f6a0011ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00e890 tx=0x7f69fc00ed50 comp rx=0 tx=0).stop 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 shutdown_connections 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f69e4038210 0x7f69e403a6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:59.978 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 --2- 172.21.15.121:0/1876366718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a0009f810 0x7f6a0011ef40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:54:59.979 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 >> 172.21.15.121:0/1876366718 conn(0x7f6a0009ae60 msgr2=0x7f6a0009b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:54:59.979 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 shutdown_connections 2024-09-15T23:54:59.979 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:54:59.976+0000 7f6a079e8640 1 -- 172.21.15.121:0/1876366718 wait complete. 2024-09-15T23:54:59.986 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-15T23:55:01.371 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-15T23:55:01.370+0000 7f732b485640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T23:55:01.386 INFO:tasks.ceph.osd.0.smithi121.stderr:2024-09-15T23:55:01.385+0000 7f7323ab7640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:55:01.402 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-15T23:55:01.401+0000 7f87546f5640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T23:55:01.418 INFO:tasks.ceph.osd.1.smithi121.stderr:2024-09-15T23:55:01.417+0000 7f874cd27640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:55:01.963 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-15T23:55:01.962+0000 7f9d8e617640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T23:55:01.972 INFO:tasks.ceph.osd.2.smithi121.stderr:2024-09-15T23:55:01.971+0000 7f9d86c49640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:55:04.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:06.289 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:06.380 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.379+0000 7f0324037640 1 Processor -- start 2024-09-15T23:55:06.380 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.379+0000 7f0324037640 1 -- start start 2024-09-15T23:55:06.381 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f0324037640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f031c070d60 0x7f031c13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.381 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f0324037640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f031c09fed0 con 0x7f031c06fa40 2024-09-15T23:55:06.381 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f0324037640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f031c0a0f00 con 0x7f031c070d60 2024-09-15T23:55:06.381 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f03215d2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f031c070d60 0x7f031c13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.381 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f03215d2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f031c070d60 0x7f031c13d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57778/0 (socket says 172.21.15.121:57778) 2024-09-15T23:55:06.382 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f03215d2640 1 -- 172.21.15.121:0/2017136197 learned_addr learned my addr 172.21.15.121:0/2017136197 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:06.382 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f03215d2640 1 -- 172.21.15.121:0/2017136197 >> v1:172.21.15.121:6789/0 conn(0x7f031c06fa40 legacy=0x7f031c06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.382 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.380+0000 7f03215d2640 1 -- 172.21.15.121:0/2017136197 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c0711e0 con 0x7f031c070d60 2024-09-15T23:55:06.382 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.381+0000 7f03215d2640 1 --2- 172.21.15.121:0/2017136197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c070d60 0x7f031c13d0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f030c0097f0 tx=0x7f030c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d663a5acf6ad5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.381+0000 7f0320dd1640 1 -- 172.21.15.121:0/2017136197 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c037070 con 0x7f031c070d60 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.381+0000 7f0320dd1640 1 -- 172.21.15.121:0/2017136197 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030c032440 con 0x7f031c070d60 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.381+0000 7f0320dd1640 1 -- 172.21.15.121:0/2017136197 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c032740 con 0x7f031c070d60 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 -- 172.21.15.121:0/2017136197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c070d60 msgr2=0x7f031c13d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 --2- 172.21.15.121:0/2017136197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c070d60 0x7f031c13d0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f030c0097f0 tx=0x7f030c02a270 comp rx=0 tx=0).stop 2024-09-15T23:55:06.383 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 -- 172.21.15.121:0/2017136197 shutdown_connections 2024-09-15T23:55:06.384 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 --2- 172.21.15.121:0/2017136197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c070d60 0x7f031c13d0b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.384 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 -- 172.21.15.121:0/2017136197 >> 172.21.15.121:0/2017136197 conn(0x7f031c09ae60 msgr2=0x7f031c09d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:06.384 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 -- 172.21.15.121:0/2017136197 shutdown_connections 2024-09-15T23:55:06.384 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.382+0000 7f0324037640 1 -- 172.21.15.121:0/2017136197 wait complete. 2024-09-15T23:55:06.385 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.383+0000 7f0324037640 1 Processor -- start 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.383+0000 7f0324037640 1 -- start start 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0324037640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0324037640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f031c070530 con 0x7f031c06fa40 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0321dd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0321dd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57790/0 (socket says 172.21.15.121:57790) 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0321dd3640 1 -- 172.21.15.121:0/2360254680 learned_addr learned my addr 172.21.15.121:0/2360254680 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0321dd3640 1 -- 172.21.15.121:0/2360254680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c11f480 con 0x7f031c06fa40 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0321dd3640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f031800c450 tx=0x7f031800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0318017070 con 0x7f031c06fa40 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0318005220 con 0x7f031c06fa40 2024-09-15T23:55:06.386 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c11f030 con 0x7f031c06fa40 2024-09-15T23:55:06.387 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03180035f0 con 0x7f031c06fa40 2024-09-15T23:55:06.387 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.384+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c120570 con 0x7f031c06fa40 2024-09-15T23:55:06.387 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.385+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f031801a070 con 0x7f031c06fa40 2024-09-15T23:55:06.388 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.385+0000 7f03127fc640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 0x7f030003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.388 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.385+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c073f00 con 0x7f031c06fa40 2024-09-15T23:55:06.388 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.386+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2587+0+0 (secure 0 0 0) 0x7f031804a0c0 con 0x7f031c06fa40 2024-09-15T23:55:06.388 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.386+0000 7f03215d2640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 0x7f030003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.388 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.386+0000 7f03215d2640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 0x7f030003a6d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f030c034000 tx=0x7f030c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.391 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.390+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f031c073f00 con 0x7f031c06fa40 2024-09-15T23:55:06.556 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.555+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f031c0a0930 con 0x7f031c06fa40 2024-09-15T23:55:06.556 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.556+0000 7f03127fc640 1 -- 172.21.15.121:0/2360254680 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+6791 (secure 0 0 0) 0x7f031801ac60 con 0x7f031c06fa40 2024-09-15T23:55:06.557 INFO:teuthology.misc.health.smithi121.stdout: 2024-09-15T23:55:06.557 INFO:teuthology.misc.health.smithi121.stdout:{"epoch":13,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:06.380200+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 msgr2=0x7f030003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 0x7f030003a6d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f030c034000 tx=0x7f030c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 msgr2=0x7f031c120d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f031800c450 tx=0x7f031800c910 comp rx=0 tx=0).stop 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 shutdown_connections 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0300038210 0x7f030003a6d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 --2- 172.21.15.121:0/2360254680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f031c06fa40 0x7f031c120d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 >> 172.21.15.121:0/2360254680 conn(0x7f031c09ae60 msgr2=0x7f031c1c00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 shutdown_connections 2024-09-15T23:55:06.559 INFO:teuthology.misc.health.smithi121.stderr:2024-09-15T23:55:06.558+0000 7f0324037640 1 -- 172.21.15.121:0/2360254680 wait complete. 2024-09-15T23:55:06.567 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-15T23:55:06.568 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T23:55:06.568 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:55:06.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:55:06.571 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:55:06.571 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:55:06.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:55:06.573 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:55:06.573 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T23:55:06.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:06.645 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:55:06.645 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:55:06.646 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-15T23:55:06.645+0000 7f2b14778640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6826/0: (98) Address already in use 2024-09-15T23:55:06.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88b14ba640 1 Processor -- start 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88b14ba640 1 -- start start 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88b14ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f88ac0a4c20 0x7f88ac13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88b14ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac13a080 con 0x7f88ac13a280 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88b14ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac0a3d50 con 0x7f88ac0a4c20 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88aa7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f88ac0a4c20 0x7f88ac13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88aaffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f88ac13a280 0x7f88ac13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45600/0 (socket says 172.21.15.121:45600) 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.673+0000 7f88aaffd640 1 -- 172.21.15.121:0/2271128515 learned_addr learned my addr 172.21.15.121:0/2271128515 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:06.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88aa7fc640 1 -- 172.21.15.121:0/2271128515 >> v1:172.21.15.121:6789/0 conn(0x7f88ac13a280 legacy=0x7f88ac13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88aa7fc640 1 -- 172.21.15.121:0/2271128515 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0a3f80 con 0x7f88ac0a4c20 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88aa7fc640 1 --2- 172.21.15.121:0/2271128515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac13f060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009720 tx=0x7f88a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3096ee6fc7a4f184 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88a9ffb640 1 -- 172.21.15.121:0/2271128515 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a0037070 con 0x7f88ac0a4c20 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88a9ffb640 1 -- 172.21.15.121:0/2271128515 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a002ad90 con 0x7f88ac0a4c20 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.674+0000 7f88a9ffb640 1 -- 172.21.15.121:0/2271128515 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88a0032590 con 0x7f88ac0a4c20 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 -- 172.21.15.121:0/2271128515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 msgr2=0x7f88ac13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 --2- 172.21.15.121:0/2271128515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac13f060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009720 tx=0x7f88a002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 -- 172.21.15.121:0/2271128515 shutdown_connections 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 --2- 172.21.15.121:0/2271128515 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac13f060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 -- 172.21.15.121:0/2271128515 >> 172.21.15.121:0/2271128515 conn(0x7f88ac0ac3e0 msgr2=0x7f88ac0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 -- 172.21.15.121:0/2271128515 shutdown_connections 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.675+0000 7f88b14ba640 1 -- 172.21.15.121:0/2271128515 wait complete. 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.676+0000 7f88b14ba640 1 Processor -- start 2024-09-15T23:55:06.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.676+0000 7f88b14ba640 1 -- start start 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88b14ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88b14ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0a7ec0 con 0x7f88ac0a4c20 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88aaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88aaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57838/0 (socket says 172.21.15.121:57838) 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88aaffd640 1 -- 172.21.15.121:0/72295257 learned_addr learned my addr 172.21.15.121:0/72295257 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:06.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88aaffd640 1 -- 172.21.15.121:0/72295257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0a2630 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88aaffd640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f889c00c4a0 tx=0x7f889c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c017070 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c005c10 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac125100 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.677+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f889c007070 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.678+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac0ab460 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.678+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f889c01a070 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.679+0000 7f88937fe640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 0x7f889803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.679+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac122cd0 con 0x7f88ac0a4c20 2024-09-15T23:55:06.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.679+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2587+0+0 (secure 0 0 0) 0x7f889c04a060 con 0x7f88ac0a4c20 2024-09-15T23:55:06.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.679+0000 7f88aa7fc640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 0x7f889803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:06.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.679+0000 7f88aa7fc640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 0x7f889803a6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f88a0034000 tx=0x7f88a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:06.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.683+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f889c01b3b0 con 0x7f88ac0a4c20 2024-09-15T23:55:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.882+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88ac075fe0 con 0x7f88ac0a4c20 2024-09-15T23:55:06.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.883+0000 7f88937fe640 1 -- 172.21.15.121:0/72295257 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f889c010300 con 0x7f88ac0a4c20 2024-09-15T23:55:06.884 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:06.884 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"btime":"2024-09-15T23:55:06:649086+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:55:06.884 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 2 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 msgr2=0x7f889803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 0x7f889803a6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f88a0034000 tx=0x7f88a002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 msgr2=0x7f88ac0a1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f889c00c4a0 tx=0x7f889c00c960 comp rx=0 tx=0).stop 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 shutdown_connections 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8898038210 0x7f889803a6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 --2- 172.21.15.121:0/72295257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f88ac0a4c20 0x7f88ac0a1160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:06.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 >> 172.21.15.121:0/72295257 conn(0x7f88ac0ac3e0 msgr2=0x7f88ac139550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:06.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 shutdown_connections 2024-09-15T23:55:06.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:06.885+0000 7f88b14ba640 1 -- 172.21.15.121:0/72295257 wait complete. 2024-09-15T23:55:08.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:09.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.006+0000 7f4ec783c640 1 Processor -- start 2024-09-15T23:55:09.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.006+0000 7f4ec783c640 1 -- start start 2024-09-15T23:55:09.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec783c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4ec013a280 0x7f4ec013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec783c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec013a080 con 0x7f4ec00a4c20 2024-09-15T23:55:09.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec783c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec00a3d50 con 0x7f4ec013a280 2024-09-15T23:55:09.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec55d8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4ec013a280 0x7f4ec013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec4dd7640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4ec00a4c20 0x7f4ec00a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45610/0 (socket says 172.21.15.121:45610) 2024-09-15T23:55:09.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec4dd7640 1 -- 172.21.15.121:0/125683692 learned_addr learned my addr 172.21.15.121:0/125683692 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:09.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec55d8640 1 -- 172.21.15.121:0/125683692 >> v1:172.21.15.121:6789/0 conn(0x7f4ec00a4c20 legacy=0x7f4ec00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4ec55d8640 1 -- 172.21.15.121:0/125683692 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00a3f80 con 0x7f4ec013a280 2024-09-15T23:55:09.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.007+0000 7f4eb7fff640 1 -- 172.21.15.121:0/125683692 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905332986 0 0) 0x7f4ec013a080 con 0x7f4ec00a4c20 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.008+0000 7f4ec55d8640 1 --2- 172.21.15.121:0/125683692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec013a280 0x7f4ec013a660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009720 tx=0x7f4ebc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38b3b3fc593f7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.008+0000 7f4eb7fff640 1 -- 172.21.15.121:0/125683692 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ebc037070 con 0x7f4ec013a280 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.008+0000 7f4eb7fff640 1 -- 172.21.15.121:0/125683692 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ebc02ad90 con 0x7f4ec013a280 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.008+0000 7f4eb7fff640 1 -- 172.21.15.121:0/125683692 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ebc032590 con 0x7f4ec013a280 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 -- 172.21.15.121:0/125683692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec013a280 msgr2=0x7f4ec013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 --2- 172.21.15.121:0/125683692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec013a280 0x7f4ec013a660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009720 tx=0x7f4ebc02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:09.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 -- 172.21.15.121:0/125683692 shutdown_connections 2024-09-15T23:55:09.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 --2- 172.21.15.121:0/125683692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec013a280 0x7f4ec013a660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 -- 172.21.15.121:0/125683692 >> 172.21.15.121:0/125683692 conn(0x7f4ec00ac3e0 msgr2=0x7f4ec00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 -- 172.21.15.121:0/125683692 shutdown_connections 2024-09-15T23:55:09.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.009+0000 7f4ec783c640 1 -- 172.21.15.121:0/125683692 wait complete. 2024-09-15T23:55:09.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec783c640 1 Processor -- start 2024-09-15T23:55:09.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec783c640 1 -- start start 2024-09-15T23:55:09.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec783c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec783c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec0139d40 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec55d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec55d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57854/0 (socket says 172.21.15.121:57854) 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.010+0000 7f4ec55d8640 1 -- 172.21.15.121:0/3791279590 learned_addr learned my addr 172.21.15.121:0/3791279590 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4ec55d8640 1 -- 172.21.15.121:0/3791279590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec0124fa0 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4ec55d8640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009720 tx=0x7f4ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ebc041070 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ebc03c460 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ebc037040 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec0137fd0 con 0x7f4ec00a4c20 2024-09-15T23:55:09.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.011+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec01228e0 con 0x7f4ec00a4c20 2024-09-15T23:55:09.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.012+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ebc044070 con 0x7f4ec00a4c20 2024-09-15T23:55:09.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.012+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec006dab0 con 0x7f4ec00a4c20 2024-09-15T23:55:09.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.012+0000 7f4eb5ffb640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 0x7f4ea403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.012+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2587+0+0 (secure 0 0 0) 0x7f4ebc06b950 con 0x7f4ec00a4c20 2024-09-15T23:55:09.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.012+0000 7f4ec4dd7640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 0x7f4ea403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.013+0000 7f4ec4dd7640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 0x7f4ea403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0000c00 tx=0x7f4eb0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.017+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ebc03a520 con 0x7f4ec00a4c20 2024-09-15T23:55:09.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.216+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ec00a2f50 con 0x7f4ec00a4c20 2024-09-15T23:55:09.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.217+0000 7f4eb5ffb640 1 -- 172.21.15.121:0/3791279590 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2261 (secure 0 0 0) 0x7f4ebc03a780 con 0x7f4ec00a4c20 2024-09-15T23:55:09.218 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:09.218 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"btime":"2024-09-15T23:55:07:649626+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:55:09.218 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 3 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 msgr2=0x7f4ea403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 0x7f4ea403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0000c00 tx=0x7f4eb0007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 msgr2=0x7f4ec00a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009720 tx=0x7f4ebc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 shutdown_connections 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ea40382a0 0x7f4ea403a760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 --2- 172.21.15.121:0/3791279590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec00a4c20 0x7f4ec00a1020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 >> 172.21.15.121:0/3791279590 conn(0x7f4ec00ac3e0 msgr2=0x7f4ec00aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 shutdown_connections 2024-09-15T23:55:09.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.219+0000 7f4ec783c640 1 -- 172.21.15.121:0/3791279590 wait complete. 2024-09-15T23:55:09.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:55:09.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.327+0000 7f9268c37640 1 Processor -- start 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.327+0000 7f9268c37640 1 -- start start 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.327+0000 7f9268c37640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9264135b50 0x7f926409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.327+0000 7f9268c37640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926409b020 con 0x7f9264135f30 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.327+0000 7f9268c37640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f926409b310 con 0x7f9264135b50 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f926259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9264135b50 0x7f926409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f9261d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9264135f30 0x7f92640a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45624/0 (socket says 172.21.15.121:45624) 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f9261d9b640 1 -- 172.21.15.121:0/268037575 learned_addr learned my addr 172.21.15.121:0/268037575 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f926259c640 1 -- 172.21.15.121:0/268037575 >> v1:172.21.15.121:6789/0 conn(0x7f9264135f30 legacy=0x7f92640a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f926259c640 1 -- 172.21.15.121:0/268037575 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92640a08c0 con 0x7f9264135b50 2024-09-15T23:55:09.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f926159a640 1 -- 172.21.15.121:0/268037575 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15595453 0 0) 0x7f926409b020 con 0x7f9264135f30 2024-09-15T23:55:09.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.328+0000 7f926259c640 1 --2- 172.21.15.121:0/268037575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409aae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9254009720 tx=0x7f925402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390d7c66648f26f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f926159a640 1 -- 172.21.15.121:0/268037575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9254037070 con 0x7f9264135b50 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f926159a640 1 -- 172.21.15.121:0/268037575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925402ae20 con 0x7f9264135b50 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f926159a640 1 -- 172.21.15.121:0/268037575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9254032590 con 0x7f9264135b50 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 -- 172.21.15.121:0/268037575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 msgr2=0x7f926409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 --2- 172.21.15.121:0/268037575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409aae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9254009720 tx=0x7f925402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 -- 172.21.15.121:0/268037575 shutdown_connections 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 --2- 172.21.15.121:0/268037575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409aae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 -- 172.21.15.121:0/268037575 >> 172.21.15.121:0/268037575 conn(0x7f92640a85e0 msgr2=0x7f92640a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 -- 172.21.15.121:0/268037575 shutdown_connections 2024-09-15T23:55:09.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.329+0000 7f9268c37640 1 -- 172.21.15.121:0/268037575 wait complete. 2024-09-15T23:55:09.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.330+0000 7f9268c37640 1 Processor -- start 2024-09-15T23:55:09.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.330+0000 7f9268c37640 1 -- start start 2024-09-15T23:55:09.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9268c37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9268c37640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92640a5430 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f926259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f926259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57880/0 (socket says 172.21.15.121:57880) 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f926259c640 1 -- 172.21.15.121:0/945373363 learned_addr learned my addr 172.21.15.121:0/945373363 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f926259c640 1 -- 172.21.15.121:0/945373363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264120ed0 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f926259c640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f925402a1e0 tx=0x7f92540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9254042070 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925403e590 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92640a32c0 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9254037040 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.331+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9264073650 con 0x7f9264135b50 2024-09-15T23:55:09.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.332+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9254045070 con 0x7f9264135b50 2024-09-15T23:55:09.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.332+0000 7f9252ffd640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 0x7f924403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.332+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2587+0+0 (secure 0 0 0) 0x7f925406b740 con 0x7f9264135b50 2024-09-15T23:55:09.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.332+0000 7f9261d9b640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 0x7f924403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.332+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9264120ce0 con 0x7f9264135b50 2024-09-15T23:55:09.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.333+0000 7f9261d9b640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 0x7f924403a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.337+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f925403e8b0 con 0x7f9264135b50 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.505+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9264136350 con 0x7f9264135b50 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.505+0000 7f9252ffd640 1 -- 172.21.15.121:0/945373363 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) ==== 84+0+65 (secure 0 0 0) 0x7f925403ec30 con 0x7f9264135b50 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:55:09.506 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:09.507 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:55:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 msgr2=0x7f924403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 0x7f924403a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9258000c00 tx=0x7f9258007910 comp rx=0 tx=0).stop 2024-09-15T23:55:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 msgr2=0x7f926409f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f925402a1e0 tx=0x7f92540046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 shutdown_connections 2024-09-15T23:55:09.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f92440382a0 0x7f924403a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 --2- 172.21.15.121:0/945373363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9264135b50 0x7f926409f440 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 >> 172.21.15.121:0/945373363 conn(0x7f92640a85e0 msgr2=0x7f92640a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 shutdown_connections 2024-09-15T23:55:09.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.507+0000 7f9268c37640 1 -- 172.21.15.121:0/945373363 wait complete. 2024-09-15T23:55:09.518 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:55:09.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:55:09.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.618+0000 7f9d6b845640 1 Processor -- start 2024-09-15T23:55:09.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.618+0000 7f9d6b845640 1 -- start start 2024-09-15T23:55:09.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d6b845640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d640a04b0 0x7f9d6413b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d6b845640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6409abc0 con 0x7f9d64133020 2024-09-15T23:55:09.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d6b845640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9d640a2310 con 0x7f9d640a04b0 2024-09-15T23:55:09.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d68de0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d640a04b0 0x7f9d6413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d695e1640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9d64133020 0x7f9d64133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45636/0 (socket says 172.21.15.121:45636) 2024-09-15T23:55:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d68de0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d640a04b0 0x7f9d6413b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57888/0 (socket says 172.21.15.121:57888) 2024-09-15T23:55:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d695e1640 1 -- 172.21.15.121:0/3777649561 learned_addr learned my addr 172.21.15.121:0/3777649561 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d68de0640 1 -- 172.21.15.121:0/3777649561 >> v1:172.21.15.121:6789/0 conn(0x7f9d64133020 legacy=0x7f9d64133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d68de0640 1 -- 172.21.15.121:0/3777649561 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d64132bf0 con 0x7f9d640a04b0 2024-09-15T23:55:09.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.619+0000 7f9d5bfff640 1 -- 172.21.15.121:0/3777649561 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783515961 0 0) 0x7f9d6409abc0 con 0x7f9d64133020 2024-09-15T23:55:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.620+0000 7f9d68de0640 1 --2- 172.21.15.121:0/3777649561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009720 tx=0x7f9d5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e5aec784d80c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.620+0000 7f9d5bfff640 1 -- 172.21.15.121:0/3777649561 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54037070 con 0x7f9d640a04b0 2024-09-15T23:55:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.620+0000 7f9d5bfff640 1 -- 172.21.15.121:0/3777649561 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5402ad90 con 0x7f9d640a04b0 2024-09-15T23:55:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.620+0000 7f9d5bfff640 1 -- 172.21.15.121:0/3777649561 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54032590 con 0x7f9d640a04b0 2024-09-15T23:55:09.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 -- 172.21.15.121:0/3777649561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 msgr2=0x7f9d6413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 --2- 172.21.15.121:0/3777649561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009720 tx=0x7f9d5402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 -- 172.21.15.121:0/3777649561 shutdown_connections 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 --2- 172.21.15.121:0/3777649561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 -- 172.21.15.121:0/3777649561 >> 172.21.15.121:0/3777649561 conn(0x7f9d640a8430 msgr2=0x7f9d640a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 -- 172.21.15.121:0/3777649561 shutdown_connections 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.621+0000 7f9d6b845640 1 -- 172.21.15.121:0/3777649561 wait complete. 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d6b845640 1 Processor -- start 2024-09-15T23:55:09.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d6b845640 1 -- start start 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d6b845640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d6b845640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d640a1410 con 0x7f9d640a04b0 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d695e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d695e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57890/0 (socket says 172.21.15.121:57890) 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d695e1640 1 -- 172.21.15.121:0/1266254443 learned_addr learned my addr 172.21.15.121:0/1266254443 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d695e1640 1 -- 172.21.15.121:0/1266254443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d64072550 con 0x7f9d640a04b0 2024-09-15T23:55:09.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.622+0000 7f9d695e1640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c420 tx=0x7f9d6000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d60018070 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d600074d0 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d60004950 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d64073150 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d64131650 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.623+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9d6001b070 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.624+0000 7f9d59ffb640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 0x7f9d4803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.624+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2587+0+0 (secure 0 0 0) 0x7f9d6004a260 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.624+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d64072f40 con 0x7f9d640a04b0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.624+0000 7f9d68de0640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 0x7f9d4803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:09.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.624+0000 7f9d68de0640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 0x7f9d4803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d54034000 tx=0x7f9d5402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:09.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.628+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d6001c9d0 con 0x7f9d640a04b0 2024-09-15T23:55:09.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:09.794+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9d640a3a20 con 0x7f9d640a04b0 2024-09-15T23:55:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.660+0000 7f9d59ffb640 1 -- 172.21.15.121:0/1266254443 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) ==== 138+0+0 (secure 0 0 0) 0x7f9d6001cc30 con 0x7f9d640a04b0 2024-09-15T23:55:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 msgr2=0x7f9d4803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 0x7f9d4803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9d54034000 tx=0x7f9d5402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 msgr2=0x7f9d6413b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c420 tx=0x7f9d6000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 shutdown_connections 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9d480382a0 0x7f9d4803a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 --2- 172.21.15.121:0/1266254443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d640a04b0 0x7f9d6413b910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 >> 172.21.15.121:0/1266254443 conn(0x7f9d640a8430 msgr2=0x7f9d640a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 shutdown_connections 2024-09-15T23:55:10.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.664+0000 7f9d6b845640 1 -- 172.21.15.121:0/1266254443 wait complete. 2024-09-15T23:55:10.682 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:55:10.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.793+0000 7fc709865640 1 Processor -- start 2024-09-15T23:55:10.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.793+0000 7fc709865640 1 -- start start 2024-09-15T23:55:10.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc709865640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc7040a4ab0 0x7fc70413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:10.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc709865640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7040a6d10 con 0x7fc7040a7140 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc709865640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc70406e230 con 0x7fc7040a4ab0 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc7027fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc7040a4ab0 0x7fc70413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc7027fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc7040a4ab0 0x7fc70413eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57900/0 (socket says 172.21.15.121:57900) 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc7027fc640 1 -- 172.21.15.121:0/3308034831 learned_addr learned my addr 172.21.15.121:0/3308034831 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc7027fc640 1 -- 172.21.15.121:0/3308034831 >> v1:172.21.15.121:6789/0 conn(0x7fc7040a7140 legacy=0x7fc7040a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc701ffb640 1 -- 172.21.15.121:0/3308034831 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036838724 0 0) 0x7fc7040a6d10 con 0x7fc7040a7140 2024-09-15T23:55:10.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.794+0000 7fc7027fc640 1 -- 172.21.15.121:0/3308034831 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040a3ae0 con 0x7fc7040a4ab0 2024-09-15T23:55:10.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.795+0000 7fc7027fc640 1 --2- 172.21.15.121:0/3308034831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70413eef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009e50 tx=0x7fc6f802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f20e2c353a3d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:10.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.795+0000 7fc701ffb640 1 -- 172.21.15.121:0/3308034831 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f8036070 con 0x7fc7040a4ab0 2024-09-15T23:55:10.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.795+0000 7fc701ffb640 1 -- 172.21.15.121:0/3308034831 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f8031400 con 0x7fc7040a4ab0 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.795+0000 7fc701ffb640 1 -- 172.21.15.121:0/3308034831 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6f80315d0 con 0x7fc7040a4ab0 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 -- 172.21.15.121:0/3308034831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 msgr2=0x7fc70413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 --2- 172.21.15.121:0/3308034831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70413eef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009e50 tx=0x7fc6f802a730 comp rx=0 tx=0).stop 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 -- 172.21.15.121:0/3308034831 shutdown_connections 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 --2- 172.21.15.121:0/3308034831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70413eef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 -- 172.21.15.121:0/3308034831 >> 172.21.15.121:0/3308034831 conn(0x7fc7040ac370 msgr2=0x7fc7040ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 -- 172.21.15.121:0/3308034831 shutdown_connections 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.796+0000 7fc709865640 1 -- 172.21.15.121:0/3308034831 wait complete. 2024-09-15T23:55:10.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc709865640 1 Processor -- start 2024-09-15T23:55:10.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc709865640 1 -- start start 2024-09-15T23:55:10.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc709865640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc709865640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040a7fc0 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57910/0 (socket says 172.21.15.121:57910) 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc702ffd640 1 -- 172.21.15.121:0/93053316 learned_addr learned my addr 172.21.15.121:0/93053316 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.797+0000 7fc702ffd640 1 -- 172.21.15.121:0/93053316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040a1b60 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc702ffd640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c3e0 tx=0x7fc6fc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6fc017070 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc005430 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7041366c0 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6fc003760 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.798+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc704136ab0 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6fc01a070 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7040a1e40 con 0x7fc7040a4ab0 2024-09-15T23:55:10.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc6ebfff640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 0x7fc6f003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:10.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2957+0+0 (secure 0 0 0) 0x7fc6fc04a450 con 0x7fc7040a4ab0 2024-09-15T23:55:10.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc7027fc640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 0x7fc6f003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:10.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.799+0000 7fc7027fc640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 0x7fc6f003a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8033000 tx=0x7fc6f8009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:10.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.804+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6fc011760 con 0x7fc7040a4ab0 2024-09-15T23:55:10.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:10.969+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc7040a2720 con 0x7fc7040a4ab0 2024-09-15T23:55:11.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.660+0000 7fc6ebfff640 1 -- 172.21.15.121:0/93053316 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) ==== 170+0+0 (secure 0 0 0) 0x7fc6fc0119c0 con 0x7fc7040a4ab0 2024-09-15T23:55:11.662 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-15T23:55:11.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 msgr2=0x7fc6f003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:11.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 0x7fc6f003a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8033000 tx=0x7fc6f8009000 comp rx=0 tx=0).stop 2024-09-15T23:55:11.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 msgr2=0x7fc70409fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:11.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c3e0 tx=0x7fc6fc00c8a0 comp rx=0 tx=0).stop 2024-09-15T23:55:11.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 shutdown_connections 2024-09-15T23:55:11.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fc6f00382a0 0x7fc6f003a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:11.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 --2- 172.21.15.121:0/93053316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7040a4ab0 0x7fc70409fec0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:11.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.664+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 >> 172.21.15.121:0/93053316 conn(0x7fc7040ac370 msgr2=0x7fc7040ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:11.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.666+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 shutdown_connections 2024-09-15T23:55:11.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.666+0000 7fc709865640 1 -- 172.21.15.121:0/93053316 wait complete. 2024-09-15T23:55:11.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:55:11.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f60172af640 1 Processor -- start 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f60172af640 1 -- start start 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f60172af640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60100a3b90 0x7f60100a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f60172af640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60100a4560 con 0x7f60100a37b0 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f60172af640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f601009b4f0 con 0x7f60100a3b90 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f601484a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60100a3b90 0x7f60100a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f601504b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f60100a37b0 0x7f601009acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45640/0 (socket says 172.21.15.121:45640) 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f601484a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60100a3b90 0x7f60100a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57912/0 (socket says 172.21.15.121:57912) 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.791+0000 7f601504b640 1 -- 172.21.15.121:0/306461981 learned_addr learned my addr 172.21.15.121:0/306461981 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:11.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.792+0000 7f601484a640 1 -- 172.21.15.121:0/306461981 >> v1:172.21.15.121:6789/0 conn(0x7f60100a37b0 legacy=0x7f601009acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.792+0000 7f601484a640 1 -- 172.21.15.121:0/306461981 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60100a1c90 con 0x7f60100a3b90 2024-09-15T23:55:11.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.792+0000 7f600ffff640 1 -- 172.21.15.121:0/306461981 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300985375 0 0) 0x7f60100a4560 con 0x7f60100a37b0 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.792+0000 7f601484a640 1 --2- 172.21.15.121:0/306461981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a3b90 0x7f60100a4020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6004009720 tx=0x7f600402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68af0b0f554392f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.792+0000 7f600ffff640 1 -- 172.21.15.121:0/306461981 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6004037070 con 0x7f60100a3b90 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f600ffff640 1 -- 172.21.15.121:0/306461981 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600402ad90 con 0x7f60100a3b90 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f600ffff640 1 -- 172.21.15.121:0/306461981 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6004032590 con 0x7f60100a3b90 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 -- 172.21.15.121:0/306461981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a3b90 msgr2=0x7f60100a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:11.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 --2- 172.21.15.121:0/306461981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a3b90 0x7f60100a4020 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6004009720 tx=0x7f600402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 -- 172.21.15.121:0/306461981 shutdown_connections 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 --2- 172.21.15.121:0/306461981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a3b90 0x7f60100a4020 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 -- 172.21.15.121:0/306461981 >> 172.21.15.121:0/306461981 conn(0x7f60100a8430 msgr2=0x7f60100a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 -- 172.21.15.121:0/306461981 shutdown_connections 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.793+0000 7f60172af640 1 -- 172.21.15.121:0/306461981 wait complete. 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.794+0000 7f60172af640 1 Processor -- start 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.794+0000 7f60172af640 1 -- start start 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.794+0000 7f60172af640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.794+0000 7f60172af640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60100a5220 con 0x7f60100a37b0 2024-09-15T23:55:11.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f601504b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f601504b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57924/0 (socket says 172.21.15.121:57924) 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f601504b640 1 -- 172.21.15.121:0/2873290032 learned_addr learned my addr 172.21.15.121:0/2873290032 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f601504b640 1 -- 172.21.15.121:0/2873290032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601013b130 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f601504b640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f600800c420 tx=0x7f600800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008018070 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60080074d0 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60101389b0 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6008004950 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.795+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601009d870 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.796+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f600801b070 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.796+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60101386a0 con 0x7f60100a37b0 2024-09-15T23:55:11.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.796+0000 7f600dffb640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 0x7f5ffc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:11.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.796+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3339+0+0 (secure 0 0 0) 0x7f600804a550 con 0x7f60100a37b0 2024-09-15T23:55:11.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.796+0000 7f601484a640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 0x7f5ffc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:11.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.797+0000 7f601484a640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 0x7f5ffc03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6004009720 tx=0x7f600402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:11.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:11.801+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f600801c9d0 con 0x7f60100a37b0 2024-09-15T23:55:12.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.003+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f60100a4020 con 0x7f60100a37b0 2024-09-15T23:55:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.672+0000 7f600dffb640 1 -- 172.21.15.121:0/2873290032 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f600801cc30 con 0x7f60100a37b0 2024-09-15T23:55:12.673 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T23:55:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.678+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 msgr2=0x7f5ffc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.678+0000 7f60172af640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 0x7f5ffc03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6004009720 tx=0x7f600402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.678+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 msgr2=0x7f601013a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.678+0000 7f60172af640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f600800c420 tx=0x7f600800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.681+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 shutdown_connections 2024-09-15T23:55:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.682+0000 7f60172af640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f5ffc0382a0 0x7f5ffc03a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.682+0000 7f60172af640 1 --2- 172.21.15.121:0/2873290032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60100a37b0 0x7f601013a010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.682+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 >> 172.21.15.121:0/2873290032 conn(0x7f60100a8430 msgr2=0x7f601013b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.682+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 shutdown_connections 2024-09-15T23:55:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.682+0000 7f60172af640 1 -- 172.21.15.121:0/2873290032 wait complete. 2024-09-15T23:55:12.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:12.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.805+0000 7f605001e640 1 Processor -- start 2024-09-15T23:55:12.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.805+0000 7f605001e640 1 -- start start 2024-09-15T23:55:12.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f605001e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f604813a220 0x7f604813a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:12.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f605001e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604809f2f0 con 0x7f60480a1c80 2024-09-15T23:55:12.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f605001e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f60480a07d0 con 0x7f604813a220 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604ddba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f604813a220 0x7f604813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604ddba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f604813a220 0x7f604813a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55426/0 (socket says 172.21.15.121:55426) 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604ddba640 1 -- 172.21.15.121:0/2459770903 learned_addr learned my addr 172.21.15.121:0/2459770903 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604d5b9640 1 --1- 172.21.15.121:0/2459770903 >> v1:172.21.15.121:6789/0 conn(0x7f60480a1c80 0x7f6048136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45340/0 (socket says 172.21.15.121:45340) 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604ddba640 1 -- 172.21.15.121:0/2459770903 >> v1:172.21.15.121:6789/0 conn(0x7f60480a1c80 legacy=0x7f6048136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.806+0000 7f604ddba640 1 -- 172.21.15.121:0/2459770903 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048139dd0 con 0x7f604813a220 2024-09-15T23:55:12.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.807+0000 7f604ddba640 1 --2- 172.21.15.121:0/2459770903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f604813a220 0x7f604813a600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60400097f0 tx=0x7f604002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae52844e9d93fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:12.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.807+0000 7f604cdb8640 1 -- 172.21.15.121:0/2459770903 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6040037070 con 0x7f604813a220 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.807+0000 7f604cdb8640 1 -- 172.21.15.121:0/2459770903 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6040032440 con 0x7f604813a220 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.807+0000 7f604cdb8640 1 -- 172.21.15.121:0/2459770903 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604002ae60 con 0x7f604813a220 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 -- 172.21.15.121:0/2459770903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f604813a220 msgr2=0x7f604813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 --2- 172.21.15.121:0/2459770903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f604813a220 0x7f604813a600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60400097f0 tx=0x7f604002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 -- 172.21.15.121:0/2459770903 shutdown_connections 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 --2- 172.21.15.121:0/2459770903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f604813a220 0x7f604813a600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 -- 172.21.15.121:0/2459770903 >> 172.21.15.121:0/2459770903 conn(0x7f604806d820 msgr2=0x7f604806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:12.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 -- 172.21.15.121:0/2459770903 shutdown_connections 2024-09-15T23:55:12.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.808+0000 7f605001e640 1 -- 172.21.15.121:0/2459770903 wait complete. 2024-09-15T23:55:12.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f605001e640 1 Processor -- start 2024-09-15T23:55:12.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f605001e640 1 -- start start 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f605001e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f605001e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6048139a20 con 0x7f60480a1c80 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f604ddba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f604ddba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55434/0 (socket says 172.21.15.121:55434) 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f604ddba640 1 -- 172.21.15.121:0/3430814871 learned_addr learned my addr 172.21.15.121:0/3430814871 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.809+0000 7f604ddba640 1 -- 172.21.15.121:0/3430814871 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60480aa0a0 con 0x7f60480a1c80 2024-09-15T23:55:12.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f604ddba640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60400090b0 tx=0x7f60400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6040041070 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604003c7a0 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6040037040 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60480a96b0 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60480a9950 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.810+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6040044070 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.811+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60480a7d80 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.811+0000 7f603e7fc640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 0x7f602c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.811+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f604006bd10 con 0x7f60480a1c80 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.811+0000 7f604d5b9640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 0x7f602c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:12.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.811+0000 7f604d5b9640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 0x7f602c03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f604813ab40 tx=0x7f6038007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.816+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60480aa0a0 con 0x7f60480a1c80 2024-09-15T23:55:12.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.982+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60480a0100 con 0x7f60480a1c80 2024-09-15T23:55:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.983+0000 7f603e7fc640 1 -- 172.21.15.121:0/3430814871 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10688 (secure 0 0 0) 0x7f604003a760 con 0x7f60480a1c80 2024-09-15T23:55:12.984 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:12.984 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":16,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:12.004824+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 msgr2=0x7f602c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 0x7f602c03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f604813ab40 tx=0x7f6038007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 msgr2=0x7f60480a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60400090b0 tx=0x7f60400046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 shutdown_connections 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f602c0382a0 0x7f602c03a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 --2- 172.21.15.121:0/3430814871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60480a1c80 0x7f60480a6000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 >> 172.21.15.121:0/3430814871 conn(0x7f604806d820 msgr2=0x7f60481346d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:12.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 shutdown_connections 2024-09-15T23:55:12.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:12.985+0000 7f605001e640 1 -- 172.21.15.121:0/3430814871 wait complete. 2024-09-15T23:55:12.997 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a32ef1640 1 Processor -- start 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a32ef1640 1 -- start start 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a32ef1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a2c09ee30 0x7f6a2c13ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a32ef1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2c0a2280 con 0x7f6a2c0a39c0 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a32ef1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6a2c09e6e0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a23fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a2c09ee30 0x7f6a2c13ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a30c8d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6a2c0a39c0 0x7f6a2c0a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45348/0 (socket says 172.21.15.121:45348) 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a23fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6a2c09ee30 0x7f6a2c13ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55438/0 (socket says 172.21.15.121:55438) 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.094+0000 7f6a30c8d640 1 -- 172.21.15.121:0/2836176718 learned_addr learned my addr 172.21.15.121:0/2836176718 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.095+0000 7f6a23fff640 1 -- 172.21.15.121:0/2836176718 >> v1:172.21.15.121:6789/0 conn(0x7f6a2c0a39c0 legacy=0x7f6a2c0a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.095+0000 7f6a23fff640 1 -- 172.21.15.121:0/2836176718 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c09e3d0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.095+0000 7f6a237fe640 1 -- 172.21.15.121:0/2836176718 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840527463 0 0) 0x7f6a2c0a2280 con 0x7f6a2c0a39c0 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.095+0000 7f6a23fff640 1 --2- 172.21.15.121:0/2836176718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c13ced0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009720 tx=0x7f6a1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98c7a22651db094 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a237fe640 1 -- 172.21.15.121:0/2836176718 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c037070 con 0x7f6a2c09ee30 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a237fe640 1 -- 172.21.15.121:0/2836176718 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c02ad90 con 0x7f6a2c09ee30 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a237fe640 1 -- 172.21.15.121:0/2836176718 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a1c032590 con 0x7f6a2c09ee30 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 -- 172.21.15.121:0/2836176718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 msgr2=0x7f6a2c13ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/2836176718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c13ced0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009720 tx=0x7f6a1c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 -- 172.21.15.121:0/2836176718 shutdown_connections 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/2836176718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c13ced0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 -- 172.21.15.121:0/2836176718 >> 172.21.15.121:0/2836176718 conn(0x7f6a2c0a85e0 msgr2=0x7f6a2c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 -- 172.21.15.121:0/2836176718 shutdown_connections 2024-09-15T23:55:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.096+0000 7f6a32ef1640 1 -- 172.21.15.121:0/2836176718 wait complete. 2024-09-15T23:55:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.097+0000 7f6a32ef1640 1 Processor -- start 2024-09-15T23:55:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.097+0000 7f6a32ef1640 1 -- start start 2024-09-15T23:55:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a32ef1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a32ef1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c0a1ed0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a30c8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a30c8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55452/0 (socket says 172.21.15.121:55452) 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a30c8d640 1 -- 172.21.15.121:0/1158837856 learned_addr learned my addr 172.21.15.121:0/1158837856 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a30c8d640 1 -- 172.21.15.121:0/1158837856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0716f0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a30c8d640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c420 tx=0x7f6a2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28018070 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280074d0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c06fa40 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a28004950 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.098+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c06f770 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.099+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6a2801b070 con 0x7f6a2c09ee30 2024-09-15T23:55:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.099+0000 7f6a217fa640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 0x7f6a1803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.099+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c0008d0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.099+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f6a2804a5b0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.099+0000 7f6a23fff640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 0x7f6a1803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.100+0000 7f6a23fff640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 0x7f6a1803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c034000 tx=0x7f6a1c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.104+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a2801c9d0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.270+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a2c071410 con 0x7f6a2c09ee30 2024-09-15T23:55:13.271 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.271+0000 7f6a217fa640 1 -- 172.21.15.121:0/1158837856 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+10688 (secure 0 0 0) 0x7f6a280249d0 con 0x7f6a2c09ee30 2024-09-15T23:55:13.272 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:13.272 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":16,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:12.004824+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 msgr2=0x7f6a1803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 0x7f6a1803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c034000 tx=0x7f6a1c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 msgr2=0x7f6a2c11e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800c420 tx=0x7f6a2800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 shutdown_connections 2024-09-15T23:55:13.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6a180382a0 0x7f6a1803a760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 --2- 172.21.15.121:0/1158837856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a2c09ee30 0x7f6a2c11e870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 >> 172.21.15.121:0/1158837856 conn(0x7f6a2c0a85e0 msgr2=0x7f6a2c0a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:13.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 shutdown_connections 2024-09-15T23:55:13.275 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.273+0000 7f6a32ef1640 1 -- 172.21.15.121:0/1158837856 wait complete. 2024-09-15T23:55:13.284 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.383+0000 7f71f12af640 1 Processor -- start 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.383+0000 7f71f12af640 1 -- start start 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.383+0000 7f71f12af640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f71ec13ce50 0x7f71ec13f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.383+0000 7f71f12af640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec0a72b0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.383+0000 7f71f12af640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f71ec0a2d00 con 0x7f71ec13ce50 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f71ec13ce50 0x7f71ec13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f71ec13ce50 0x7f71ec13f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55454/0 (socket says 172.21.15.121:55454) 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71eaffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f71ec0a76e0 0x7f71ec0a7ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45364/0 (socket says 172.21.15.121:45364) 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 -- 172.21.15.121:0/3539489211 learned_addr learned my addr 172.21.15.121:0/3539489211 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 -- 172.21.15.121:0/3539489211 >> v1:172.21.15.121:6789/0 conn(0x7f71ec0a76e0 legacy=0x7f71ec0a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 -- 172.21.15.121:0/3539489211 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec0a3e60 con 0x7f71ec13ce50 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.384+0000 7f71ea7fc640 1 --2- 172.21.15.121:0/3539489211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec13ce50 0x7f71ec13f240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097f0 tx=0x7f71e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105a0c06ce2f6173 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71e9ffb640 1 -- 172.21.15.121:0/3539489211 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e0037070 con 0x7f71ec13ce50 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71e9ffb640 1 -- 172.21.15.121:0/3539489211 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e0032440 con 0x7f71ec13ce50 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71e9ffb640 1 -- 172.21.15.121:0/3539489211 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71e002ae60 con 0x7f71ec13ce50 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 -- 172.21.15.121:0/3539489211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec13ce50 msgr2=0x7f71ec13f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 --2- 172.21.15.121:0/3539489211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec13ce50 0x7f71ec13f240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097f0 tx=0x7f71e002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 -- 172.21.15.121:0/3539489211 shutdown_connections 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 --2- 172.21.15.121:0/3539489211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec13ce50 0x7f71ec13f240 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 -- 172.21.15.121:0/3539489211 >> 172.21.15.121:0/3539489211 conn(0x7f71ec0a8de0 msgr2=0x7f71ec0a91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 -- 172.21.15.121:0/3539489211 shutdown_connections 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.385+0000 7f71f12af640 1 -- 172.21.15.121:0/3539489211 wait complete. 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.386+0000 7f71f12af640 1 Processor -- start 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.386+0000 7f71f12af640 1 -- start start 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71f12af640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71f12af640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec0a4c50 con 0x7f71ec0a76e0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71eaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71eaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55458/0 (socket says 172.21.15.121:55458) 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71eaffd640 1 -- 172.21.15.121:0/2994154182 learned_addr learned my addr 172.21.15.121:0/2994154182 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71eaffd640 1 -- 172.21.15.121:0/2994154182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec09d450 con 0x7f71ec0a76e0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71eaffd640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c780 tx=0x7f71dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71dc017070 con 0x7f71ec0a76e0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71dc005da0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec09e5b0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71dc00a790 con 0x7f71ec0a76e0 2024-09-15T23:55:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.387+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec09f520 con 0x7f71ec0a76e0 2024-09-15T23:55:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.388+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f71dc01a070 con 0x7f71ec0a76e0 2024-09-15T23:55:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.388+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec09d9f0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.388+0000 7f71d37fe640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 0x7f71d803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.388+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3439+0+0 (secure 0 0 0) 0x7f71dc04a7e0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.388+0000 7f71ea7fc640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 0x7f71d803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.389+0000 7f71ea7fc640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 0x7f71d803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f71e0034000 tx=0x7f71e002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.393+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71dc00a930 con 0x7f71ec0a76e0 2024-09-15T23:55:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.592+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f71ec0a48b0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.672+0000 7f71d37fe640 1 -- 172.21.15.121:0/2994154182 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f71dc0070c0 con 0x7f71ec0a76e0 2024-09-15T23:55:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 msgr2=0x7f71d803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.675 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 0x7f71d803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f71e0034000 tx=0x7f71e002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 msgr2=0x7f71ec1cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00c780 tx=0x7f71dc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 shutdown_connections 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f71d80382a0 0x7f71d803a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 --2- 172.21.15.121:0/2994154182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71ec0a76e0 0x7f71ec1cb800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 >> 172.21.15.121:0/2994154182 conn(0x7f71ec0a8de0 msgr2=0x7f71ec13b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 shutdown_connections 2024-09-15T23:55:13.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.674+0000 7f71f12af640 1 -- 172.21.15.121:0/2994154182 wait complete. 2024-09-15T23:55:13.688 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:55:13.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:55:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.787+0000 7f7c2712c640 1 Processor -- start 2024-09-15T23:55:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.787+0000 7f7c2712c640 1 -- start start 2024-09-15T23:55:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c2712c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c200a4ab0 0x7f7c2013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c2712c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c200a6d10 con 0x7f7c200a7140 2024-09-15T23:55:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c2712c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2006e230 con 0x7f7c200a4ab0 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c1ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c200a4ab0 0x7f7c2013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c24ec8640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7c200a7140 0x7f7c200a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45374/0 (socket says 172.21.15.121:45374) 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c24ec8640 1 -- 172.21.15.121:0/1384447269 learned_addr learned my addr 172.21.15.121:0/1384447269 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c1ffff640 1 -- 172.21.15.121:0/1384447269 >> v1:172.21.15.121:6789/0 conn(0x7f7c200a7140 legacy=0x7f7c200a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c1ffff640 1 -- 172.21.15.121:0/1384447269 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c200a3ae0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.788+0000 7f7c1f7fe640 1 -- 172.21.15.121:0/1384447269 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901837551 0 0) 0x7f7c200a6d10 con 0x7f7c200a7140 2024-09-15T23:55:13.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.789+0000 7f7c1ffff640 1 --2- 172.21.15.121:0/1384447269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c2013eef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009720 tx=0x7f7c0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2ff050a3d7b79d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.789+0000 7f7c1f7fe640 1 -- 172.21.15.121:0/1384447269 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c037070 con 0x7f7c200a4ab0 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.789+0000 7f7c1f7fe640 1 -- 172.21.15.121:0/1384447269 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c02ad90 con 0x7f7c200a4ab0 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.789+0000 7f7c1f7fe640 1 -- 172.21.15.121:0/1384447269 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c0c032590 con 0x7f7c200a4ab0 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 -- 172.21.15.121:0/1384447269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 msgr2=0x7f7c2013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 --2- 172.21.15.121:0/1384447269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c2013eef0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009720 tx=0x7f7c0c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 -- 172.21.15.121:0/1384447269 shutdown_connections 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 --2- 172.21.15.121:0/1384447269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c2013eef0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 -- 172.21.15.121:0/1384447269 >> 172.21.15.121:0/1384447269 conn(0x7f7c200ac370 msgr2=0x7f7c200ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 -- 172.21.15.121:0/1384447269 shutdown_connections 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.790+0000 7f7c2712c640 1 -- 172.21.15.121:0/1384447269 wait complete. 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c2712c640 1 Processor -- start 2024-09-15T23:55:13.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c2712c640 1 -- start start 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c2712c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c2712c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c200a7fc0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c24ec8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c24ec8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55466/0 (socket says 172.21.15.121:55466) 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.791+0000 7f7c24ec8640 1 -- 172.21.15.121:0/951593591 learned_addr learned my addr 172.21.15.121:0/951593591 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c24ec8640 1 -- 172.21.15.121:0/951593591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c200a1190 con 0x7f7c200a4ab0 2024-09-15T23:55:13.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c24ec8640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c420 tx=0x7f7c1400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14018070 con 0x7f7c200a4ab0 2024-09-15T23:55:13.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c140074d0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c200a0300 con 0x7f7c200a4ab0 2024-09-15T23:55:13.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c14004950 con 0x7f7c200a4ab0 2024-09-15T23:55:13.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.792+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c201369b0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.793+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7c1401b070 con 0x7f7c200a4ab0 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.793+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2009fff0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.793+0000 7f7c1d7fa640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 0x7f7c0403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.793+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f7c1404a5b0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.793+0000 7f7c1ffff640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 0x7f7c0403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:13.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.794+0000 7f7c1ffff640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 0x7f7c0403a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c034000 tx=0x7f7c0c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:13.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.798+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c1401c9d0 con 0x7f7c200a4ab0 2024-09-15T23:55:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:13.996+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7c2009e520 con 0x7f7c200a4ab0 2024-09-15T23:55:14.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.679+0000 7f7c1d7fa640 1 -- 172.21.15.121:0/951593591 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f7c1401cc30 con 0x7f7c200a4ab0 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.681+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 msgr2=0x7f7c0403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.681+0000 7f7c2712c640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 0x7f7c0403a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c034000 tx=0x7f7c0c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.681+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 msgr2=0x7f7c20135c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.681+0000 7f7c2712c640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c420 tx=0x7f7c1400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 shutdown_connections 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7c040382a0 0x7f7c0403a760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 --2- 172.21.15.121:0/951593591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c200a4ab0 0x7f7c20135c60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 >> 172.21.15.121:0/951593591 conn(0x7f7c200ac370 msgr2=0x7f7c20137110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 shutdown_connections 2024-09-15T23:55:14.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.682+0000 7f7c2712c640 1 -- 172.21.15.121:0/951593591 wait complete. 2024-09-15T23:55:14.694 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:55:14.695 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.794+0000 7fb7b2f03640 1 Processor -- start 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7b2f03640 1 -- start start 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7b2f03640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7ac133640 0x7fb7ac13b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7b2f03640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ac0a16c0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7b2f03640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ac0a1490 con 0x7fb7ac133640 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7abfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7ac133640 0x7fb7ac13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7abfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7ac133640 0x7fb7ac13b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55478/0 (socket says 172.21.15.121:55478) 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7abfff640 1 -- 172.21.15.121:0/2338459268 learned_addr learned my addr 172.21.15.121:0/2338459268 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7b0c9f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb7ac0a39c0 0x7fb7ac132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45376/0 (socket says 172.21.15.121:45376) 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7abfff640 1 -- 172.21.15.121:0/2338459268 >> v1:172.21.15.121:6789/0 conn(0x7fb7ac0a39c0 legacy=0x7fb7ac132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7abfff640 1 -- 172.21.15.121:0/2338459268 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac0a4010 con 0x7fb7ac133640 2024-09-15T23:55:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.795+0000 7fb7ab7fe640 1 -- 172.21.15.121:0/2338459268 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824189262 0 0) 0x7fb7ac0a16c0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.796+0000 7fb7abfff640 1 --2- 172.21.15.121:0/2338459268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac133640 0x7fb7ac13b270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb79800ba80 tx=0x7fb79802c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5d9af4255d6911 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.796+0000 7fb7ab7fe640 1 -- 172.21.15.121:0/2338459268 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb79803a070 con 0x7fb7ac133640 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.796+0000 7fb7ab7fe640 1 -- 172.21.15.121:0/2338459268 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7980325b0 con 0x7fb7ac133640 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.796+0000 7fb7ab7fe640 1 -- 172.21.15.121:0/2338459268 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7980328b0 con 0x7fb7ac133640 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2338459268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac133640 msgr2=0x7fb7ac13b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2338459268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac133640 0x7fb7ac13b270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb79800ba80 tx=0x7fb79802c690 comp rx=0 tx=0).stop 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2338459268 shutdown_connections 2024-09-15T23:55:14.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2338459268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac133640 0x7fb7ac13b270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2338459268 >> 172.21.15.121:0/2338459268 conn(0x7fb7ac0a85e0 msgr2=0x7fb7ac0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2338459268 shutdown_connections 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.797+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2338459268 wait complete. 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b2f03640 1 Processor -- start 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b2f03640 1 -- start start 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b2f03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b2f03640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac1329c0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b0c9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b0c9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55494/0 (socket says 172.21.15.121:55494) 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.798+0000 7fb7b0c9f640 1 -- 172.21.15.121:0/2798217844 learned_addr learned my addr 172.21.15.121:0/2798217844 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7b0c9f640 1 -- 172.21.15.121:0/2798217844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac09e8d0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7b0c9f640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000c370 tx=0x7fb7a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a0007410 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a00075d0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a0004950 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac09e5f0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.799+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac1ca430 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb7a0011070 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ac0a2340 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7a97fa640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 0x7fb79003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:14.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fb7a004adb0 con 0x7fb7ac0a39c0 2024-09-15T23:55:14.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7abfff640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 0x7fb79003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:14.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.800+0000 7fb7abfff640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 0x7fb79003a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb798037000 tx=0x7fb798030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:14.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:14.804+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7a001cbd0 con 0x7fb7ac0a39c0 2024-09-15T23:55:15.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.005+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7ac070fa0 con 0x7fb7ac0a39c0 2024-09-15T23:55:15.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.005+0000 7fb7a97fa640 1 -- 172.21.15.121:0/2798217844 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7fb7a0004d80 con 0x7fb7ac0a39c0 2024-09-15T23:55:15.006 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:15.006 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:15.007 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 msgr2=0x7fb79003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 0x7fb79003a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb798037000 tx=0x7fb798030000 comp rx=0 tx=0).stop 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 msgr2=0x7fb7ac070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000c370 tx=0x7fb7a000c830 comp rx=0 tx=0).stop 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 shutdown_connections 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb7900382a0 0x7fb79003a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 --2- 172.21.15.121:0/2798217844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7ac0a39c0 0x7fb7ac070a60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 >> 172.21.15.121:0/2798217844 conn(0x7fb7ac0a85e0 msgr2=0x7fb7ac0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 shutdown_connections 2024-09-15T23:55:15.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.007+0000 7fb7b2f03640 1 -- 172.21.15.121:0/2798217844 wait complete. 2024-09-15T23:55:15.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:15.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b47f6640 1 Processor -- start 2024-09-15T23:55:15.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b47f6640 1 -- start start 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b47f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f73ac133640 0x7f73ac13b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b47f6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0a16c0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b47f6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0a1490 con 0x7f73ac133640 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b1d91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f73ac133640 0x7f73ac13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b2592640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f73ac0a39c0 0x7f73ac132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45392/0 (socket says 172.21.15.121:45392) 2024-09-15T23:55:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b1d91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f73ac133640 0x7f73ac13b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55504/0 (socket says 172.21.15.121:55504) 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.115+0000 7f73b2592640 1 -- 172.21.15.121:0/2148850501 learned_addr learned my addr 172.21.15.121:0/2148850501 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1d91640 1 -- 172.21.15.121:0/2148850501 >> v1:172.21.15.121:6789/0 conn(0x7f73ac0a39c0 legacy=0x7f73ac132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1d91640 1 -- 172.21.15.121:0/2148850501 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0a4010 con 0x7f73ac133640 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1590640 1 -- 172.21.15.121:0/2148850501 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306694004 0 0) 0x7f73ac0a16c0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1d91640 1 --2- 172.21.15.121:0/2148850501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac133640 0x7f73ac13b270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f739c009720 tx=0x7f739c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a192f9e0ea5ccf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1590640 1 -- 172.21.15.121:0/2148850501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f739c037070 con 0x7f73ac133640 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1590640 1 -- 172.21.15.121:0/2148850501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c02ad90 con 0x7f73ac133640 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.116+0000 7f73b1590640 1 -- 172.21.15.121:0/2148850501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f739c032590 con 0x7f73ac133640 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 -- 172.21.15.121:0/2148850501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac133640 msgr2=0x7f73ac13b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 --2- 172.21.15.121:0/2148850501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac133640 0x7f73ac13b270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f739c009720 tx=0x7f739c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 -- 172.21.15.121:0/2148850501 shutdown_connections 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 --2- 172.21.15.121:0/2148850501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac133640 0x7f73ac13b270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 -- 172.21.15.121:0/2148850501 >> 172.21.15.121:0/2148850501 conn(0x7f73ac0a85e0 msgr2=0x7f73ac0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 -- 172.21.15.121:0/2148850501 shutdown_connections 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.117+0000 7f73b47f6640 1 -- 172.21.15.121:0/2148850501 wait complete. 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b47f6640 1 Processor -- start 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b47f6640 1 -- start start 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b47f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b47f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac1329c0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b2592640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b2592640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55514/0 (socket says 172.21.15.121:55514) 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.118+0000 7f73b2592640 1 -- 172.21.15.121:0/1815493479 learned_addr learned my addr 172.21.15.121:0/1815493479 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73b2592640 1 -- 172.21.15.121:0/1815493479 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac09d200 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73b2592640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f73a000c370 tx=0x7f73a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a0007410 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00075d0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a0004950 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac09e480 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.119+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac073860 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f73a0011070 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac09d3d0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73aaffd640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 0x7f739803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f73a004adb0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73b1d91640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 0x7f739803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.120+0000 7f73b1d91640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 0x7f739803a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f739c034000 tx=0x7f739c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.124+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73a001cbd0 con 0x7f73ac0a39c0 2024-09-15T23:55:15.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.289+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73ac0a2340 con 0x7f73ac0a39c0 2024-09-15T23:55:15.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.290+0000 7f73aaffd640 1 -- 172.21.15.121:0/1815493479 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f73a0004d80 con 0x7f73ac0a39c0 2024-09-15T23:55:15.291 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:15.291 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 msgr2=0x7f739803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 0x7f739803a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f739c034000 tx=0x7f739c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 msgr2=0x7f73ac1ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f73a000c370 tx=0x7f73a000c830 comp rx=0 tx=0).stop 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 shutdown_connections 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f73980382a0 0x7f739803a760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 --2- 172.21.15.121:0/1815493479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73ac0a39c0 0x7f73ac1ce820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 >> 172.21.15.121:0/1815493479 conn(0x7f73ac0a85e0 msgr2=0x7f73ac0a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 shutdown_connections 2024-09-15T23:55:15.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.292+0000 7f73b47f6640 1 -- 172.21.15.121:0/1815493479 wait complete. 2024-09-15T23:55:15.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:55:15.304 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:15.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.400+0000 7f4ae0427640 1 Processor -- start 2024-09-15T23:55:15.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.400+0000 7f4ae0427640 1 -- start start 2024-09-15T23:55:15.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4ae0427640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4ad80a4c20 0x7f4ad813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4ae0427640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad813a080 con 0x7f4ad813a280 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4ae0427640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad80a3d50 con 0x7f4ad80a4c20 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4add9c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4ad80a4c20 0x7f4ad813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4add9c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4ad80a4c20 0x7f4ad813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55520/0 (socket says 172.21.15.121:55520) 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4ade1c3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4ad813a280 0x7f4ad813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45400/0 (socket says 172.21.15.121:45400) 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4add9c2640 1 -- 172.21.15.121:0/1104519958 learned_addr learned my addr 172.21.15.121:0/1104519958 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4add9c2640 1 -- 172.21.15.121:0/1104519958 >> v1:172.21.15.121:6789/0 conn(0x7f4ad813a280 legacy=0x7f4ad813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.401+0000 7f4add9c2640 1 -- 172.21.15.121:0/1104519958 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad80a3f80 con 0x7f4ad80a4c20 2024-09-15T23:55:15.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.402+0000 7f4add9c2640 1 --2- 172.21.15.121:0/1104519958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad813f060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097f0 tx=0x7f4ac802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383e7a4c3aa53c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.402+0000 7f4add1c1640 1 -- 172.21.15.121:0/1104519958 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8037070 con 0x7f4ad80a4c20 2024-09-15T23:55:15.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.402+0000 7f4add1c1640 1 -- 172.21.15.121:0/1104519958 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8032440 con 0x7f4ad80a4c20 2024-09-15T23:55:15.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.402+0000 7f4add1c1640 1 -- 172.21.15.121:0/1104519958 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac802ae60 con 0x7f4ad80a4c20 2024-09-15T23:55:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 -- 172.21.15.121:0/1104519958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 msgr2=0x7f4ad813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 --2- 172.21.15.121:0/1104519958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad813f060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097f0 tx=0x7f4ac802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 -- 172.21.15.121:0/1104519958 shutdown_connections 2024-09-15T23:55:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 --2- 172.21.15.121:0/1104519958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad813f060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 -- 172.21.15.121:0/1104519958 >> 172.21.15.121:0/1104519958 conn(0x7f4ad80ac3e0 msgr2=0x7f4ad80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 -- 172.21.15.121:0/1104519958 shutdown_connections 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.403+0000 7f4ae0427640 1 -- 172.21.15.121:0/1104519958 wait complete. 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ae0427640 1 Processor -- start 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ae0427640 1 -- start start 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ae0427640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ae0427640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad80a7ec0 con 0x7f4ad80a4c20 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ade1c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ade1c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55536/0 (socket says 172.21.15.121:55536) 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ade1c3640 1 -- 172.21.15.121:0/3009386383 learned_addr learned my addr 172.21.15.121:0/3009386383 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ade1c3640 1 -- 172.21.15.121:0/3009386383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad8124f10 con 0x7f4ad80a4c20 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.404+0000 7f4ade1c3640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c380 tx=0x7f4ad000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad0007410 con 0x7f4ad80a4c20 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad00075b0 con 0x7f4ad80a4c20 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad00047e0 con 0x7f4ad80a4c20 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad81247c0 con 0x7f4ad80a4c20 2024-09-15T23:55:15.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad8123540 con 0x7f4ad80a4c20 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ad001a020 con 0x7f4ad80a4c20 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.405+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad80a2f50 con 0x7f4ad80a4c20 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.406+0000 7f4aceffd640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 0x7f4abc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.406+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f4ad004a990 con 0x7f4ad80a4c20 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.406+0000 7f4add9c2640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 0x7f4abc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.406+0000 7f4add9c2640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 0x7f4abc03a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.410+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ad8124f10 con 0x7f4ad80a4c20 2024-09-15T23:55:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.573+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ad8138090 con 0x7f4abc0382a0 2024-09-15T23:55:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.579+0000 7f4aceffd640 1 -- 172.21.15.121:0/3009386383 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245901 (secure 0 0 0) 0x7f4ac80327a0 con 0x7f4abc0382a0 2024-09-15T23:55:15.582 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:15.584 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:15.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 msgr2=0x7f4abc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 0x7f4abc03a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8034000 tx=0x7f4ac802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:15.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 msgr2=0x7f4ad80a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c380 tx=0x7f4ad000c840 comp rx=0 tx=0).stop 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 shutdown_connections 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4abc0382a0 0x7f4abc03a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 --2- 172.21.15.121:0/3009386383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ad80a4c20 0x7f4ad80a1180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 >> 172.21.15.121:0/3009386383 conn(0x7f4ad80ac3e0 msgr2=0x7f4ad80aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 shutdown_connections 2024-09-15T23:55:15.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.582+0000 7f4ae0427640 1 -- 172.21.15.121:0/3009386383 wait complete. 2024-09-15T23:55:15.593 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-15T23:55:14.023948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82680,"kb_used_data":1580,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032840,"statfs":{"total":289910292480,"available":289825628160,"internally_reserved":0,"allocated":1617920,"data_stored":1296816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701909+0000","last_change":"2024-09-15T23:55:12.689010+0000","last_active":"2024-09-15T23:55:12.701909+0000","last_peered":"2024-09-15T23:55:12.701909+0000","last_clean":"2024-09-15T23:55:12.701909+0000","last_became_active":"2024-09-15T23:55:12.688116+0000","last_became_peered":"2024-09-15T23:55:12.688116+0000","last_unstale":"2024-09-15T23:55:12.701909+0000","last_undegraded":"2024-09-15T23:55:12.701909+0000","last_fullsized":"2024-09-15T23:55:12.701909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:00.679597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703211+0000","last_change":"2024-09-15T23:55:12.691799+0000","last_active":"2024-09-15T23:55:12.703211+0000","last_peered":"2024-09-15T23:55:12.703211+0000","last_clean":"2024-09-15T23:55:12.703211+0000","last_became_active":"2024-09-15T23:55:12.691528+0000","last_became_peered":"2024-09-15T23:55:12.691528+0000","last_unstale":"2024-09-15T23:55:12.703211+0000","last_undegraded":"2024-09-15T23:55:12.703211+0000","last_fullsized":"2024-09-15T23:55:12.703211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:00.679597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702798+0000","last_change":"2024-09-15T23:55:12.698265+0000","last_active":"2024-09-15T23:55:12.702798+0000","last_peered":"2024-09-15T23:55:12.702798+0000","last_clean":"2024-09-15T23:55:12.702798+0000","last_became_active":"2024-09-15T23:55:12.696115+0000","last_became_peered":"2024-09-15T23:55:12.696115+0000","last_unstale":"2024-09-15T23:55:12.702798+0000","last_undegraded":"2024-09-15T23:55:12.702798+0000","last_fullsized":"2024-09-15T23:55:12.702798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:04.611155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711688+0000","last_change":"2024-09-15T23:55:12.708793+0000","last_active":"2024-09-15T23:55:12.711688+0000","last_peered":"2024-09-15T23:55:12.711688+0000","last_clean":"2024-09-15T23:55:12.711688+0000","last_became_active":"2024-09-15T23:55:12.708546+0000","last_became_peered":"2024-09-15T23:55:12.708546+0000","last_unstale":"2024-09-15T23:55:12.711688+0000","last_undegraded":"2024-09-15T23:55:12.711688+0000","last_fullsized":"2024-09-15T23:55:12.711688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:39.962113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702044+0000","last_change":"2024-09-15T23:55:12.689949+0000","last_active":"2024-09-15T23:55:12.702044+0000","last_peered":"2024-09-15T23:55:12.702044+0000","last_clean":"2024-09-15T23:55:12.702044+0000","last_became_active":"2024-09-15T23:55:12.689502+0000","last_became_peered":"2024-09-15T23:55:12.689502+0000","last_unstale":"2024-09-15T23:55:12.702044+0000","last_undegraded":"2024-09-15T23:55:12.702044+0000","last_fullsized":"2024-09-15T23:55:12.702044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:31.578782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712906+0000","last_change":"2024-09-15T23:55:12.710819+0000","last_active":"2024-09-15T23:55:12.712906+0000","last_peered":"2024-09-15T23:55:12.712906+0000","last_clean":"2024-09-15T23:55:12.712906+0000","last_became_active":"2024-09-15T23:55:12.709647+0000","last_became_peered":"2024-09-15T23:55:12.709647+0000","last_unstale":"2024-09-15T23:55:12.712906+0000","last_undegraded":"2024-09-15T23:55:12.712906+0000","last_fullsized":"2024-09-15T23:55:12.712906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:53.568775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.695735+0000","last_change":"2024-09-15T23:55:12.683855+0000","last_active":"2024-09-15T23:55:12.695735+0000","last_peered":"2024-09-15T23:55:12.695735+0000","last_clean":"2024-09-15T23:55:12.695735+0000","last_became_active":"2024-09-15T23:55:12.683568+0000","last_became_peered":"2024-09-15T23:55:12.683568+0000","last_unstale":"2024-09-15T23:55:12.695735+0000","last_undegraded":"2024-09-15T23:55:12.695735+0000","last_fullsized":"2024-09-15T23:55:12.695735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:25.718760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.713418+0000","last_change":"2024-09-15T23:55:12.712357+0000","last_active":"2024-09-15T23:55:12.713418+0000","last_peered":"2024-09-15T23:55:12.713418+0000","last_clean":"2024-09-15T23:55:12.713418+0000","last_became_active":"2024-09-15T23:55:12.711161+0000","last_became_peered":"2024-09-15T23:55:12.711161+0000","last_unstale":"2024-09-15T23:55:12.713418+0000","last_undegraded":"2024-09-15T23:55:12.713418+0000","last_fullsized":"2024-09-15T23:55:12.713418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:23.054111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703443+0000","last_change":"2024-09-15T23:55:12.698143+0000","last_active":"2024-09-15T23:55:12.703443+0000","last_peered":"2024-09-15T23:55:12.703443+0000","last_clean":"2024-09-15T23:55:12.703443+0000","last_became_active":"2024-09-15T23:55:12.697913+0000","last_became_peered":"2024-09-15T23:55:12.697913+0000","last_unstale":"2024-09-15T23:55:12.703443+0000","last_undegraded":"2024-09-15T23:55:12.703443+0000","last_fullsized":"2024-09-15T23:55:12.703443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:59.751892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702098+0000","last_change":"2024-09-15T23:55:12.691954+0000","last_active":"2024-09-15T23:55:12.702098+0000","last_peered":"2024-09-15T23:55:12.702098+0000","last_clean":"2024-09-15T23:55:12.702098+0000","last_became_active":"2024-09-15T23:55:12.691679+0000","last_became_peered":"2024-09-15T23:55:12.691679+0000","last_unstale":"2024-09-15T23:55:12.702098+0000","last_undegraded":"2024-09-15T23:55:12.702098+0000","last_fullsized":"2024-09-15T23:55:12.702098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:51.710730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702762+0000","last_change":"2024-09-15T23:55:12.697740+0000","last_active":"2024-09-15T23:55:12.702762+0000","last_peered":"2024-09-15T23:55:12.702762+0000","last_clean":"2024-09-15T23:55:12.702762+0000","last_became_active":"2024-09-15T23:55:12.695173+0000","last_became_peered":"2024-09-15T23:55:12.695173+0000","last_unstale":"2024-09-15T23:55:12.702762+0000","last_undegraded":"2024-09-15T23:55:12.702762+0000","last_fullsized":"2024-09-15T23:55:12.702762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:59.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699294+0000","last_change":"2024-09-15T23:55:12.688930+0000","last_active":"2024-09-15T23:55:12.699294+0000","last_peered":"2024-09-15T23:55:12.699294+0000","last_clean":"2024-09-15T23:55:12.699294+0000","last_became_active":"2024-09-15T23:55:12.688599+0000","last_became_peered":"2024-09-15T23:55:12.688599+0000","last_unstale":"2024-09-15T23:55:12.699294+0000","last_undegraded":"2024-09-15T23:55:12.699294+0000","last_fullsized":"2024-09-15T23:55:12.699294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:20.418069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703528+0000","last_change":"2024-09-15T23:55:12.699041+0000","last_active":"2024-09-15T23:55:12.703528+0000","last_peered":"2024-09-15T23:55:12.703528+0000","last_clean":"2024-09-15T23:55:12.703528+0000","last_became_active":"2024-09-15T23:55:12.698719+0000","last_became_peered":"2024-09-15T23:55:12.698719+0000","last_unstale":"2024-09-15T23:55:12.703528+0000","last_undegraded":"2024-09-15T23:55:12.703528+0000","last_fullsized":"2024-09-15T23:55:12.703528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:32.130285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703554+0000","last_change":"2024-09-15T23:55:12.699903+0000","last_active":"2024-09-15T23:55:12.703554+0000","last_peered":"2024-09-15T23:55:12.703554+0000","last_clean":"2024-09-15T23:55:12.703554+0000","last_became_active":"2024-09-15T23:55:12.699658+0000","last_became_peered":"2024-09-15T23:55:12.699658+0000","last_unstale":"2024-09-15T23:55:12.703554+0000","last_undegraded":"2024-09-15T23:55:12.703554+0000","last_fullsized":"2024-09-15T23:55:12.703554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:02.111895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703886+0000","last_change":"2024-09-15T23:55:12.697628+0000","last_active":"2024-09-15T23:55:12.703886+0000","last_peered":"2024-09-15T23:55:12.703886+0000","last_clean":"2024-09-15T23:55:12.703886+0000","last_became_active":"2024-09-15T23:55:12.697376+0000","last_became_peered":"2024-09-15T23:55:12.697376+0000","last_unstale":"2024-09-15T23:55:12.703886+0000","last_undegraded":"2024-09-15T23:55:12.703886+0000","last_fullsized":"2024-09-15T23:55:12.703886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:31.578782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714616+0000","last_change":"2024-09-15T23:55:12.712697+0000","last_active":"2024-09-15T23:55:12.714616+0000","last_peered":"2024-09-15T23:55:12.714616+0000","last_clean":"2024-09-15T23:55:12.714616+0000","last_became_active":"2024-09-15T23:55:12.712204+0000","last_became_peered":"2024-09-15T23:55:12.712204+0000","last_unstale":"2024-09-15T23:55:12.714616+0000","last_undegraded":"2024-09-15T23:55:12.714616+0000","last_fullsized":"2024-09-15T23:55:12.714616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:55.477901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703208+0000","last_change":"2024-09-15T23:55:12.691645+0000","last_active":"2024-09-15T23:55:12.703208+0000","last_peered":"2024-09-15T23:55:12.703208+0000","last_clean":"2024-09-15T23:55:12.703208+0000","last_became_active":"2024-09-15T23:55:12.691220+0000","last_became_peered":"2024-09-15T23:55:12.691220+0000","last_unstale":"2024-09-15T23:55:12.703208+0000","last_undegraded":"2024-09-15T23:55:12.703208+0000","last_fullsized":"2024-09-15T23:55:12.703208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:20.418069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701308+0000","last_change":"2024-09-15T23:55:12.696986+0000","last_active":"2024-09-15T23:55:12.701308+0000","last_peered":"2024-09-15T23:55:12.701308+0000","last_clean":"2024-09-15T23:55:12.701308+0000","last_became_active":"2024-09-15T23:55:12.696708+0000","last_became_peered":"2024-09-15T23:55:12.696708+0000","last_unstale":"2024-09-15T23:55:12.701308+0000","last_undegraded":"2024-09-15T23:55:12.701308+0000","last_fullsized":"2024-09-15T23:55:12.701308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:27.840198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702781+0000","last_change":"2024-09-15T23:55:12.697966+0000","last_active":"2024-09-15T23:55:12.702781+0000","last_peered":"2024-09-15T23:55:12.702781+0000","last_clean":"2024-09-15T23:55:12.702781+0000","last_became_active":"2024-09-15T23:55:12.695494+0000","last_became_peered":"2024-09-15T23:55:12.695494+0000","last_unstale":"2024-09-15T23:55:12.702781+0000","last_undegraded":"2024-09-15T23:55:12.702781+0000","last_fullsized":"2024-09-15T23:55:12.702781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:28.197430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702526+0000","last_change":"2024-09-15T23:55:12.696664+0000","last_active":"2024-09-15T23:55:12.702526+0000","last_peered":"2024-09-15T23:55:12.702526+0000","last_clean":"2024-09-15T23:55:12.702526+0000","last_became_active":"2024-09-15T23:55:12.696407+0000","last_became_peered":"2024-09-15T23:55:12.696407+0000","last_unstale":"2024-09-15T23:55:12.702526+0000","last_undegraded":"2024-09-15T23:55:12.702526+0000","last_fullsized":"2024-09-15T23:55:12.702526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:10.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.696058+0000","last_change":"2024-09-15T23:55:12.686358+0000","last_active":"2024-09-15T23:55:12.696058+0000","last_peered":"2024-09-15T23:55:12.696058+0000","last_clean":"2024-09-15T23:55:12.696058+0000","last_became_active":"2024-09-15T23:55:12.685997+0000","last_became_peered":"2024-09-15T23:55:12.685997+0000","last_unstale":"2024-09-15T23:55:12.696058+0000","last_undegraded":"2024-09-15T23:55:12.696058+0000","last_fullsized":"2024-09-15T23:55:12.696058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:43.390563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705513+0000","last_change":"2024-09-15T23:55:12.700605+0000","last_active":"2024-09-15T23:55:12.705513+0000","last_peered":"2024-09-15T23:55:12.705513+0000","last_clean":"2024-09-15T23:55:12.705513+0000","last_became_active":"2024-09-15T23:55:12.700273+0000","last_became_peered":"2024-09-15T23:55:12.700273+0000","last_unstale":"2024-09-15T23:55:12.705513+0000","last_undegraded":"2024-09-15T23:55:12.705513+0000","last_fullsized":"2024-09-15T23:55:12.705513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:12.202368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.695855+0000","last_change":"2024-09-15T23:55:12.686146+0000","last_active":"2024-09-15T23:55:12.695855+0000","last_peered":"2024-09-15T23:55:12.695855+0000","last_clean":"2024-09-15T23:55:12.695855+0000","last_became_active":"2024-09-15T23:55:12.685705+0000","last_became_peered":"2024-09-15T23:55:12.685705+0000","last_unstale":"2024-09-15T23:55:12.695855+0000","last_undegraded":"2024-09-15T23:55:12.695855+0000","last_fullsized":"2024-09-15T23:55:12.695855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:49.770292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703630+0000","last_change":"2024-09-15T23:55:12.701281+0000","last_active":"2024-09-15T23:55:12.703630+0000","last_peered":"2024-09-15T23:55:12.703630+0000","last_clean":"2024-09-15T23:55:12.703630+0000","last_became_active":"2024-09-15T23:55:12.701047+0000","last_became_peered":"2024-09-15T23:55:12.701047+0000","last_unstale":"2024-09-15T23:55:12.703630+0000","last_undegraded":"2024-09-15T23:55:12.703630+0000","last_fullsized":"2024-09-15T23:55:12.703630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:09.860747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708361+0000","last_change":"2024-09-15T23:55:12.702183+0000","last_active":"2024-09-15T23:55:12.708361+0000","last_peered":"2024-09-15T23:55:12.708361+0000","last_clean":"2024-09-15T23:55:12.708361+0000","last_became_active":"2024-09-15T23:55:12.701921+0000","last_became_peered":"2024-09-15T23:55:12.701921+0000","last_unstale":"2024-09-15T23:55:12.708361+0000","last_undegraded":"2024-09-15T23:55:12.708361+0000","last_fullsized":"2024-09-15T23:55:12.708361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:28.462597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701327+0000","last_change":"2024-09-15T23:55:12.697158+0000","last_active":"2024-09-15T23:55:12.701327+0000","last_peered":"2024-09-15T23:55:12.701327+0000","last_clean":"2024-09-15T23:55:12.701327+0000","last_became_active":"2024-09-15T23:55:12.696919+0000","last_became_peered":"2024-09-15T23:55:12.696919+0000","last_unstale":"2024-09-15T23:55:12.701327+0000","last_undegraded":"2024-09-15T23:55:12.701327+0000","last_fullsized":"2024-09-15T23:55:12.701327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.567248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694981+0000","last_change":"2024-09-15T23:55:12.684313+0000","last_active":"2024-09-15T23:55:12.694981+0000","last_peered":"2024-09-15T23:55:12.694981+0000","last_clean":"2024-09-15T23:55:12.694981+0000","last_became_active":"2024-09-15T23:55:12.684051+0000","last_became_peered":"2024-09-15T23:55:12.684051+0000","last_unstale":"2024-09-15T23:55:12.694981+0000","last_undegraded":"2024-09-15T23:55:12.694981+0000","last_fullsized":"2024-09-15T23:55:12.694981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:25.718760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701709+0000","last_change":"2024-09-15T23:55:12.691786+0000","last_active":"2024-09-15T23:55:12.701709+0000","last_peered":"2024-09-15T23:55:12.701709+0000","last_clean":"2024-09-15T23:55:12.701709+0000","last_became_active":"2024-09-15T23:55:12.691014+0000","last_became_peered":"2024-09-15T23:55:12.691014+0000","last_unstale":"2024-09-15T23:55:12.701709+0000","last_undegraded":"2024-09-15T23:55:12.701709+0000","last_fullsized":"2024-09-15T23:55:12.701709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:59.751892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702078+0000","last_change":"2024-09-15T23:55:12.692693+0000","last_active":"2024-09-15T23:55:12.702078+0000","last_peered":"2024-09-15T23:55:12.702078+0000","last_clean":"2024-09-15T23:55:12.702078+0000","last_became_active":"2024-09-15T23:55:12.692388+0000","last_became_peered":"2024-09-15T23:55:12.692388+0000","last_unstale":"2024-09-15T23:55:12.702078+0000","last_undegraded":"2024-09-15T23:55:12.702078+0000","last_fullsized":"2024-09-15T23:55:12.702078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:22.807301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702503+0000","last_change":"2024-09-15T23:55:12.694633+0000","last_active":"2024-09-15T23:55:12.702503+0000","last_peered":"2024-09-15T23:55:12.702503+0000","last_clean":"2024-09-15T23:55:12.702503+0000","last_became_active":"2024-09-15T23:55:12.694187+0000","last_became_peered":"2024-09-15T23:55:12.694187+0000","last_unstale":"2024-09-15T23:55:12.702503+0000","last_undegraded":"2024-09-15T23:55:12.702503+0000","last_fullsized":"2024-09-15T23:55:12.702503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:56.223906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708178+0000","last_change":"2024-09-15T23:55:12.702217+0000","last_active":"2024-09-15T23:55:12.708178+0000","last_peered":"2024-09-15T23:55:12.708178+0000","last_clean":"2024-09-15T23:55:12.708178+0000","last_became_active":"2024-09-15T23:55:12.701635+0000","last_became_peered":"2024-09-15T23:55:12.701635+0000","last_unstale":"2024-09-15T23:55:12.708178+0000","last_undegraded":"2024-09-15T23:55:12.708178+0000","last_fullsized":"2024-09-15T23:55:12.708178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:18.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714591+0000","last_change":"2024-09-15T23:55:12.712448+0000","last_active":"2024-09-15T23:55:12.714591+0000","last_peered":"2024-09-15T23:55:12.714591+0000","last_clean":"2024-09-15T23:55:12.714591+0000","last_became_active":"2024-09-15T23:55:12.711476+0000","last_became_peered":"2024-09-15T23:55:12.711476+0000","last_unstale":"2024-09-15T23:55:12.714591+0000","last_undegraded":"2024-09-15T23:55:12.714591+0000","last_fullsized":"2024-09-15T23:55:12.714591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:23.553630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703287+0000","last_change":"2024-09-15T23:55:12.694322+0000","last_active":"2024-09-15T23:55:12.703287+0000","last_peered":"2024-09-15T23:55:12.703287+0000","last_clean":"2024-09-15T23:55:12.703287+0000","last_became_active":"2024-09-15T23:55:12.694058+0000","last_became_peered":"2024-09-15T23:55:12.694058+0000","last_unstale":"2024-09-15T23:55:12.703287+0000","last_undegraded":"2024-09-15T23:55:12.703287+0000","last_fullsized":"2024-09-15T23:55:12.703287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:49.381845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705603+0000","last_change":"2024-09-15T23:55:11.689438+0000","last_active":"2024-09-15T23:55:12.705603+0000","last_peered":"2024-09-15T23:55:12.705603+0000","last_clean":"2024-09-15T23:55:12.705603+0000","last_became_active":"2024-09-15T23:55:11.688715+0000","last_became_peered":"2024-09-15T23:55:11.688715+0000","last_unstale":"2024-09-15T23:55:12.705603+0000","last_undegraded":"2024-09-15T23:55:12.705603+0000","last_fullsized":"2024-09-15T23:55:12.705603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.696037+0000","last_change":"2024-09-15T23:55:12.685542+0000","last_active":"2024-09-15T23:55:12.696037+0000","last_peered":"2024-09-15T23:55:12.696037+0000","last_clean":"2024-09-15T23:55:12.696037+0000","last_became_active":"2024-09-15T23:55:12.685271+0000","last_became_peered":"2024-09-15T23:55:12.685271+0000","last_unstale":"2024-09-15T23:55:12.696037+0000","last_undegraded":"2024-09-15T23:55:12.696037+0000","last_fullsized":"2024-09-15T23:55:12.696037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:47.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712834+0000","last_change":"2024-09-15T23:55:11.690527+0000","last_active":"2024-09-15T23:55:12.712834+0000","last_peered":"2024-09-15T23:55:12.712834+0000","last_clean":"2024-09-15T23:55:12.712834+0000","last_became_active":"2024-09-15T23:55:11.690256+0000","last_became_peered":"2024-09-15T23:55:11.690256+0000","last_unstale":"2024-09-15T23:55:12.712834+0000","last_undegraded":"2024-09-15T23:55:12.712834+0000","last_fullsized":"2024-09-15T23:55:12.712834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.749058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.671199+0000","last_change":"2024-09-15T23:55:11.687201+0000","last_active":"2024-09-15T23:55:12.671199+0000","last_peered":"2024-09-15T23:55:12.671199+0000","last_clean":"2024-09-15T23:55:12.671199+0000","last_became_active":"2024-09-15T23:55:11.687041+0000","last_became_peered":"2024-09-15T23:55:11.687041+0000","last_unstale":"2024-09-15T23:55:12.671199+0000","last_undegraded":"2024-09-15T23:55:12.671199+0000","last_fullsized":"2024-09-15T23:55:12.671199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714606+0000","last_change":"2024-09-15T23:55:12.712572+0000","last_active":"2024-09-15T23:55:12.714606+0000","last_peered":"2024-09-15T23:55:12.714606+0000","last_clean":"2024-09-15T23:55:12.714606+0000","last_became_active":"2024-09-15T23:55:12.711835+0000","last_became_peered":"2024-09-15T23:55:12.711835+0000","last_unstale":"2024-09-15T23:55:12.714606+0000","last_undegraded":"2024-09-15T23:55:12.714606+0000","last_fullsized":"2024-09-15T23:55:12.714606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:15.940580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.670402+0000","last_change":"2024-09-15T23:55:11.695048+0000","last_active":"2024-09-15T23:55:12.670402+0000","last_peered":"2024-09-15T23:55:12.670402+0000","last_clean":"2024-09-15T23:55:12.670402+0000","last_became_active":"2024-09-15T23:55:11.694766+0000","last_became_peered":"2024-09-15T23:55:11.694766+0000","last_unstale":"2024-09-15T23:55:12.670402+0000","last_undegraded":"2024-09-15T23:55:12.670402+0000","last_fullsized":"2024-09-15T23:55:12.670402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694886+0000","last_change":"2024-09-15T23:55:12.685430+0000","last_active":"2024-09-15T23:55:12.694886+0000","last_peered":"2024-09-15T23:55:12.694886+0000","last_clean":"2024-09-15T23:55:12.694886+0000","last_became_active":"2024-09-15T23:55:12.685161+0000","last_became_peered":"2024-09-15T23:55:12.685161+0000","last_unstale":"2024-09-15T23:55:12.694886+0000","last_undegraded":"2024-09-15T23:55:12.694886+0000","last_fullsized":"2024-09-15T23:55:12.694886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:49.770292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.676916+0000","last_change":"2024-09-15T23:55:11.680383+0000","last_active":"2024-09-15T23:55:12.676916+0000","last_peered":"2024-09-15T23:55:12.676916+0000","last_clean":"2024-09-15T23:55:12.676916+0000","last_became_active":"2024-09-15T23:55:11.680116+0000","last_became_peered":"2024-09-15T23:55:11.680116+0000","last_unstale":"2024-09-15T23:55:12.676916+0000","last_undegraded":"2024-09-15T23:55:12.676916+0000","last_fullsized":"2024-09-15T23:55:12.676916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701269+0000","last_change":"2024-09-15T23:55:12.695948+0000","last_active":"2024-09-15T23:55:12.701269+0000","last_peered":"2024-09-15T23:55:12.701269+0000","last_clean":"2024-09-15T23:55:12.701269+0000","last_became_active":"2024-09-15T23:55:12.695680+0000","last_became_peered":"2024-09-15T23:55:12.695680+0000","last_unstale":"2024-09-15T23:55:12.701269+0000","last_undegraded":"2024-09-15T23:55:12.701269+0000","last_fullsized":"2024-09-15T23:55:12.701269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:18.423134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.673194+0000","last_change":"2024-09-15T23:55:11.684947+0000","last_active":"2024-09-15T23:55:12.673194+0000","last_peered":"2024-09-15T23:55:12.673194+0000","last_clean":"2024-09-15T23:55:12.673194+0000","last_became_active":"2024-09-15T23:55:11.684524+0000","last_became_peered":"2024-09-15T23:55:11.684524+0000","last_unstale":"2024-09-15T23:55:12.673194+0000","last_undegraded":"2024-09-15T23:55:12.673194+0000","last_fullsized":"2024-09-15T23:55:12.673194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702012+0000","last_change":"2024-09-15T23:55:12.692510+0000","last_active":"2024-09-15T23:55:12.702012+0000","last_peered":"2024-09-15T23:55:12.702012+0000","last_clean":"2024-09-15T23:55:12.702012+0000","last_became_active":"2024-09-15T23:55:12.692271+0000","last_became_peered":"2024-09-15T23:55:12.692271+0000","last_unstale":"2024-09-15T23:55:12.702012+0000","last_undegraded":"2024-09-15T23:55:12.702012+0000","last_fullsized":"2024-09-15T23:55:12.702012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:41.676029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.706392+0000","last_change":"2024-09-15T23:55:11.689697+0000","last_active":"2024-09-15T23:55:12.706392+0000","last_peered":"2024-09-15T23:55:12.706392+0000","last_clean":"2024-09-15T23:55:12.706392+0000","last_became_active":"2024-09-15T23:55:11.689121+0000","last_became_peered":"2024-09-15T23:55:11.689121+0000","last_unstale":"2024-09-15T23:55:12.706392+0000","last_undegraded":"2024-09-15T23:55:12.706392+0000","last_fullsized":"2024-09-15T23:55:12.706392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703039+0000","last_change":"2024-09-15T23:55:12.690608+0000","last_active":"2024-09-15T23:55:12.703039+0000","last_peered":"2024-09-15T23:55:12.703039+0000","last_clean":"2024-09-15T23:55:12.703039+0000","last_became_active":"2024-09-15T23:55:12.690352+0000","last_became_peered":"2024-09-15T23:55:12.690352+0000","last_unstale":"2024-09-15T23:55:12.703039+0000","last_undegraded":"2024-09-15T23:55:12.703039+0000","last_fullsized":"2024-09-15T23:55:12.703039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:43.390563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714048+0000","last_change":"2024-09-15T23:55:11.685728+0000","last_active":"2024-09-15T23:55:12.714048+0000","last_peered":"2024-09-15T23:55:12.714048+0000","last_clean":"2024-09-15T23:55:12.714048+0000","last_became_active":"2024-09-15T23:55:11.685469+0000","last_became_peered":"2024-09-15T23:55:11.685469+0000","last_unstale":"2024-09-15T23:55:12.714048+0000","last_undegraded":"2024-09-15T23:55:12.714048+0000","last_fullsized":"2024-09-15T23:55:12.714048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:25.521672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702741+0000","last_change":"2024-09-15T23:55:12.697521+0000","last_active":"2024-09-15T23:55:12.702741+0000","last_peered":"2024-09-15T23:55:12.702741+0000","last_clean":"2024-09-15T23:55:12.702741+0000","last_became_active":"2024-09-15T23:55:12.694852+0000","last_became_peered":"2024-09-15T23:55:12.694852+0000","last_unstale":"2024-09-15T23:55:12.702741+0000","last_undegraded":"2024-09-15T23:55:12.702741+0000","last_fullsized":"2024-09-15T23:55:12.702741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:09.986785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.713312+0000","last_change":"2024-09-15T23:55:11.687469+0000","last_active":"2024-09-15T23:55:12.713312+0000","last_peered":"2024-09-15T23:55:12.713312+0000","last_clean":"2024-09-15T23:55:12.713312+0000","last_became_active":"2024-09-15T23:55:11.687140+0000","last_became_peered":"2024-09-15T23:55:11.687140+0000","last_unstale":"2024-09-15T23:55:12.713312+0000","last_undegraded":"2024-09-15T23:55:12.713312+0000","last_fullsized":"2024-09-15T23:55:12.713312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702486+0000","last_change":"2024-09-15T23:55:12.694577+0000","last_active":"2024-09-15T23:55:12.702486+0000","last_peered":"2024-09-15T23:55:12.702486+0000","last_clean":"2024-09-15T23:55:12.702486+0000","last_became_active":"2024-09-15T23:55:12.693352+0000","last_became_peered":"2024-09-15T23:55:12.693352+0000","last_unstale":"2024-09-15T23:55:12.702486+0000","last_undegraded":"2024-09-15T23:55:12.702486+0000","last_fullsized":"2024-09-15T23:55:12.702486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.347154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.688631+0000","last_change":"2024-09-15T23:55:11.686342+0000","last_active":"2024-09-15T23:55:12.688631+0000","last_peered":"2024-09-15T23:55:12.688631+0000","last_clean":"2024-09-15T23:55:12.688631+0000","last_became_active":"2024-09-15T23:55:11.686052+0000","last_became_peered":"2024-09-15T23:55:11.686052+0000","last_unstale":"2024-09-15T23:55:12.688631+0000","last_undegraded":"2024-09-15T23:55:12.688631+0000","last_fullsized":"2024-09-15T23:55:12.688631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:50.303621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.704079+0000","last_change":"2024-09-15T23:55:12.699612+0000","last_active":"2024-09-15T23:55:12.704079+0000","last_peered":"2024-09-15T23:55:12.704079+0000","last_clean":"2024-09-15T23:55:12.704079+0000","last_became_active":"2024-09-15T23:55:12.699166+0000","last_became_peered":"2024-09-15T23:55:12.699166+0000","last_unstale":"2024-09-15T23:55:12.704079+0000","last_undegraded":"2024-09-15T23:55:12.704079+0000","last_fullsized":"2024-09-15T23:55:12.704079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:41.676029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.671930+0000","last_change":"2024-09-15T23:55:11.685669+0000","last_active":"2024-09-15T23:55:12.671930+0000","last_peered":"2024-09-15T23:55:12.671930+0000","last_clean":"2024-09-15T23:55:12.671930+0000","last_became_active":"2024-09-15T23:55:11.685404+0000","last_became_peered":"2024-09-15T23:55:11.685404+0000","last_unstale":"2024-09-15T23:55:12.671930+0000","last_undegraded":"2024-09-15T23:55:12.671930+0000","last_fullsized":"2024-09-15T23:55:12.671930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708927+0000","last_change":"2024-09-15T23:55:12.706980+0000","last_active":"2024-09-15T23:55:12.708927+0000","last_peered":"2024-09-15T23:55:12.708927+0000","last_clean":"2024-09-15T23:55:12.708927+0000","last_became_active":"2024-09-15T23:55:12.706336+0000","last_became_peered":"2024-09-15T23:55:12.706336+0000","last_unstale":"2024-09-15T23:55:12.708927+0000","last_undegraded":"2024-09-15T23:55:12.708927+0000","last_fullsized":"2024-09-15T23:55:12.708927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:28.158305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712201+0000","last_change":"2024-09-15T23:55:11.690815+0000","last_active":"2024-09-15T23:55:12.712201+0000","last_peered":"2024-09-15T23:55:12.712201+0000","last_clean":"2024-09-15T23:55:12.712201+0000","last_became_active":"2024-09-15T23:55:11.690538+0000","last_became_peered":"2024-09-15T23:55:11.690538+0000","last_unstale":"2024-09-15T23:55:12.712201+0000","last_undegraded":"2024-09-15T23:55:12.712201+0000","last_fullsized":"2024-09-15T23:55:12.712201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:34.734800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.710574+0000","last_change":"2024-09-15T23:55:12.705659+0000","last_active":"2024-09-15T23:55:12.710574+0000","last_peered":"2024-09-15T23:55:12.710574+0000","last_clean":"2024-09-15T23:55:12.710574+0000","last_became_active":"2024-09-15T23:55:12.705408+0000","last_became_peered":"2024-09-15T23:55:12.705408+0000","last_unstale":"2024-09-15T23:55:12.710574+0000","last_undegraded":"2024-09-15T23:55:12.710574+0000","last_fullsized":"2024-09-15T23:55:12.710574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:45.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711311+0000","last_change":"2024-09-15T23:55:11.685486+0000","last_active":"2024-09-15T23:55:12.711311+0000","last_peered":"2024-09-15T23:55:12.711311+0000","last_clean":"2024-09-15T23:55:12.711311+0000","last_became_active":"2024-09-15T23:55:11.685191+0000","last_became_peered":"2024-09-15T23:55:11.685191+0000","last_unstale":"2024-09-15T23:55:12.711311+0000","last_undegraded":"2024-09-15T23:55:12.711311+0000","last_fullsized":"2024-09-15T23:55:12.711311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711907+0000","last_change":"2024-09-15T23:55:12.710015+0000","last_active":"2024-09-15T23:55:12.711907+0000","last_peered":"2024-09-15T23:55:12.711907+0000","last_clean":"2024-09-15T23:55:12.711907+0000","last_became_active":"2024-09-15T23:55:12.709501+0000","last_became_peered":"2024-09-15T23:55:12.709501+0000","last_unstale":"2024-09-15T23:55:12.711907+0000","last_undegraded":"2024-09-15T23:55:12.711907+0000","last_fullsized":"2024-09-15T23:55:12.711907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:12.814359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712894+0000","last_change":"2024-09-15T23:55:11.690840+0000","last_active":"2024-09-15T23:55:12.712894+0000","last_peered":"2024-09-15T23:55:12.712894+0000","last_clean":"2024-09-15T23:55:12.712894+0000","last_became_active":"2024-09-15T23:55:11.690562+0000","last_became_peered":"2024-09-15T23:55:11.690562+0000","last_unstale":"2024-09-15T23:55:12.712894+0000","last_undegraded":"2024-09-15T23:55:12.712894+0000","last_fullsized":"2024-09-15T23:55:12.712894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:05.205328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702643+0000","last_change":"2024-09-15T23:55:12.697590+0000","last_active":"2024-09-15T23:55:12.702643+0000","last_peered":"2024-09-15T23:55:12.702643+0000","last_clean":"2024-09-15T23:55:12.702643+0000","last_became_active":"2024-09-15T23:55:12.697210+0000","last_became_peered":"2024-09-15T23:55:12.697210+0000","last_unstale":"2024-09-15T23:55:12.702643+0000","last_undegraded":"2024-09-15T23:55:12.702643+0000","last_fullsized":"2024-09-15T23:55:12.702643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:06.699466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703513+0000","last_change":"2024-09-15T23:55:11.680934+0000","last_active":"2024-09-15T23:55:12.703513+0000","last_peered":"2024-09-15T23:55:12.703513+0000","last_clean":"2024-09-15T23:55:12.703513+0000","last_became_active":"2024-09-15T23:55:11.679943+0000","last_became_peered":"2024-09-15T23:55:11.679943+0000","last_unstale":"2024-09-15T23:55:12.703513+0000","last_undegraded":"2024-09-15T23:55:12.703513+0000","last_fullsized":"2024-09-15T23:55:12.703513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702544+0000","last_change":"2024-09-15T23:55:12.697768+0000","last_active":"2024-09-15T23:55:12.702544+0000","last_peered":"2024-09-15T23:55:12.702544+0000","last_clean":"2024-09-15T23:55:12.702544+0000","last_became_active":"2024-09-15T23:55:12.696964+0000","last_became_peered":"2024-09-15T23:55:12.696964+0000","last_unstale":"2024-09-15T23:55:12.702544+0000","last_undegraded":"2024-09-15T23:55:12.702544+0000","last_fullsized":"2024-09-15T23:55:12.702544+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.687704+0000","last_change":"2024-09-15T23:55:11.689063+0000","last_active":"2024-09-15T23:55:12.687704+0000","last_peered":"2024-09-15T23:55:12.687704+0000","last_clean":"2024-09-15T23:55:12.687704+0000","last_became_active":"2024-09-15T23:55:11.688818+0000","last_became_peered":"2024-09-15T23:55:11.688818+0000","last_unstale":"2024-09-15T23:55:12.687704+0000","last_undegraded":"2024-09-15T23:55:12.687704+0000","last_fullsized":"2024-09-15T23:55:12.687704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:11.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703564+0000","last_change":"2024-09-15T23:55:12.694288+0000","last_active":"2024-09-15T23:55:12.703564+0000","last_peered":"2024-09-15T23:55:12.703564+0000","last_clean":"2024-09-15T23:55:12.703564+0000","last_became_active":"2024-09-15T23:55:12.693688+0000","last_became_peered":"2024-09-15T23:55:12.693688+0000","last_unstale":"2024-09-15T23:55:12.703564+0000","last_undegraded":"2024-09-15T23:55:12.703564+0000","last_fullsized":"2024-09-15T23:55:12.703564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:55.572607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":145,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677829+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:12.677829+0000","last_peered":"2024-09-15T23:55:12.677829+0000","last_clean":"2024-09-15T23:55:12.677829+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:12.677829+0000","last_undegraded":"2024-09-15T23:55:12.677829+0000","last_fullsized":"2024-09-15T23:55:12.677829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.678342+0000","last_change":"2024-09-15T23:55:11.684064+0000","last_active":"2024-09-15T23:55:12.678342+0000","last_peered":"2024-09-15T23:55:12.678342+0000","last_clean":"2024-09-15T23:55:12.678342+0000","last_became_active":"2024-09-15T23:55:11.683537+0000","last_became_peered":"2024-09-15T23:55:11.683537+0000","last_unstale":"2024-09-15T23:55:12.678342+0000","last_undegraded":"2024-09-15T23:55:12.678342+0000","last_fullsized":"2024-09-15T23:55:12.678342+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703030+0000","last_change":"2024-09-15T23:55:12.690740+0000","last_active":"2024-09-15T23:55:12.703030+0000","last_peered":"2024-09-15T23:55:12.703030+0000","last_clean":"2024-09-15T23:55:12.703030+0000","last_became_active":"2024-09-15T23:55:12.690500+0000","last_became_peered":"2024-09-15T23:55:12.690500+0000","last_unstale":"2024-09-15T23:55:12.703030+0000","last_undegraded":"2024-09-15T23:55:12.703030+0000","last_fullsized":"2024-09-15T23:55:12.703030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:27.460408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.690408+0000","last_change":"2024-09-15T23:55:11.691560+0000","last_active":"2024-09-15T23:55:12.690408+0000","last_peered":"2024-09-15T23:55:12.690408+0000","last_clean":"2024-09-15T23:55:12.690408+0000","last_became_active":"2024-09-15T23:55:11.691111+0000","last_became_peered":"2024-09-15T23:55:11.691111+0000","last_unstale":"2024-09-15T23:55:12.690408+0000","last_undegraded":"2024-09-15T23:55:12.690408+0000","last_fullsized":"2024-09-15T23:55:12.690408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:40.745603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701837+0000","last_change":"2024-09-15T23:55:12.692568+0000","last_active":"2024-09-15T23:55:12.701837+0000","last_peered":"2024-09-15T23:55:12.701837+0000","last_clean":"2024-09-15T23:55:12.701837+0000","last_became_active":"2024-09-15T23:55:12.692021+0000","last_became_peered":"2024-09-15T23:55:12.692021+0000","last_unstale":"2024-09-15T23:55:12.701837+0000","last_undegraded":"2024-09-15T23:55:12.701837+0000","last_fullsized":"2024-09-15T23:55:12.701837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:12.202368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.687220+0000","last_change":"2024-09-15T23:55:11.686567+0000","last_active":"2024-09-15T23:55:12.687220+0000","last_peered":"2024-09-15T23:55:12.687220+0000","last_clean":"2024-09-15T23:55:12.687220+0000","last_became_active":"2024-09-15T23:55:11.686326+0000","last_became_peered":"2024-09-15T23:55:11.686326+0000","last_unstale":"2024-09-15T23:55:12.687220+0000","last_undegraded":"2024-09-15T23:55:12.687220+0000","last_fullsized":"2024-09-15T23:55:12.687220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694889+0000","last_change":"2024-09-15T23:55:12.684331+0000","last_active":"2024-09-15T23:55:12.694889+0000","last_peered":"2024-09-15T23:55:12.694889+0000","last_clean":"2024-09-15T23:55:12.694889+0000","last_became_active":"2024-09-15T23:55:12.684077+0000","last_became_peered":"2024-09-15T23:55:12.684077+0000","last_unstale":"2024-09-15T23:55:12.694889+0000","last_undegraded":"2024-09-15T23:55:12.694889+0000","last_fullsized":"2024-09-15T23:55:12.694889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:47.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.675766+0000","last_change":"2024-09-15T23:55:11.681692+0000","last_active":"2024-09-15T23:55:12.675766+0000","last_peered":"2024-09-15T23:55:12.675766+0000","last_clean":"2024-09-15T23:55:12.675766+0000","last_became_active":"2024-09-15T23:55:11.681438+0000","last_became_peered":"2024-09-15T23:55:11.681438+0000","last_unstale":"2024-09-15T23:55:12.675766+0000","last_undegraded":"2024-09-15T23:55:12.675766+0000","last_fullsized":"2024-09-15T23:55:12.675766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699373+0000","last_change":"2024-09-15T23:55:12.689132+0000","last_active":"2024-09-15T23:55:12.699373+0000","last_peered":"2024-09-15T23:55:12.699373+0000","last_clean":"2024-09-15T23:55:12.699373+0000","last_became_active":"2024-09-15T23:55:12.688172+0000","last_became_peered":"2024-09-15T23:55:12.688172+0000","last_unstale":"2024-09-15T23:55:12.699373+0000","last_undegraded":"2024-09-15T23:55:12.699373+0000","last_fullsized":"2024-09-15T23:55:12.699373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:55.572607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677840+0000","last_change":"2024-09-15T23:55:11.690745+0000","last_active":"2024-09-15T23:55:12.677840+0000","last_peered":"2024-09-15T23:55:12.677840+0000","last_clean":"2024-09-15T23:55:12.677840+0000","last_became_active":"2024-09-15T23:55:11.690190+0000","last_became_peered":"2024-09-15T23:55:11.690190+0000","last_unstale":"2024-09-15T23:55:12.677840+0000","last_undegraded":"2024-09-15T23:55:12.677840+0000","last_fullsized":"2024-09-15T23:55:12.677840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708425+0000","last_change":"2024-09-15T23:55:12.702288+0000","last_active":"2024-09-15T23:55:12.708425+0000","last_peered":"2024-09-15T23:55:12.708425+0000","last_clean":"2024-09-15T23:55:12.708425+0000","last_became_active":"2024-09-15T23:55:12.701837+0000","last_became_peered":"2024-09-15T23:55:12.701837+0000","last_unstale":"2024-09-15T23:55:12.708425+0000","last_undegraded":"2024-09-15T23:55:12.708425+0000","last_fullsized":"2024-09-15T23:55:12.708425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:38.496510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.675193+0000","last_change":"2024-09-15T23:55:11.689383+0000","last_active":"2024-09-15T23:55:12.675193+0000","last_peered":"2024-09-15T23:55:12.675193+0000","last_clean":"2024-09-15T23:55:12.675193+0000","last_became_active":"2024-09-15T23:55:11.688499+0000","last_became_peered":"2024-09-15T23:55:11.688499+0000","last_unstale":"2024-09-15T23:55:12.675193+0000","last_undegraded":"2024-09-15T23:55:12.675193+0000","last_fullsized":"2024-09-15T23:55:12.675193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694623+0000","last_change":"2024-09-15T23:55:12.683877+0000","last_active":"2024-09-15T23:55:12.694623+0000","last_peered":"2024-09-15T23:55:12.694623+0000","last_clean":"2024-09-15T23:55:12.694623+0000","last_became_active":"2024-09-15T23:55:12.683590+0000","last_became_peered":"2024-09-15T23:55:12.683590+0000","last_unstale":"2024-09-15T23:55:12.694623+0000","last_undegraded":"2024-09-15T23:55:12.694623+0000","last_fullsized":"2024-09-15T23:55:12.694623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:08.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.674317+0000","last_change":"2024-09-15T23:55:11.691447+0000","last_active":"2024-09-15T23:55:12.674317+0000","last_peered":"2024-09-15T23:55:12.674317+0000","last_clean":"2024-09-15T23:55:12.674317+0000","last_became_active":"2024-09-15T23:55:11.691128+0000","last_became_peered":"2024-09-15T23:55:11.691128+0000","last_unstale":"2024-09-15T23:55:12.674317+0000","last_undegraded":"2024-09-15T23:55:12.674317+0000","last_fullsized":"2024-09-15T23:55:12.674317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711125+0000","last_change":"2024-09-15T23:55:12.704420+0000","last_active":"2024-09-15T23:55:12.711125+0000","last_peered":"2024-09-15T23:55:12.711125+0000","last_clean":"2024-09-15T23:55:12.711125+0000","last_became_active":"2024-09-15T23:55:12.704171+0000","last_became_peered":"2024-09-15T23:55:12.704171+0000","last_unstale":"2024-09-15T23:55:12.711125+0000","last_undegraded":"2024-09-15T23:55:12.711125+0000","last_fullsized":"2024-09-15T23:55:12.711125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:31.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.706812+0000","last_change":"2024-09-15T23:55:11.689361+0000","last_active":"2024-09-15T23:55:12.706812+0000","last_peered":"2024-09-15T23:55:12.706812+0000","last_clean":"2024-09-15T23:55:12.706812+0000","last_became_active":"2024-09-15T23:55:11.688414+0000","last_became_peered":"2024-09-15T23:55:11.688414+0000","last_unstale":"2024-09-15T23:55:12.706812+0000","last_undegraded":"2024-09-15T23:55:12.706812+0000","last_fullsized":"2024-09-15T23:55:12.706812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699219+0000","last_change":"2024-09-15T23:55:12.688327+0000","last_active":"2024-09-15T23:55:12.699219+0000","last_peered":"2024-09-15T23:55:12.699219+0000","last_clean":"2024-09-15T23:55:12.699219+0000","last_became_active":"2024-09-15T23:55:12.688057+0000","last_became_peered":"2024-09-15T23:55:12.688057+0000","last_unstale":"2024-09-15T23:55:12.699219+0000","last_undegraded":"2024-09-15T23:55:12.699219+0000","last_fullsized":"2024-09-15T23:55:12.699219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:27.460408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.672243+0000","last_change":"2024-09-15T23:55:11.685621+0000","last_active":"2024-09-15T23:55:12.672243+0000","last_peered":"2024-09-15T23:55:12.672243+0000","last_clean":"2024-09-15T23:55:12.672243+0000","last_became_active":"2024-09-15T23:55:11.685362+0000","last_became_peered":"2024-09-15T23:55:11.685362+0000","last_unstale":"2024-09-15T23:55:12.672243+0000","last_undegraded":"2024-09-15T23:55:12.672243+0000","last_fullsized":"2024-09-15T23:55:12.672243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701859+0000","last_change":"2024-09-15T23:55:12.693033+0000","last_active":"2024-09-15T23:55:12.701859+0000","last_peered":"2024-09-15T23:55:12.701859+0000","last_clean":"2024-09-15T23:55:12.701859+0000","last_became_active":"2024-09-15T23:55:12.692321+0000","last_became_peered":"2024-09-15T23:55:12.692321+0000","last_unstale":"2024-09-15T23:55:12.701859+0000","last_undegraded":"2024-09-15T23:55:12.701859+0000","last_fullsized":"2024-09-15T23:55:12.701859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:28.158305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677998+0000","last_change":"2024-09-15T23:55:11.689154+0000","last_active":"2024-09-15T23:55:12.677998+0000","last_peered":"2024-09-15T23:55:12.677998+0000","last_clean":"2024-09-15T23:55:12.677998+0000","last_became_active":"2024-09-15T23:55:11.688854+0000","last_became_peered":"2024-09-15T23:55:11.688854+0000","last_unstale":"2024-09-15T23:55:12.677998+0000","last_undegraded":"2024-09-15T23:55:12.677998+0000","last_fullsized":"2024-09-15T23:55:12.677998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712244+0000","last_change":"2024-09-15T23:55:12.705007+0000","last_active":"2024-09-15T23:55:12.712244+0000","last_peered":"2024-09-15T23:55:12.712244+0000","last_clean":"2024-09-15T23:55:12.712244+0000","last_became_active":"2024-09-15T23:55:12.704753+0000","last_became_peered":"2024-09-15T23:55:12.704753+0000","last_unstale":"2024-09-15T23:55:12.712244+0000","last_undegraded":"2024-09-15T23:55:12.712244+0000","last_fullsized":"2024-09-15T23:55:12.712244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:22.199481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.680910+0000","last_change":"2024-09-15T23:55:11.689771+0000","last_active":"2024-09-15T23:55:12.680910+0000","last_peered":"2024-09-15T23:55:12.680910+0000","last_clean":"2024-09-15T23:55:12.680910+0000","last_became_active":"2024-09-15T23:55:11.689083+0000","last_became_peered":"2024-09-15T23:55:11.689083+0000","last_unstale":"2024-09-15T23:55:12.680910+0000","last_undegraded":"2024-09-15T23:55:12.680910+0000","last_fullsized":"2024-09-15T23:55:12.680910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.704058+0000","last_change":"2024-09-15T23:55:12.699401+0000","last_active":"2024-09-15T23:55:12.704058+0000","last_peered":"2024-09-15T23:55:12.704058+0000","last_clean":"2024-09-15T23:55:12.704058+0000","last_became_active":"2024-09-15T23:55:12.698873+0000","last_became_peered":"2024-09-15T23:55:12.698873+0000","last_unstale":"2024-09-15T23:55:12.704058+0000","last_undegraded":"2024-09-15T23:55:12.704058+0000","last_fullsized":"2024-09-15T23:55:12.704058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:51.710730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712694+0000","last_change":"2024-09-15T23:55:11.683719+0000","last_active":"2024-09-15T23:55:12.712694+0000","last_peered":"2024-09-15T23:55:12.712694+0000","last_clean":"2024-09-15T23:55:12.712694+0000","last_became_active":"2024-09-15T23:55:11.682811+0000","last_became_peered":"2024-09-15T23:55:11.682811+0000","last_unstale":"2024-09-15T23:55:12.712694+0000","last_undegraded":"2024-09-15T23:55:12.712694+0000","last_fullsized":"2024-09-15T23:55:12.712694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702465+0000","last_change":"2024-09-15T23:55:12.694426+0000","last_active":"2024-09-15T23:55:12.702465+0000","last_peered":"2024-09-15T23:55:12.702465+0000","last_clean":"2024-09-15T23:55:12.702465+0000","last_became_active":"2024-09-15T23:55:12.693056+0000","last_became_peered":"2024-09-15T23:55:12.693056+0000","last_unstale":"2024-09-15T23:55:12.702465+0000","last_undegraded":"2024-09-15T23:55:12.702465+0000","last_fullsized":"2024-09-15T23:55:12.702465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.831473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708406+0000","last_change":"2024-09-15T23:55:12.702080+0000","last_active":"2024-09-15T23:55:12.708406+0000","last_peered":"2024-09-15T23:55:12.708406+0000","last_clean":"2024-09-15T23:55:12.708406+0000","last_became_active":"2024-09-15T23:55:12.701497+0000","last_became_peered":"2024-09-15T23:55:12.701497+0000","last_unstale":"2024-09-15T23:55:12.708406+0000","last_undegraded":"2024-09-15T23:55:12.708406+0000","last_fullsized":"2024-09-15T23:55:12.708406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:33.662496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.709697+0000","last_change":"2024-09-15T23:55:11.682360+0000","last_active":"2024-09-15T23:55:12.709697+0000","last_peered":"2024-09-15T23:55:12.709697+0000","last_clean":"2024-09-15T23:55:12.709697+0000","last_became_active":"2024-09-15T23:55:11.682073+0000","last_became_peered":"2024-09-15T23:55:11.682073+0000","last_unstale":"2024-09-15T23:55:12.709697+0000","last_undegraded":"2024-09-15T23:55:12.709697+0000","last_fullsized":"2024-09-15T23:55:12.709697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:07.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705760+0000","last_change":"2024-09-15T23:55:12.700670+0000","last_active":"2024-09-15T23:55:12.705760+0000","last_peered":"2024-09-15T23:55:12.705760+0000","last_clean":"2024-09-15T23:55:12.705760+0000","last_became_active":"2024-09-15T23:55:12.699711+0000","last_became_peered":"2024-09-15T23:55:12.699711+0000","last_unstale":"2024-09-15T23:55:12.705760+0000","last_undegraded":"2024-09-15T23:55:12.705760+0000","last_fullsized":"2024-09-15T23:55:12.705760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:22.807301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.709826+0000","last_change":"2024-09-15T23:55:11.693722+0000","last_active":"2024-09-15T23:55:12.709826+0000","last_peered":"2024-09-15T23:55:12.709826+0000","last_clean":"2024-09-15T23:55:12.709826+0000","last_became_active":"2024-09-15T23:55:11.693487+0000","last_became_peered":"2024-09-15T23:55:11.693487+0000","last_unstale":"2024-09-15T23:55:12.709826+0000","last_undegraded":"2024-09-15T23:55:12.709826+0000","last_fullsized":"2024-09-15T23:55:12.709826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701930+0000","last_change":"2024-09-15T23:55:12.689223+0000","last_active":"2024-09-15T23:55:12.701930+0000","last_peered":"2024-09-15T23:55:12.701930+0000","last_clean":"2024-09-15T23:55:12.701930+0000","last_became_active":"2024-09-15T23:55:12.688397+0000","last_became_peered":"2024-09-15T23:55:12.688397+0000","last_unstale":"2024-09-15T23:55:12.701930+0000","last_undegraded":"2024-09-15T23:55:12.701930+0000","last_fullsized":"2024-09-15T23:55:12.701930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:49.381845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712504+0000","last_change":"2024-09-15T23:55:11.691511+0000","last_active":"2024-09-15T23:55:12.712504+0000","last_peered":"2024-09-15T23:55:12.712504+0000","last_clean":"2024-09-15T23:55:12.712504+0000","last_became_active":"2024-09-15T23:55:11.690348+0000","last_became_peered":"2024-09-15T23:55:11.690348+0000","last_unstale":"2024-09-15T23:55:12.712504+0000","last_undegraded":"2024-09-15T23:55:12.712504+0000","last_fullsized":"2024-09-15T23:55:12.712504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.969491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701291+0000","last_change":"2024-09-15T23:55:12.696145+0000","last_active":"2024-09-15T23:55:12.701291+0000","last_peered":"2024-09-15T23:55:12.701291+0000","last_clean":"2024-09-15T23:55:12.701291+0000","last_became_active":"2024-09-15T23:55:12.695891+0000","last_became_peered":"2024-09-15T23:55:12.695891+0000","last_unstale":"2024-09-15T23:55:12.701291+0000","last_undegraded":"2024-09-15T23:55:12.701291+0000","last_fullsized":"2024-09-15T23:55:12.701291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:05.165335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711402+0000","last_change":"2024-09-15T23:55:11.686294+0000","last_active":"2024-09-15T23:55:12.711402+0000","last_peered":"2024-09-15T23:55:12.711402+0000","last_clean":"2024-09-15T23:55:12.711402+0000","last_became_active":"2024-09-15T23:55:11.685978+0000","last_became_peered":"2024-09-15T23:55:11.685978+0000","last_unstale":"2024-09-15T23:55:12.711402+0000","last_undegraded":"2024-09-15T23:55:12.711402+0000","last_fullsized":"2024-09-15T23:55:12.711402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":761856,"data_stored":633622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":724992,"data_stored":626781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:15.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:15.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.731+0000 7f9a482d2640 1 Processor -- start 2024-09-15T23:55:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.731+0000 7f9a482d2640 1 -- start start 2024-09-15T23:55:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a482d2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9a4009ee30 0x7f9a4013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a482d2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a400a2280 con 0x7f9a400a39c0 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a482d2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4009e6e0 con 0x7f9a4009ee30 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4586d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9a4009ee30 0x7f9a4013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4586d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9a4009ee30 0x7f9a4013ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55540/0 (socket says 172.21.15.121:55540) 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4606e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9a400a39c0 0x7f9a400a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45410/0 (socket says 172.21.15.121:45410) 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4586d640 1 -- 172.21.15.121:0/2332350144 learned_addr learned my addr 172.21.15.121:0/2332350144 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4586d640 1 -- 172.21.15.121:0/2332350144 >> v1:172.21.15.121:6789/0 conn(0x7f9a400a39c0 legacy=0x7f9a400a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.732+0000 7f9a4586d640 1 -- 172.21.15.121:0/2332350144 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4009e3d0 con 0x7f9a4009ee30 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.733+0000 7f9a4586d640 1 --2- 172.21.15.121:0/2332350144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a4013ced0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a300097f0 tx=0x7f9a3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bc6478d7df5207 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.733+0000 7f9a4506c640 1 -- 172.21.15.121:0/2332350144 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a30037070 con 0x7f9a4009ee30 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.733+0000 7f9a4506c640 1 -- 172.21.15.121:0/2332350144 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a30032440 con 0x7f9a4009ee30 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.733+0000 7f9a4506c640 1 -- 172.21.15.121:0/2332350144 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3002ae60 con 0x7f9a4009ee30 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 -- 172.21.15.121:0/2332350144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 msgr2=0x7f9a4013ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 --2- 172.21.15.121:0/2332350144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a4013ced0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a300097f0 tx=0x7f9a3002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 -- 172.21.15.121:0/2332350144 shutdown_connections 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 --2- 172.21.15.121:0/2332350144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a4013ced0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 -- 172.21.15.121:0/2332350144 >> 172.21.15.121:0/2332350144 conn(0x7f9a400a85e0 msgr2=0x7f9a400a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 -- 172.21.15.121:0/2332350144 shutdown_connections 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.734+0000 7f9a482d2640 1 -- 172.21.15.121:0/2332350144 wait complete. 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a482d2640 1 Processor -- start 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a482d2640 1 -- start start 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a482d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a482d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9a400a1ed0 con 0x7f9a4009ee30 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a4606e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a4606e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55542/0 (socket says 172.21.15.121:55542) 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a4606e640 1 -- 172.21.15.121:0/1063262557 learned_addr learned my addr 172.21.15.121:0/1063262557 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.735+0000 7f9a4606e640 1 -- 172.21.15.121:0/1063262557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a401206e0 con 0x7f9a4009ee30 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a4606e640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800c710 tx=0x7f9a3800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a38017070 con 0x7f9a4009ee30 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38005da0 con 0x7f9a4009ee30 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a40120fc0 con 0x7f9a4009ee30 2024-09-15T23:55:15.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3800a790 con 0x7f9a4009ee30 2024-09-15T23:55:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.736+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401214c0 con 0x7f9a4009ee30 2024-09-15T23:55:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.737+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9a3801a070 con 0x7f9a4009ee30 2024-09-15T23:55:15.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.737+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a400008d0 con 0x7f9a4009ee30 2024-09-15T23:55:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.737+0000 7f9a36ffd640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 0x7f9a2403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.737+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f9a3804a7d0 con 0x7f9a4009ee30 2024-09-15T23:55:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.737+0000 7f9a4586d640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 0x7f9a2403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:15.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.738+0000 7f9a4586d640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 0x7f9a2403a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a30034000 tx=0x7f9a3002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:15.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.741+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a3800a930 con 0x7f9a4009ee30 2024-09-15T23:55:15.906 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.905+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a40135630 con 0x7f9a240382a0 2024-09-15T23:55:15.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.910+0000 7f9a36ffd640 1 -- 172.21.15.121:0/1063262557 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245901 (secure 0 0 0) 0x7f9a40135630 con 0x7f9a240382a0 2024-09-15T23:55:15.915 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:15.916 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:15.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 msgr2=0x7f9a2403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 0x7f9a2403a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a30034000 tx=0x7f9a3002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 msgr2=0x7f9a401c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800c710 tx=0x7f9a3800cbd0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 shutdown_connections 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f9a240382a0 0x7f9a2403a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 --2- 172.21.15.121:0/1063262557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a4009ee30 0x7f9a401c9760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 >> 172.21.15.121:0/1063262557 conn(0x7f9a400a85e0 msgr2=0x7f9a400a12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 shutdown_connections 2024-09-15T23:55:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:15.913+0000 7f9a482d2640 1 -- 172.21.15.121:0/1063262557 wait complete. 2024-09-15T23:55:15.925 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-15T23:55:14.023948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82680,"kb_used_data":1580,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032840,"statfs":{"total":289910292480,"available":289825628160,"internally_reserved":0,"allocated":1617920,"data_stored":1296816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701909+0000","last_change":"2024-09-15T23:55:12.689010+0000","last_active":"2024-09-15T23:55:12.701909+0000","last_peered":"2024-09-15T23:55:12.701909+0000","last_clean":"2024-09-15T23:55:12.701909+0000","last_became_active":"2024-09-15T23:55:12.688116+0000","last_became_peered":"2024-09-15T23:55:12.688116+0000","last_unstale":"2024-09-15T23:55:12.701909+0000","last_undegraded":"2024-09-15T23:55:12.701909+0000","last_fullsized":"2024-09-15T23:55:12.701909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:00.679597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703211+0000","last_change":"2024-09-15T23:55:12.691799+0000","last_active":"2024-09-15T23:55:12.703211+0000","last_peered":"2024-09-15T23:55:12.703211+0000","last_clean":"2024-09-15T23:55:12.703211+0000","last_became_active":"2024-09-15T23:55:12.691528+0000","last_became_peered":"2024-09-15T23:55:12.691528+0000","last_unstale":"2024-09-15T23:55:12.703211+0000","last_undegraded":"2024-09-15T23:55:12.703211+0000","last_fullsized":"2024-09-15T23:55:12.703211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:00.679597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702798+0000","last_change":"2024-09-15T23:55:12.698265+0000","last_active":"2024-09-15T23:55:12.702798+0000","last_peered":"2024-09-15T23:55:12.702798+0000","last_clean":"2024-09-15T23:55:12.702798+0000","last_became_active":"2024-09-15T23:55:12.696115+0000","last_became_peered":"2024-09-15T23:55:12.696115+0000","last_unstale":"2024-09-15T23:55:12.702798+0000","last_undegraded":"2024-09-15T23:55:12.702798+0000","last_fullsized":"2024-09-15T23:55:12.702798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:04.611155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711688+0000","last_change":"2024-09-15T23:55:12.708793+0000","last_active":"2024-09-15T23:55:12.711688+0000","last_peered":"2024-09-15T23:55:12.711688+0000","last_clean":"2024-09-15T23:55:12.711688+0000","last_became_active":"2024-09-15T23:55:12.708546+0000","last_became_peered":"2024-09-15T23:55:12.708546+0000","last_unstale":"2024-09-15T23:55:12.711688+0000","last_undegraded":"2024-09-15T23:55:12.711688+0000","last_fullsized":"2024-09-15T23:55:12.711688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:39.962113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702044+0000","last_change":"2024-09-15T23:55:12.689949+0000","last_active":"2024-09-15T23:55:12.702044+0000","last_peered":"2024-09-15T23:55:12.702044+0000","last_clean":"2024-09-15T23:55:12.702044+0000","last_became_active":"2024-09-15T23:55:12.689502+0000","last_became_peered":"2024-09-15T23:55:12.689502+0000","last_unstale":"2024-09-15T23:55:12.702044+0000","last_undegraded":"2024-09-15T23:55:12.702044+0000","last_fullsized":"2024-09-15T23:55:12.702044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:31.578782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712906+0000","last_change":"2024-09-15T23:55:12.710819+0000","last_active":"2024-09-15T23:55:12.712906+0000","last_peered":"2024-09-15T23:55:12.712906+0000","last_clean":"2024-09-15T23:55:12.712906+0000","last_became_active":"2024-09-15T23:55:12.709647+0000","last_became_peered":"2024-09-15T23:55:12.709647+0000","last_unstale":"2024-09-15T23:55:12.712906+0000","last_undegraded":"2024-09-15T23:55:12.712906+0000","last_fullsized":"2024-09-15T23:55:12.712906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:53.568775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.695735+0000","last_change":"2024-09-15T23:55:12.683855+0000","last_active":"2024-09-15T23:55:12.695735+0000","last_peered":"2024-09-15T23:55:12.695735+0000","last_clean":"2024-09-15T23:55:12.695735+0000","last_became_active":"2024-09-15T23:55:12.683568+0000","last_became_peered":"2024-09-15T23:55:12.683568+0000","last_unstale":"2024-09-15T23:55:12.695735+0000","last_undegraded":"2024-09-15T23:55:12.695735+0000","last_fullsized":"2024-09-15T23:55:12.695735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:25.718760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.713418+0000","last_change":"2024-09-15T23:55:12.712357+0000","last_active":"2024-09-15T23:55:12.713418+0000","last_peered":"2024-09-15T23:55:12.713418+0000","last_clean":"2024-09-15T23:55:12.713418+0000","last_became_active":"2024-09-15T23:55:12.711161+0000","last_became_peered":"2024-09-15T23:55:12.711161+0000","last_unstale":"2024-09-15T23:55:12.713418+0000","last_undegraded":"2024-09-15T23:55:12.713418+0000","last_fullsized":"2024-09-15T23:55:12.713418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:23.054111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703443+0000","last_change":"2024-09-15T23:55:12.698143+0000","last_active":"2024-09-15T23:55:12.703443+0000","last_peered":"2024-09-15T23:55:12.703443+0000","last_clean":"2024-09-15T23:55:12.703443+0000","last_became_active":"2024-09-15T23:55:12.697913+0000","last_became_peered":"2024-09-15T23:55:12.697913+0000","last_unstale":"2024-09-15T23:55:12.703443+0000","last_undegraded":"2024-09-15T23:55:12.703443+0000","last_fullsized":"2024-09-15T23:55:12.703443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:59.751892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702098+0000","last_change":"2024-09-15T23:55:12.691954+0000","last_active":"2024-09-15T23:55:12.702098+0000","last_peered":"2024-09-15T23:55:12.702098+0000","last_clean":"2024-09-15T23:55:12.702098+0000","last_became_active":"2024-09-15T23:55:12.691679+0000","last_became_peered":"2024-09-15T23:55:12.691679+0000","last_unstale":"2024-09-15T23:55:12.702098+0000","last_undegraded":"2024-09-15T23:55:12.702098+0000","last_fullsized":"2024-09-15T23:55:12.702098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:51.710730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702762+0000","last_change":"2024-09-15T23:55:12.697740+0000","last_active":"2024-09-15T23:55:12.702762+0000","last_peered":"2024-09-15T23:55:12.702762+0000","last_clean":"2024-09-15T23:55:12.702762+0000","last_became_active":"2024-09-15T23:55:12.695173+0000","last_became_peered":"2024-09-15T23:55:12.695173+0000","last_unstale":"2024-09-15T23:55:12.702762+0000","last_undegraded":"2024-09-15T23:55:12.702762+0000","last_fullsized":"2024-09-15T23:55:12.702762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:59.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699294+0000","last_change":"2024-09-15T23:55:12.688930+0000","last_active":"2024-09-15T23:55:12.699294+0000","last_peered":"2024-09-15T23:55:12.699294+0000","last_clean":"2024-09-15T23:55:12.699294+0000","last_became_active":"2024-09-15T23:55:12.688599+0000","last_became_peered":"2024-09-15T23:55:12.688599+0000","last_unstale":"2024-09-15T23:55:12.699294+0000","last_undegraded":"2024-09-15T23:55:12.699294+0000","last_fullsized":"2024-09-15T23:55:12.699294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:20.418069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703528+0000","last_change":"2024-09-15T23:55:12.699041+0000","last_active":"2024-09-15T23:55:12.703528+0000","last_peered":"2024-09-15T23:55:12.703528+0000","last_clean":"2024-09-15T23:55:12.703528+0000","last_became_active":"2024-09-15T23:55:12.698719+0000","last_became_peered":"2024-09-15T23:55:12.698719+0000","last_unstale":"2024-09-15T23:55:12.703528+0000","last_undegraded":"2024-09-15T23:55:12.703528+0000","last_fullsized":"2024-09-15T23:55:12.703528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:32.130285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703554+0000","last_change":"2024-09-15T23:55:12.699903+0000","last_active":"2024-09-15T23:55:12.703554+0000","last_peered":"2024-09-15T23:55:12.703554+0000","last_clean":"2024-09-15T23:55:12.703554+0000","last_became_active":"2024-09-15T23:55:12.699658+0000","last_became_peered":"2024-09-15T23:55:12.699658+0000","last_unstale":"2024-09-15T23:55:12.703554+0000","last_undegraded":"2024-09-15T23:55:12.703554+0000","last_fullsized":"2024-09-15T23:55:12.703554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:02.111895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703886+0000","last_change":"2024-09-15T23:55:12.697628+0000","last_active":"2024-09-15T23:55:12.703886+0000","last_peered":"2024-09-15T23:55:12.703886+0000","last_clean":"2024-09-15T23:55:12.703886+0000","last_became_active":"2024-09-15T23:55:12.697376+0000","last_became_peered":"2024-09-15T23:55:12.697376+0000","last_unstale":"2024-09-15T23:55:12.703886+0000","last_undegraded":"2024-09-15T23:55:12.703886+0000","last_fullsized":"2024-09-15T23:55:12.703886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:31.578782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714616+0000","last_change":"2024-09-15T23:55:12.712697+0000","last_active":"2024-09-15T23:55:12.714616+0000","last_peered":"2024-09-15T23:55:12.714616+0000","last_clean":"2024-09-15T23:55:12.714616+0000","last_became_active":"2024-09-15T23:55:12.712204+0000","last_became_peered":"2024-09-15T23:55:12.712204+0000","last_unstale":"2024-09-15T23:55:12.714616+0000","last_undegraded":"2024-09-15T23:55:12.714616+0000","last_fullsized":"2024-09-15T23:55:12.714616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:55.477901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703208+0000","last_change":"2024-09-15T23:55:12.691645+0000","last_active":"2024-09-15T23:55:12.703208+0000","last_peered":"2024-09-15T23:55:12.703208+0000","last_clean":"2024-09-15T23:55:12.703208+0000","last_became_active":"2024-09-15T23:55:12.691220+0000","last_became_peered":"2024-09-15T23:55:12.691220+0000","last_unstale":"2024-09-15T23:55:12.703208+0000","last_undegraded":"2024-09-15T23:55:12.703208+0000","last_fullsized":"2024-09-15T23:55:12.703208+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:20.418069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701308+0000","last_change":"2024-09-15T23:55:12.696986+0000","last_active":"2024-09-15T23:55:12.701308+0000","last_peered":"2024-09-15T23:55:12.701308+0000","last_clean":"2024-09-15T23:55:12.701308+0000","last_became_active":"2024-09-15T23:55:12.696708+0000","last_became_peered":"2024-09-15T23:55:12.696708+0000","last_unstale":"2024-09-15T23:55:12.701308+0000","last_undegraded":"2024-09-15T23:55:12.701308+0000","last_fullsized":"2024-09-15T23:55:12.701308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:27.840198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702781+0000","last_change":"2024-09-15T23:55:12.697966+0000","last_active":"2024-09-15T23:55:12.702781+0000","last_peered":"2024-09-15T23:55:12.702781+0000","last_clean":"2024-09-15T23:55:12.702781+0000","last_became_active":"2024-09-15T23:55:12.695494+0000","last_became_peered":"2024-09-15T23:55:12.695494+0000","last_unstale":"2024-09-15T23:55:12.702781+0000","last_undegraded":"2024-09-15T23:55:12.702781+0000","last_fullsized":"2024-09-15T23:55:12.702781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:28.197430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702526+0000","last_change":"2024-09-15T23:55:12.696664+0000","last_active":"2024-09-15T23:55:12.702526+0000","last_peered":"2024-09-15T23:55:12.702526+0000","last_clean":"2024-09-15T23:55:12.702526+0000","last_became_active":"2024-09-15T23:55:12.696407+0000","last_became_peered":"2024-09-15T23:55:12.696407+0000","last_unstale":"2024-09-15T23:55:12.702526+0000","last_undegraded":"2024-09-15T23:55:12.702526+0000","last_fullsized":"2024-09-15T23:55:12.702526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:10.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.696058+0000","last_change":"2024-09-15T23:55:12.686358+0000","last_active":"2024-09-15T23:55:12.696058+0000","last_peered":"2024-09-15T23:55:12.696058+0000","last_clean":"2024-09-15T23:55:12.696058+0000","last_became_active":"2024-09-15T23:55:12.685997+0000","last_became_peered":"2024-09-15T23:55:12.685997+0000","last_unstale":"2024-09-15T23:55:12.696058+0000","last_undegraded":"2024-09-15T23:55:12.696058+0000","last_fullsized":"2024-09-15T23:55:12.696058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:43.390563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705513+0000","last_change":"2024-09-15T23:55:12.700605+0000","last_active":"2024-09-15T23:55:12.705513+0000","last_peered":"2024-09-15T23:55:12.705513+0000","last_clean":"2024-09-15T23:55:12.705513+0000","last_became_active":"2024-09-15T23:55:12.700273+0000","last_became_peered":"2024-09-15T23:55:12.700273+0000","last_unstale":"2024-09-15T23:55:12.705513+0000","last_undegraded":"2024-09-15T23:55:12.705513+0000","last_fullsized":"2024-09-15T23:55:12.705513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:12.202368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.695855+0000","last_change":"2024-09-15T23:55:12.686146+0000","last_active":"2024-09-15T23:55:12.695855+0000","last_peered":"2024-09-15T23:55:12.695855+0000","last_clean":"2024-09-15T23:55:12.695855+0000","last_became_active":"2024-09-15T23:55:12.685705+0000","last_became_peered":"2024-09-15T23:55:12.685705+0000","last_unstale":"2024-09-15T23:55:12.695855+0000","last_undegraded":"2024-09-15T23:55:12.695855+0000","last_fullsized":"2024-09-15T23:55:12.695855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:49.770292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703630+0000","last_change":"2024-09-15T23:55:12.701281+0000","last_active":"2024-09-15T23:55:12.703630+0000","last_peered":"2024-09-15T23:55:12.703630+0000","last_clean":"2024-09-15T23:55:12.703630+0000","last_became_active":"2024-09-15T23:55:12.701047+0000","last_became_peered":"2024-09-15T23:55:12.701047+0000","last_unstale":"2024-09-15T23:55:12.703630+0000","last_undegraded":"2024-09-15T23:55:12.703630+0000","last_fullsized":"2024-09-15T23:55:12.703630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:09.860747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708361+0000","last_change":"2024-09-15T23:55:12.702183+0000","last_active":"2024-09-15T23:55:12.708361+0000","last_peered":"2024-09-15T23:55:12.708361+0000","last_clean":"2024-09-15T23:55:12.708361+0000","last_became_active":"2024-09-15T23:55:12.701921+0000","last_became_peered":"2024-09-15T23:55:12.701921+0000","last_unstale":"2024-09-15T23:55:12.708361+0000","last_undegraded":"2024-09-15T23:55:12.708361+0000","last_fullsized":"2024-09-15T23:55:12.708361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:28.462597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701327+0000","last_change":"2024-09-15T23:55:12.697158+0000","last_active":"2024-09-15T23:55:12.701327+0000","last_peered":"2024-09-15T23:55:12.701327+0000","last_clean":"2024-09-15T23:55:12.701327+0000","last_became_active":"2024-09-15T23:55:12.696919+0000","last_became_peered":"2024-09-15T23:55:12.696919+0000","last_unstale":"2024-09-15T23:55:12.701327+0000","last_undegraded":"2024-09-15T23:55:12.701327+0000","last_fullsized":"2024-09-15T23:55:12.701327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:27.567248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694981+0000","last_change":"2024-09-15T23:55:12.684313+0000","last_active":"2024-09-15T23:55:12.694981+0000","last_peered":"2024-09-15T23:55:12.694981+0000","last_clean":"2024-09-15T23:55:12.694981+0000","last_became_active":"2024-09-15T23:55:12.684051+0000","last_became_peered":"2024-09-15T23:55:12.684051+0000","last_unstale":"2024-09-15T23:55:12.694981+0000","last_undegraded":"2024-09-15T23:55:12.694981+0000","last_fullsized":"2024-09-15T23:55:12.694981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:25.718760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701709+0000","last_change":"2024-09-15T23:55:12.691786+0000","last_active":"2024-09-15T23:55:12.701709+0000","last_peered":"2024-09-15T23:55:12.701709+0000","last_clean":"2024-09-15T23:55:12.701709+0000","last_became_active":"2024-09-15T23:55:12.691014+0000","last_became_peered":"2024-09-15T23:55:12.691014+0000","last_unstale":"2024-09-15T23:55:12.701709+0000","last_undegraded":"2024-09-15T23:55:12.701709+0000","last_fullsized":"2024-09-15T23:55:12.701709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:59.751892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702078+0000","last_change":"2024-09-15T23:55:12.692693+0000","last_active":"2024-09-15T23:55:12.702078+0000","last_peered":"2024-09-15T23:55:12.702078+0000","last_clean":"2024-09-15T23:55:12.702078+0000","last_became_active":"2024-09-15T23:55:12.692388+0000","last_became_peered":"2024-09-15T23:55:12.692388+0000","last_unstale":"2024-09-15T23:55:12.702078+0000","last_undegraded":"2024-09-15T23:55:12.702078+0000","last_fullsized":"2024-09-15T23:55:12.702078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:22.807301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702503+0000","last_change":"2024-09-15T23:55:12.694633+0000","last_active":"2024-09-15T23:55:12.702503+0000","last_peered":"2024-09-15T23:55:12.702503+0000","last_clean":"2024-09-15T23:55:12.702503+0000","last_became_active":"2024-09-15T23:55:12.694187+0000","last_became_peered":"2024-09-15T23:55:12.694187+0000","last_unstale":"2024-09-15T23:55:12.702503+0000","last_undegraded":"2024-09-15T23:55:12.702503+0000","last_fullsized":"2024-09-15T23:55:12.702503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:56.223906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708178+0000","last_change":"2024-09-15T23:55:12.702217+0000","last_active":"2024-09-15T23:55:12.708178+0000","last_peered":"2024-09-15T23:55:12.708178+0000","last_clean":"2024-09-15T23:55:12.708178+0000","last_became_active":"2024-09-15T23:55:12.701635+0000","last_became_peered":"2024-09-15T23:55:12.701635+0000","last_unstale":"2024-09-15T23:55:12.708178+0000","last_undegraded":"2024-09-15T23:55:12.708178+0000","last_fullsized":"2024-09-15T23:55:12.708178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:18.894516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714591+0000","last_change":"2024-09-15T23:55:12.712448+0000","last_active":"2024-09-15T23:55:12.714591+0000","last_peered":"2024-09-15T23:55:12.714591+0000","last_clean":"2024-09-15T23:55:12.714591+0000","last_became_active":"2024-09-15T23:55:12.711476+0000","last_became_peered":"2024-09-15T23:55:12.711476+0000","last_unstale":"2024-09-15T23:55:12.714591+0000","last_undegraded":"2024-09-15T23:55:12.714591+0000","last_fullsized":"2024-09-15T23:55:12.714591+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:23.553630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703287+0000","last_change":"2024-09-15T23:55:12.694322+0000","last_active":"2024-09-15T23:55:12.703287+0000","last_peered":"2024-09-15T23:55:12.703287+0000","last_clean":"2024-09-15T23:55:12.703287+0000","last_became_active":"2024-09-15T23:55:12.694058+0000","last_became_peered":"2024-09-15T23:55:12.694058+0000","last_unstale":"2024-09-15T23:55:12.703287+0000","last_undegraded":"2024-09-15T23:55:12.703287+0000","last_fullsized":"2024-09-15T23:55:12.703287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:49.381845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705603+0000","last_change":"2024-09-15T23:55:11.689438+0000","last_active":"2024-09-15T23:55:12.705603+0000","last_peered":"2024-09-15T23:55:12.705603+0000","last_clean":"2024-09-15T23:55:12.705603+0000","last_became_active":"2024-09-15T23:55:11.688715+0000","last_became_peered":"2024-09-15T23:55:11.688715+0000","last_unstale":"2024-09-15T23:55:12.705603+0000","last_undegraded":"2024-09-15T23:55:12.705603+0000","last_fullsized":"2024-09-15T23:55:12.705603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.696037+0000","last_change":"2024-09-15T23:55:12.685542+0000","last_active":"2024-09-15T23:55:12.696037+0000","last_peered":"2024-09-15T23:55:12.696037+0000","last_clean":"2024-09-15T23:55:12.696037+0000","last_became_active":"2024-09-15T23:55:12.685271+0000","last_became_peered":"2024-09-15T23:55:12.685271+0000","last_unstale":"2024-09-15T23:55:12.696037+0000","last_undegraded":"2024-09-15T23:55:12.696037+0000","last_fullsized":"2024-09-15T23:55:12.696037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:47.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712834+0000","last_change":"2024-09-15T23:55:11.690527+0000","last_active":"2024-09-15T23:55:12.712834+0000","last_peered":"2024-09-15T23:55:12.712834+0000","last_clean":"2024-09-15T23:55:12.712834+0000","last_became_active":"2024-09-15T23:55:11.690256+0000","last_became_peered":"2024-09-15T23:55:11.690256+0000","last_unstale":"2024-09-15T23:55:12.712834+0000","last_undegraded":"2024-09-15T23:55:12.712834+0000","last_fullsized":"2024-09-15T23:55:12.712834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.749058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.671199+0000","last_change":"2024-09-15T23:55:11.687201+0000","last_active":"2024-09-15T23:55:12.671199+0000","last_peered":"2024-09-15T23:55:12.671199+0000","last_clean":"2024-09-15T23:55:12.671199+0000","last_became_active":"2024-09-15T23:55:11.687041+0000","last_became_peered":"2024-09-15T23:55:11.687041+0000","last_unstale":"2024-09-15T23:55:12.671199+0000","last_undegraded":"2024-09-15T23:55:12.671199+0000","last_fullsized":"2024-09-15T23:55:12.671199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714606+0000","last_change":"2024-09-15T23:55:12.712572+0000","last_active":"2024-09-15T23:55:12.714606+0000","last_peered":"2024-09-15T23:55:12.714606+0000","last_clean":"2024-09-15T23:55:12.714606+0000","last_became_active":"2024-09-15T23:55:12.711835+0000","last_became_peered":"2024-09-15T23:55:12.711835+0000","last_unstale":"2024-09-15T23:55:12.714606+0000","last_undegraded":"2024-09-15T23:55:12.714606+0000","last_fullsized":"2024-09-15T23:55:12.714606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:15.940580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.670402+0000","last_change":"2024-09-15T23:55:11.695048+0000","last_active":"2024-09-15T23:55:12.670402+0000","last_peered":"2024-09-15T23:55:12.670402+0000","last_clean":"2024-09-15T23:55:12.670402+0000","last_became_active":"2024-09-15T23:55:11.694766+0000","last_became_peered":"2024-09-15T23:55:11.694766+0000","last_unstale":"2024-09-15T23:55:12.670402+0000","last_undegraded":"2024-09-15T23:55:12.670402+0000","last_fullsized":"2024-09-15T23:55:12.670402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694886+0000","last_change":"2024-09-15T23:55:12.685430+0000","last_active":"2024-09-15T23:55:12.694886+0000","last_peered":"2024-09-15T23:55:12.694886+0000","last_clean":"2024-09-15T23:55:12.694886+0000","last_became_active":"2024-09-15T23:55:12.685161+0000","last_became_peered":"2024-09-15T23:55:12.685161+0000","last_unstale":"2024-09-15T23:55:12.694886+0000","last_undegraded":"2024-09-15T23:55:12.694886+0000","last_fullsized":"2024-09-15T23:55:12.694886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:49.770292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.676916+0000","last_change":"2024-09-15T23:55:11.680383+0000","last_active":"2024-09-15T23:55:12.676916+0000","last_peered":"2024-09-15T23:55:12.676916+0000","last_clean":"2024-09-15T23:55:12.676916+0000","last_became_active":"2024-09-15T23:55:11.680116+0000","last_became_peered":"2024-09-15T23:55:11.680116+0000","last_unstale":"2024-09-15T23:55:12.676916+0000","last_undegraded":"2024-09-15T23:55:12.676916+0000","last_fullsized":"2024-09-15T23:55:12.676916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701269+0000","last_change":"2024-09-15T23:55:12.695948+0000","last_active":"2024-09-15T23:55:12.701269+0000","last_peered":"2024-09-15T23:55:12.701269+0000","last_clean":"2024-09-15T23:55:12.701269+0000","last_became_active":"2024-09-15T23:55:12.695680+0000","last_became_peered":"2024-09-15T23:55:12.695680+0000","last_unstale":"2024-09-15T23:55:12.701269+0000","last_undegraded":"2024-09-15T23:55:12.701269+0000","last_fullsized":"2024-09-15T23:55:12.701269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:18.423134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.673194+0000","last_change":"2024-09-15T23:55:11.684947+0000","last_active":"2024-09-15T23:55:12.673194+0000","last_peered":"2024-09-15T23:55:12.673194+0000","last_clean":"2024-09-15T23:55:12.673194+0000","last_became_active":"2024-09-15T23:55:11.684524+0000","last_became_peered":"2024-09-15T23:55:11.684524+0000","last_unstale":"2024-09-15T23:55:12.673194+0000","last_undegraded":"2024-09-15T23:55:12.673194+0000","last_fullsized":"2024-09-15T23:55:12.673194+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702012+0000","last_change":"2024-09-15T23:55:12.692510+0000","last_active":"2024-09-15T23:55:12.702012+0000","last_peered":"2024-09-15T23:55:12.702012+0000","last_clean":"2024-09-15T23:55:12.702012+0000","last_became_active":"2024-09-15T23:55:12.692271+0000","last_became_peered":"2024-09-15T23:55:12.692271+0000","last_unstale":"2024-09-15T23:55:12.702012+0000","last_undegraded":"2024-09-15T23:55:12.702012+0000","last_fullsized":"2024-09-15T23:55:12.702012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:41.676029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.706392+0000","last_change":"2024-09-15T23:55:11.689697+0000","last_active":"2024-09-15T23:55:12.706392+0000","last_peered":"2024-09-15T23:55:12.706392+0000","last_clean":"2024-09-15T23:55:12.706392+0000","last_became_active":"2024-09-15T23:55:11.689121+0000","last_became_peered":"2024-09-15T23:55:11.689121+0000","last_unstale":"2024-09-15T23:55:12.706392+0000","last_undegraded":"2024-09-15T23:55:12.706392+0000","last_fullsized":"2024-09-15T23:55:12.706392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703039+0000","last_change":"2024-09-15T23:55:12.690608+0000","last_active":"2024-09-15T23:55:12.703039+0000","last_peered":"2024-09-15T23:55:12.703039+0000","last_clean":"2024-09-15T23:55:12.703039+0000","last_became_active":"2024-09-15T23:55:12.690352+0000","last_became_peered":"2024-09-15T23:55:12.690352+0000","last_unstale":"2024-09-15T23:55:12.703039+0000","last_undegraded":"2024-09-15T23:55:12.703039+0000","last_fullsized":"2024-09-15T23:55:12.703039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:43.390563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.714048+0000","last_change":"2024-09-15T23:55:11.685728+0000","last_active":"2024-09-15T23:55:12.714048+0000","last_peered":"2024-09-15T23:55:12.714048+0000","last_clean":"2024-09-15T23:55:12.714048+0000","last_became_active":"2024-09-15T23:55:11.685469+0000","last_became_peered":"2024-09-15T23:55:11.685469+0000","last_unstale":"2024-09-15T23:55:12.714048+0000","last_undegraded":"2024-09-15T23:55:12.714048+0000","last_fullsized":"2024-09-15T23:55:12.714048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:25.521672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702741+0000","last_change":"2024-09-15T23:55:12.697521+0000","last_active":"2024-09-15T23:55:12.702741+0000","last_peered":"2024-09-15T23:55:12.702741+0000","last_clean":"2024-09-15T23:55:12.702741+0000","last_became_active":"2024-09-15T23:55:12.694852+0000","last_became_peered":"2024-09-15T23:55:12.694852+0000","last_unstale":"2024-09-15T23:55:12.702741+0000","last_undegraded":"2024-09-15T23:55:12.702741+0000","last_fullsized":"2024-09-15T23:55:12.702741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:09.986785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.713312+0000","last_change":"2024-09-15T23:55:11.687469+0000","last_active":"2024-09-15T23:55:12.713312+0000","last_peered":"2024-09-15T23:55:12.713312+0000","last_clean":"2024-09-15T23:55:12.713312+0000","last_became_active":"2024-09-15T23:55:11.687140+0000","last_became_peered":"2024-09-15T23:55:11.687140+0000","last_unstale":"2024-09-15T23:55:12.713312+0000","last_undegraded":"2024-09-15T23:55:12.713312+0000","last_fullsized":"2024-09-15T23:55:12.713312+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702486+0000","last_change":"2024-09-15T23:55:12.694577+0000","last_active":"2024-09-15T23:55:12.702486+0000","last_peered":"2024-09-15T23:55:12.702486+0000","last_clean":"2024-09-15T23:55:12.702486+0000","last_became_active":"2024-09-15T23:55:12.693352+0000","last_became_peered":"2024-09-15T23:55:12.693352+0000","last_unstale":"2024-09-15T23:55:12.702486+0000","last_undegraded":"2024-09-15T23:55:12.702486+0000","last_fullsized":"2024-09-15T23:55:12.702486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.347154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.688631+0000","last_change":"2024-09-15T23:55:11.686342+0000","last_active":"2024-09-15T23:55:12.688631+0000","last_peered":"2024-09-15T23:55:12.688631+0000","last_clean":"2024-09-15T23:55:12.688631+0000","last_became_active":"2024-09-15T23:55:11.686052+0000","last_became_peered":"2024-09-15T23:55:11.686052+0000","last_unstale":"2024-09-15T23:55:12.688631+0000","last_undegraded":"2024-09-15T23:55:12.688631+0000","last_fullsized":"2024-09-15T23:55:12.688631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:50.303621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.704079+0000","last_change":"2024-09-15T23:55:12.699612+0000","last_active":"2024-09-15T23:55:12.704079+0000","last_peered":"2024-09-15T23:55:12.704079+0000","last_clean":"2024-09-15T23:55:12.704079+0000","last_became_active":"2024-09-15T23:55:12.699166+0000","last_became_peered":"2024-09-15T23:55:12.699166+0000","last_unstale":"2024-09-15T23:55:12.704079+0000","last_undegraded":"2024-09-15T23:55:12.704079+0000","last_fullsized":"2024-09-15T23:55:12.704079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:41.676029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.671930+0000","last_change":"2024-09-15T23:55:11.685669+0000","last_active":"2024-09-15T23:55:12.671930+0000","last_peered":"2024-09-15T23:55:12.671930+0000","last_clean":"2024-09-15T23:55:12.671930+0000","last_became_active":"2024-09-15T23:55:11.685404+0000","last_became_peered":"2024-09-15T23:55:11.685404+0000","last_unstale":"2024-09-15T23:55:12.671930+0000","last_undegraded":"2024-09-15T23:55:12.671930+0000","last_fullsized":"2024-09-15T23:55:12.671930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708927+0000","last_change":"2024-09-15T23:55:12.706980+0000","last_active":"2024-09-15T23:55:12.708927+0000","last_peered":"2024-09-15T23:55:12.708927+0000","last_clean":"2024-09-15T23:55:12.708927+0000","last_became_active":"2024-09-15T23:55:12.706336+0000","last_became_peered":"2024-09-15T23:55:12.706336+0000","last_unstale":"2024-09-15T23:55:12.708927+0000","last_undegraded":"2024-09-15T23:55:12.708927+0000","last_fullsized":"2024-09-15T23:55:12.708927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:28.158305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712201+0000","last_change":"2024-09-15T23:55:11.690815+0000","last_active":"2024-09-15T23:55:12.712201+0000","last_peered":"2024-09-15T23:55:12.712201+0000","last_clean":"2024-09-15T23:55:12.712201+0000","last_became_active":"2024-09-15T23:55:11.690538+0000","last_became_peered":"2024-09-15T23:55:11.690538+0000","last_unstale":"2024-09-15T23:55:12.712201+0000","last_undegraded":"2024-09-15T23:55:12.712201+0000","last_fullsized":"2024-09-15T23:55:12.712201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:34.734800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.710574+0000","last_change":"2024-09-15T23:55:12.705659+0000","last_active":"2024-09-15T23:55:12.710574+0000","last_peered":"2024-09-15T23:55:12.710574+0000","last_clean":"2024-09-15T23:55:12.710574+0000","last_became_active":"2024-09-15T23:55:12.705408+0000","last_became_peered":"2024-09-15T23:55:12.705408+0000","last_unstale":"2024-09-15T23:55:12.710574+0000","last_undegraded":"2024-09-15T23:55:12.710574+0000","last_fullsized":"2024-09-15T23:55:12.710574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:45.389165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711311+0000","last_change":"2024-09-15T23:55:11.685486+0000","last_active":"2024-09-15T23:55:12.711311+0000","last_peered":"2024-09-15T23:55:12.711311+0000","last_clean":"2024-09-15T23:55:12.711311+0000","last_became_active":"2024-09-15T23:55:11.685191+0000","last_became_peered":"2024-09-15T23:55:11.685191+0000","last_unstale":"2024-09-15T23:55:12.711311+0000","last_undegraded":"2024-09-15T23:55:12.711311+0000","last_fullsized":"2024-09-15T23:55:12.711311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711907+0000","last_change":"2024-09-15T23:55:12.710015+0000","last_active":"2024-09-15T23:55:12.711907+0000","last_peered":"2024-09-15T23:55:12.711907+0000","last_clean":"2024-09-15T23:55:12.711907+0000","last_became_active":"2024-09-15T23:55:12.709501+0000","last_became_peered":"2024-09-15T23:55:12.709501+0000","last_unstale":"2024-09-15T23:55:12.711907+0000","last_undegraded":"2024-09-15T23:55:12.711907+0000","last_fullsized":"2024-09-15T23:55:12.711907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:12.814359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712894+0000","last_change":"2024-09-15T23:55:11.690840+0000","last_active":"2024-09-15T23:55:12.712894+0000","last_peered":"2024-09-15T23:55:12.712894+0000","last_clean":"2024-09-15T23:55:12.712894+0000","last_became_active":"2024-09-15T23:55:11.690562+0000","last_became_peered":"2024-09-15T23:55:11.690562+0000","last_unstale":"2024-09-15T23:55:12.712894+0000","last_undegraded":"2024-09-15T23:55:12.712894+0000","last_fullsized":"2024-09-15T23:55:12.712894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:05.205328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702643+0000","last_change":"2024-09-15T23:55:12.697590+0000","last_active":"2024-09-15T23:55:12.702643+0000","last_peered":"2024-09-15T23:55:12.702643+0000","last_clean":"2024-09-15T23:55:12.702643+0000","last_became_active":"2024-09-15T23:55:12.697210+0000","last_became_peered":"2024-09-15T23:55:12.697210+0000","last_unstale":"2024-09-15T23:55:12.702643+0000","last_undegraded":"2024-09-15T23:55:12.702643+0000","last_fullsized":"2024-09-15T23:55:12.702643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:06.699466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703513+0000","last_change":"2024-09-15T23:55:11.680934+0000","last_active":"2024-09-15T23:55:12.703513+0000","last_peered":"2024-09-15T23:55:12.703513+0000","last_clean":"2024-09-15T23:55:12.703513+0000","last_became_active":"2024-09-15T23:55:11.679943+0000","last_became_peered":"2024-09-15T23:55:11.679943+0000","last_unstale":"2024-09-15T23:55:12.703513+0000","last_undegraded":"2024-09-15T23:55:12.703513+0000","last_fullsized":"2024-09-15T23:55:12.703513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702544+0000","last_change":"2024-09-15T23:55:12.697768+0000","last_active":"2024-09-15T23:55:12.702544+0000","last_peered":"2024-09-15T23:55:12.702544+0000","last_clean":"2024-09-15T23:55:12.702544+0000","last_became_active":"2024-09-15T23:55:12.696964+0000","last_became_peered":"2024-09-15T23:55:12.696964+0000","last_unstale":"2024-09-15T23:55:12.702544+0000","last_undegraded":"2024-09-15T23:55:12.702544+0000","last_fullsized":"2024-09-15T23:55:12.702544+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.687704+0000","last_change":"2024-09-15T23:55:11.689063+0000","last_active":"2024-09-15T23:55:12.687704+0000","last_peered":"2024-09-15T23:55:12.687704+0000","last_clean":"2024-09-15T23:55:12.687704+0000","last_became_active":"2024-09-15T23:55:11.688818+0000","last_became_peered":"2024-09-15T23:55:11.688818+0000","last_unstale":"2024-09-15T23:55:12.687704+0000","last_undegraded":"2024-09-15T23:55:12.687704+0000","last_fullsized":"2024-09-15T23:55:12.687704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:11.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703564+0000","last_change":"2024-09-15T23:55:12.694288+0000","last_active":"2024-09-15T23:55:12.703564+0000","last_peered":"2024-09-15T23:55:12.703564+0000","last_clean":"2024-09-15T23:55:12.703564+0000","last_became_active":"2024-09-15T23:55:12.693688+0000","last_became_peered":"2024-09-15T23:55:12.693688+0000","last_unstale":"2024-09-15T23:55:12.703564+0000","last_undegraded":"2024-09-15T23:55:12.703564+0000","last_fullsized":"2024-09-15T23:55:12.703564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:55.572607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":145,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677829+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:12.677829+0000","last_peered":"2024-09-15T23:55:12.677829+0000","last_clean":"2024-09-15T23:55:12.677829+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:12.677829+0000","last_undegraded":"2024-09-15T23:55:12.677829+0000","last_fullsized":"2024-09-15T23:55:12.677829+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.678342+0000","last_change":"2024-09-15T23:55:11.684064+0000","last_active":"2024-09-15T23:55:12.678342+0000","last_peered":"2024-09-15T23:55:12.678342+0000","last_clean":"2024-09-15T23:55:12.678342+0000","last_became_active":"2024-09-15T23:55:11.683537+0000","last_became_peered":"2024-09-15T23:55:11.683537+0000","last_unstale":"2024-09-15T23:55:12.678342+0000","last_undegraded":"2024-09-15T23:55:12.678342+0000","last_fullsized":"2024-09-15T23:55:12.678342+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.703030+0000","last_change":"2024-09-15T23:55:12.690740+0000","last_active":"2024-09-15T23:55:12.703030+0000","last_peered":"2024-09-15T23:55:12.703030+0000","last_clean":"2024-09-15T23:55:12.703030+0000","last_became_active":"2024-09-15T23:55:12.690500+0000","last_became_peered":"2024-09-15T23:55:12.690500+0000","last_unstale":"2024-09-15T23:55:12.703030+0000","last_undegraded":"2024-09-15T23:55:12.703030+0000","last_fullsized":"2024-09-15T23:55:12.703030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:27.460408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.690408+0000","last_change":"2024-09-15T23:55:11.691560+0000","last_active":"2024-09-15T23:55:12.690408+0000","last_peered":"2024-09-15T23:55:12.690408+0000","last_clean":"2024-09-15T23:55:12.690408+0000","last_became_active":"2024-09-15T23:55:11.691111+0000","last_became_peered":"2024-09-15T23:55:11.691111+0000","last_unstale":"2024-09-15T23:55:12.690408+0000","last_undegraded":"2024-09-15T23:55:12.690408+0000","last_fullsized":"2024-09-15T23:55:12.690408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:40.745603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701837+0000","last_change":"2024-09-15T23:55:12.692568+0000","last_active":"2024-09-15T23:55:12.701837+0000","last_peered":"2024-09-15T23:55:12.701837+0000","last_clean":"2024-09-15T23:55:12.701837+0000","last_became_active":"2024-09-15T23:55:12.692021+0000","last_became_peered":"2024-09-15T23:55:12.692021+0000","last_unstale":"2024-09-15T23:55:12.701837+0000","last_undegraded":"2024-09-15T23:55:12.701837+0000","last_fullsized":"2024-09-15T23:55:12.701837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:12.202368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.687220+0000","last_change":"2024-09-15T23:55:11.686567+0000","last_active":"2024-09-15T23:55:12.687220+0000","last_peered":"2024-09-15T23:55:12.687220+0000","last_clean":"2024-09-15T23:55:12.687220+0000","last_became_active":"2024-09-15T23:55:11.686326+0000","last_became_peered":"2024-09-15T23:55:11.686326+0000","last_unstale":"2024-09-15T23:55:12.687220+0000","last_undegraded":"2024-09-15T23:55:12.687220+0000","last_fullsized":"2024-09-15T23:55:12.687220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694889+0000","last_change":"2024-09-15T23:55:12.684331+0000","last_active":"2024-09-15T23:55:12.694889+0000","last_peered":"2024-09-15T23:55:12.694889+0000","last_clean":"2024-09-15T23:55:12.694889+0000","last_became_active":"2024-09-15T23:55:12.684077+0000","last_became_peered":"2024-09-15T23:55:12.684077+0000","last_unstale":"2024-09-15T23:55:12.694889+0000","last_undegraded":"2024-09-15T23:55:12.694889+0000","last_fullsized":"2024-09-15T23:55:12.694889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:47.319185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.675766+0000","last_change":"2024-09-15T23:55:11.681692+0000","last_active":"2024-09-15T23:55:12.675766+0000","last_peered":"2024-09-15T23:55:12.675766+0000","last_clean":"2024-09-15T23:55:12.675766+0000","last_became_active":"2024-09-15T23:55:11.681438+0000","last_became_peered":"2024-09-15T23:55:11.681438+0000","last_unstale":"2024-09-15T23:55:12.675766+0000","last_undegraded":"2024-09-15T23:55:12.675766+0000","last_fullsized":"2024-09-15T23:55:12.675766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699373+0000","last_change":"2024-09-15T23:55:12.689132+0000","last_active":"2024-09-15T23:55:12.699373+0000","last_peered":"2024-09-15T23:55:12.699373+0000","last_clean":"2024-09-15T23:55:12.699373+0000","last_became_active":"2024-09-15T23:55:12.688172+0000","last_became_peered":"2024-09-15T23:55:12.688172+0000","last_unstale":"2024-09-15T23:55:12.699373+0000","last_undegraded":"2024-09-15T23:55:12.699373+0000","last_fullsized":"2024-09-15T23:55:12.699373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:55.572607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677840+0000","last_change":"2024-09-15T23:55:11.690745+0000","last_active":"2024-09-15T23:55:12.677840+0000","last_peered":"2024-09-15T23:55:12.677840+0000","last_clean":"2024-09-15T23:55:12.677840+0000","last_became_active":"2024-09-15T23:55:11.690190+0000","last_became_peered":"2024-09-15T23:55:11.690190+0000","last_unstale":"2024-09-15T23:55:12.677840+0000","last_undegraded":"2024-09-15T23:55:12.677840+0000","last_fullsized":"2024-09-15T23:55:12.677840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708425+0000","last_change":"2024-09-15T23:55:12.702288+0000","last_active":"2024-09-15T23:55:12.708425+0000","last_peered":"2024-09-15T23:55:12.708425+0000","last_clean":"2024-09-15T23:55:12.708425+0000","last_became_active":"2024-09-15T23:55:12.701837+0000","last_became_peered":"2024-09-15T23:55:12.701837+0000","last_unstale":"2024-09-15T23:55:12.708425+0000","last_undegraded":"2024-09-15T23:55:12.708425+0000","last_fullsized":"2024-09-15T23:55:12.708425+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:38.496510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.675193+0000","last_change":"2024-09-15T23:55:11.689383+0000","last_active":"2024-09-15T23:55:12.675193+0000","last_peered":"2024-09-15T23:55:12.675193+0000","last_clean":"2024-09-15T23:55:12.675193+0000","last_became_active":"2024-09-15T23:55:11.688499+0000","last_became_peered":"2024-09-15T23:55:11.688499+0000","last_unstale":"2024-09-15T23:55:12.675193+0000","last_undegraded":"2024-09-15T23:55:12.675193+0000","last_fullsized":"2024-09-15T23:55:12.675193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.694623+0000","last_change":"2024-09-15T23:55:12.683877+0000","last_active":"2024-09-15T23:55:12.694623+0000","last_peered":"2024-09-15T23:55:12.694623+0000","last_clean":"2024-09-15T23:55:12.694623+0000","last_became_active":"2024-09-15T23:55:12.683590+0000","last_became_peered":"2024-09-15T23:55:12.683590+0000","last_unstale":"2024-09-15T23:55:12.694623+0000","last_undegraded":"2024-09-15T23:55:12.694623+0000","last_fullsized":"2024-09-15T23:55:12.694623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:08.820009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.674317+0000","last_change":"2024-09-15T23:55:11.691447+0000","last_active":"2024-09-15T23:55:12.674317+0000","last_peered":"2024-09-15T23:55:12.674317+0000","last_clean":"2024-09-15T23:55:12.674317+0000","last_became_active":"2024-09-15T23:55:11.691128+0000","last_became_peered":"2024-09-15T23:55:11.691128+0000","last_unstale":"2024-09-15T23:55:12.674317+0000","last_undegraded":"2024-09-15T23:55:12.674317+0000","last_fullsized":"2024-09-15T23:55:12.674317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711125+0000","last_change":"2024-09-15T23:55:12.704420+0000","last_active":"2024-09-15T23:55:12.711125+0000","last_peered":"2024-09-15T23:55:12.711125+0000","last_clean":"2024-09-15T23:55:12.711125+0000","last_became_active":"2024-09-15T23:55:12.704171+0000","last_became_peered":"2024-09-15T23:55:12.704171+0000","last_unstale":"2024-09-15T23:55:12.711125+0000","last_undegraded":"2024-09-15T23:55:12.711125+0000","last_fullsized":"2024-09-15T23:55:12.711125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:31.882456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.706812+0000","last_change":"2024-09-15T23:55:11.689361+0000","last_active":"2024-09-15T23:55:12.706812+0000","last_peered":"2024-09-15T23:55:12.706812+0000","last_clean":"2024-09-15T23:55:12.706812+0000","last_became_active":"2024-09-15T23:55:11.688414+0000","last_became_peered":"2024-09-15T23:55:11.688414+0000","last_unstale":"2024-09-15T23:55:12.706812+0000","last_undegraded":"2024-09-15T23:55:12.706812+0000","last_fullsized":"2024-09-15T23:55:12.706812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.699219+0000","last_change":"2024-09-15T23:55:12.688327+0000","last_active":"2024-09-15T23:55:12.699219+0000","last_peered":"2024-09-15T23:55:12.699219+0000","last_clean":"2024-09-15T23:55:12.699219+0000","last_became_active":"2024-09-15T23:55:12.688057+0000","last_became_peered":"2024-09-15T23:55:12.688057+0000","last_unstale":"2024-09-15T23:55:12.699219+0000","last_undegraded":"2024-09-15T23:55:12.699219+0000","last_fullsized":"2024-09-15T23:55:12.699219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:27.460408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.672243+0000","last_change":"2024-09-15T23:55:11.685621+0000","last_active":"2024-09-15T23:55:12.672243+0000","last_peered":"2024-09-15T23:55:12.672243+0000","last_clean":"2024-09-15T23:55:12.672243+0000","last_became_active":"2024-09-15T23:55:11.685362+0000","last_became_peered":"2024-09-15T23:55:11.685362+0000","last_unstale":"2024-09-15T23:55:12.672243+0000","last_undegraded":"2024-09-15T23:55:12.672243+0000","last_fullsized":"2024-09-15T23:55:12.672243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701859+0000","last_change":"2024-09-15T23:55:12.693033+0000","last_active":"2024-09-15T23:55:12.701859+0000","last_peered":"2024-09-15T23:55:12.701859+0000","last_clean":"2024-09-15T23:55:12.701859+0000","last_became_active":"2024-09-15T23:55:12.692321+0000","last_became_peered":"2024-09-15T23:55:12.692321+0000","last_unstale":"2024-09-15T23:55:12.701859+0000","last_undegraded":"2024-09-15T23:55:12.701859+0000","last_fullsized":"2024-09-15T23:55:12.701859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:28.158305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.677998+0000","last_change":"2024-09-15T23:55:11.689154+0000","last_active":"2024-09-15T23:55:12.677998+0000","last_peered":"2024-09-15T23:55:12.677998+0000","last_clean":"2024-09-15T23:55:12.677998+0000","last_became_active":"2024-09-15T23:55:11.688854+0000","last_became_peered":"2024-09-15T23:55:11.688854+0000","last_unstale":"2024-09-15T23:55:12.677998+0000","last_undegraded":"2024-09-15T23:55:12.677998+0000","last_fullsized":"2024-09-15T23:55:12.677998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712244+0000","last_change":"2024-09-15T23:55:12.705007+0000","last_active":"2024-09-15T23:55:12.712244+0000","last_peered":"2024-09-15T23:55:12.712244+0000","last_clean":"2024-09-15T23:55:12.712244+0000","last_became_active":"2024-09-15T23:55:12.704753+0000","last_became_peered":"2024-09-15T23:55:12.704753+0000","last_unstale":"2024-09-15T23:55:12.712244+0000","last_undegraded":"2024-09-15T23:55:12.712244+0000","last_fullsized":"2024-09-15T23:55:12.712244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:22.199481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.680910+0000","last_change":"2024-09-15T23:55:11.689771+0000","last_active":"2024-09-15T23:55:12.680910+0000","last_peered":"2024-09-15T23:55:12.680910+0000","last_clean":"2024-09-15T23:55:12.680910+0000","last_became_active":"2024-09-15T23:55:11.689083+0000","last_became_peered":"2024-09-15T23:55:11.689083+0000","last_unstale":"2024-09-15T23:55:12.680910+0000","last_undegraded":"2024-09-15T23:55:12.680910+0000","last_fullsized":"2024-09-15T23:55:12.680910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.704058+0000","last_change":"2024-09-15T23:55:12.699401+0000","last_active":"2024-09-15T23:55:12.704058+0000","last_peered":"2024-09-15T23:55:12.704058+0000","last_clean":"2024-09-15T23:55:12.704058+0000","last_became_active":"2024-09-15T23:55:12.698873+0000","last_became_peered":"2024-09-15T23:55:12.698873+0000","last_unstale":"2024-09-15T23:55:12.704058+0000","last_undegraded":"2024-09-15T23:55:12.704058+0000","last_fullsized":"2024-09-15T23:55:12.704058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:51.710730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712694+0000","last_change":"2024-09-15T23:55:11.683719+0000","last_active":"2024-09-15T23:55:12.712694+0000","last_peered":"2024-09-15T23:55:12.712694+0000","last_clean":"2024-09-15T23:55:12.712694+0000","last_became_active":"2024-09-15T23:55:11.682811+0000","last_became_peered":"2024-09-15T23:55:11.682811+0000","last_unstale":"2024-09-15T23:55:12.712694+0000","last_undegraded":"2024-09-15T23:55:12.712694+0000","last_fullsized":"2024-09-15T23:55:12.712694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.702465+0000","last_change":"2024-09-15T23:55:12.694426+0000","last_active":"2024-09-15T23:55:12.702465+0000","last_peered":"2024-09-15T23:55:12.702465+0000","last_clean":"2024-09-15T23:55:12.702465+0000","last_became_active":"2024-09-15T23:55:12.693056+0000","last_became_peered":"2024-09-15T23:55:12.693056+0000","last_unstale":"2024-09-15T23:55:12.702465+0000","last_undegraded":"2024-09-15T23:55:12.702465+0000","last_fullsized":"2024-09-15T23:55:12.702465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.831473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.708406+0000","last_change":"2024-09-15T23:55:12.702080+0000","last_active":"2024-09-15T23:55:12.708406+0000","last_peered":"2024-09-15T23:55:12.708406+0000","last_clean":"2024-09-15T23:55:12.708406+0000","last_became_active":"2024-09-15T23:55:12.701497+0000","last_became_peered":"2024-09-15T23:55:12.701497+0000","last_unstale":"2024-09-15T23:55:12.708406+0000","last_undegraded":"2024-09-15T23:55:12.708406+0000","last_fullsized":"2024-09-15T23:55:12.708406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:33.662496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.709697+0000","last_change":"2024-09-15T23:55:11.682360+0000","last_active":"2024-09-15T23:55:12.709697+0000","last_peered":"2024-09-15T23:55:12.709697+0000","last_clean":"2024-09-15T23:55:12.709697+0000","last_became_active":"2024-09-15T23:55:11.682073+0000","last_became_peered":"2024-09-15T23:55:11.682073+0000","last_unstale":"2024-09-15T23:55:12.709697+0000","last_undegraded":"2024-09-15T23:55:12.709697+0000","last_fullsized":"2024-09-15T23:55:12.709697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:07.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.705760+0000","last_change":"2024-09-15T23:55:12.700670+0000","last_active":"2024-09-15T23:55:12.705760+0000","last_peered":"2024-09-15T23:55:12.705760+0000","last_clean":"2024-09-15T23:55:12.705760+0000","last_became_active":"2024-09-15T23:55:12.699711+0000","last_became_peered":"2024-09-15T23:55:12.699711+0000","last_unstale":"2024-09-15T23:55:12.705760+0000","last_undegraded":"2024-09-15T23:55:12.705760+0000","last_fullsized":"2024-09-15T23:55:12.705760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:22.807301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.709826+0000","last_change":"2024-09-15T23:55:11.693722+0000","last_active":"2024-09-15T23:55:12.709826+0000","last_peered":"2024-09-15T23:55:12.709826+0000","last_clean":"2024-09-15T23:55:12.709826+0000","last_became_active":"2024-09-15T23:55:11.693487+0000","last_became_peered":"2024-09-15T23:55:11.693487+0000","last_unstale":"2024-09-15T23:55:12.709826+0000","last_undegraded":"2024-09-15T23:55:12.709826+0000","last_fullsized":"2024-09-15T23:55:12.709826+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701930+0000","last_change":"2024-09-15T23:55:12.689223+0000","last_active":"2024-09-15T23:55:12.701930+0000","last_peered":"2024-09-15T23:55:12.701930+0000","last_clean":"2024-09-15T23:55:12.701930+0000","last_became_active":"2024-09-15T23:55:12.688397+0000","last_became_peered":"2024-09-15T23:55:12.688397+0000","last_unstale":"2024-09-15T23:55:12.701930+0000","last_undegraded":"2024-09-15T23:55:12.701930+0000","last_fullsized":"2024-09-15T23:55:12.701930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:49.381845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.712504+0000","last_change":"2024-09-15T23:55:11.691511+0000","last_active":"2024-09-15T23:55:12.712504+0000","last_peered":"2024-09-15T23:55:12.712504+0000","last_clean":"2024-09-15T23:55:12.712504+0000","last_became_active":"2024-09-15T23:55:11.690348+0000","last_became_peered":"2024-09-15T23:55:11.690348+0000","last_unstale":"2024-09-15T23:55:12.712504+0000","last_undegraded":"2024-09-15T23:55:12.712504+0000","last_fullsized":"2024-09-15T23:55:12.712504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.969491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.701291+0000","last_change":"2024-09-15T23:55:12.696145+0000","last_active":"2024-09-15T23:55:12.701291+0000","last_peered":"2024-09-15T23:55:12.701291+0000","last_clean":"2024-09-15T23:55:12.701291+0000","last_became_active":"2024-09-15T23:55:12.695891+0000","last_became_peered":"2024-09-15T23:55:12.695891+0000","last_unstale":"2024-09-15T23:55:12.701291+0000","last_undegraded":"2024-09-15T23:55:12.701291+0000","last_fullsized":"2024-09-15T23:55:12.701291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:05.165335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-15T23:55:12.711402+0000","last_change":"2024-09-15T23:55:11.686294+0000","last_active":"2024-09-15T23:55:12.711402+0000","last_peered":"2024-09-15T23:55:12.711402+0000","last_clean":"2024-09-15T23:55:12.711402+0000","last_became_active":"2024-09-15T23:55:11.685978+0000","last_became_peered":"2024-09-15T23:55:11.685978+0000","last_unstale":"2024-09-15T23:55:12.711402+0000","last_undegraded":"2024-09-15T23:55:12.711402+0000","last_fullsized":"2024-09-15T23:55:12.711402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":761856,"data_stored":633622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":724992,"data_stored":626781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:15.928 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:55:15.929 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T23:55:15.929 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T23:55:15.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T23:55:15.929 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T23:55:16.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.062+0000 7f19a05d8640 1 Processor -- start 2024-09-15T23:55:16.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.062+0000 7f19a05d8640 1 -- start start 2024-09-15T23:55:16.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f19a05d8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f199813a280 0x7f199813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f19a05d8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199813a080 con 0x7f19980a4c20 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f19a05d8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f19980a3d50 con 0x7f199813a280 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199e374640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f199813a280 0x7f199813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199db73640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f19980a4c20 0x7f19980a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45424/0 (socket says 172.21.15.121:45424) 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199e374640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f199813a280 0x7f199813a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55558/0 (socket says 172.21.15.121:55558) 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199db73640 1 -- 172.21.15.121:0/3853718231 learned_addr learned my addr 172.21.15.121:0/3853718231 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199e374640 1 -- 172.21.15.121:0/3853718231 >> v1:172.21.15.121:6789/0 conn(0x7f19980a4c20 legacy=0x7f19980a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.063+0000 7f199e374640 1 -- 172.21.15.121:0/3853718231 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980a3f80 con 0x7f199813a280 2024-09-15T23:55:16.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.064+0000 7f199e374640 1 --2- 172.21.15.121:0/3853718231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f199813a280 0x7f199813a660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1994009720 tx=0x7f199402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fc4b2753665efb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.064+0000 7f199d372640 1 -- 172.21.15.121:0/3853718231 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994037070 con 0x7f199813a280 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.064+0000 7f199d372640 1 -- 172.21.15.121:0/3853718231 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199402ad90 con 0x7f199813a280 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.064+0000 7f199d372640 1 -- 172.21.15.121:0/3853718231 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994032590 con 0x7f199813a280 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 -- 172.21.15.121:0/3853718231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f199813a280 msgr2=0x7f199813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3853718231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f199813a280 0x7f199813a660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1994009720 tx=0x7f199402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 -- 172.21.15.121:0/3853718231 shutdown_connections 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3853718231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f199813a280 0x7f199813a660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 -- 172.21.15.121:0/3853718231 >> 172.21.15.121:0/3853718231 conn(0x7f19980ac3e0 msgr2=0x7f19980ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 -- 172.21.15.121:0/3853718231 shutdown_connections 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.065+0000 7f19a05d8640 1 -- 172.21.15.121:0/3853718231 wait complete. 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f19a05d8640 1 Processor -- start 2024-09-15T23:55:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f19a05d8640 1 -- start start 2024-09-15T23:55:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f19a05d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f19a05d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1998139d40 con 0x7f19980a4c20 2024-09-15T23:55:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f199e374640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f199e374640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55564/0 (socket says 172.21.15.121:55564) 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f199e374640 1 -- 172.21.15.121:0/3076579326 learned_addr learned my addr 172.21.15.121:0/3076579326 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.066+0000 7f199e374640 1 -- 172.21.15.121:0/3076579326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1998124ff0 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f199e374640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1994009840 tx=0x7f19940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994041020 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199403d550 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994037040 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1998125270 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.067+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1998138290 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1994044020 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199806dab0 con 0x7f19980a4c20 2024-09-15T23:55:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f198effd640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 0x7f197c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f199406b940 con 0x7f19980a4c20 2024-09-15T23:55:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f199db73640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 0x7f197c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.068+0000 7f199db73640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 0x7f197c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1988007fd0 tx=0x7f1988007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.072+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f199404b030 con 0x7f19980a4c20 2024-09-15T23:55:16.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.282+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f19980a2f50 con 0x7f19980a4c20 2024-09-15T23:55:16.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.284+0000 7f198effd640 1 -- 172.21.15.121:0/3076579326 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87488 (secure 0 0 0) 0x7f1998124ff0 con 0x7f19980a4c20 2024-09-15T23:55:16.287 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 msgr2=0x7f197c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 0x7f197c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1988007fd0 tx=0x7f1988007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 msgr2=0x7f19980a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1994009840 tx=0x7f19940046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 shutdown_connections 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f197c0382a0 0x7f197c03a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 --2- 172.21.15.121:0/3076579326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19980a4c20 0x7f19980a1150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 >> 172.21.15.121:0/3076579326 conn(0x7f19980ac3e0 msgr2=0x7f19980aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 shutdown_connections 2024-09-15T23:55:16.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.286+0000 7f19a05d8640 1 -- 172.21.15.121:0/3076579326 wait complete. 2024-09-15T23:55:16.298 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1047503300},{"type":"v1","addr":"172.21.15.121:6825","nonce":1047503300}]},"active_addr":"172.21.15.121:6825/1047503300","active_change":"2024-09-15T23:54:56.018197+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":370154040}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2264301746}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1333687230}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":822936298}]}]} 2024-09-15T23:55:16.300 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T23:55:16.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T23:55:16.300 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:16.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.397+0000 7f8f38711640 1 Processor -- start 2024-09-15T23:55:16.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.397+0000 7f8f38711640 1 -- start start 2024-09-15T23:55:16.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f38711640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8f3013a280 0x7f8f3013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f38711640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3013a080 con 0x7f8f300a4c20 2024-09-15T23:55:16.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f38711640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8f300a3d50 con 0x7f8f3013a280 2024-09-15T23:55:16.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f364ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8f3013a280 0x7f8f3013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f35cac640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8f300a4c20 0x7f8f300a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45430/0 (socket says 172.21.15.121:45430) 2024-09-15T23:55:16.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f35cac640 1 -- 172.21.15.121:0/1417908100 learned_addr learned my addr 172.21.15.121:0/1417908100 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:16.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f364ad640 1 -- 172.21.15.121:0/1417908100 >> v1:172.21.15.121:6789/0 conn(0x7f8f300a4c20 legacy=0x7f8f300a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.398+0000 7f8f364ad640 1 -- 172.21.15.121:0/1417908100 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f300a3f80 con 0x7f8f3013a280 2024-09-15T23:55:16.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.399+0000 7f8f364ad640 1 --2- 172.21.15.121:0/1417908100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3013a280 0x7f8f3013a660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009720 tx=0x7f8f2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630dfaf249760dcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.399+0000 7f8f354ab640 1 -- 172.21.15.121:0/1417908100 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c037070 con 0x7f8f3013a280 2024-09-15T23:55:16.401 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.399+0000 7f8f354ab640 1 -- 172.21.15.121:0/1417908100 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c02ad90 con 0x7f8f3013a280 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.399+0000 7f8f354ab640 1 -- 172.21.15.121:0/1417908100 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c032590 con 0x7f8f3013a280 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 -- 172.21.15.121:0/1417908100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3013a280 msgr2=0x7f8f3013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 --2- 172.21.15.121:0/1417908100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3013a280 0x7f8f3013a660 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009720 tx=0x7f8f2c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 -- 172.21.15.121:0/1417908100 shutdown_connections 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 --2- 172.21.15.121:0/1417908100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f3013a280 0x7f8f3013a660 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 -- 172.21.15.121:0/1417908100 >> 172.21.15.121:0/1417908100 conn(0x7f8f300ac3e0 msgr2=0x7f8f300ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 -- 172.21.15.121:0/1417908100 shutdown_connections 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.400+0000 7f8f38711640 1 -- 172.21.15.121:0/1417908100 wait complete. 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f38711640 1 Processor -- start 2024-09-15T23:55:16.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f38711640 1 -- start start 2024-09-15T23:55:16.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f38711640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f38711640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f30139d40 con 0x7f8f300a4c20 2024-09-15T23:55:16.404 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f364ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f364ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55586/0 (socket says 172.21.15.121:55586) 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f364ad640 1 -- 172.21.15.121:0/498724633 learned_addr learned my addr 172.21.15.121:0/498724633 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.401+0000 7f8f364ad640 1 -- 172.21.15.121:0/498724633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f30124ff0 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f364ad640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009840 tx=0x7f8f2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c041020 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2c03d550 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f30125270 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f2c037040 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.402+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f30138290 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f2c044020 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3006dab0 con 0x7f8f300a4c20 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f26ffd640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 0x7f8f1403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.405 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f8f2c06b8b0 con 0x7f8f300a4c20 2024-09-15T23:55:16.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f35cac640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 0x7f8f1403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.403+0000 7f8f35cac640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 0x7f8f1403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f20007fd0 tx=0x7f8f20007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.407+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f2c04b030 con 0x7f8f300a4c20 2024-09-15T23:55:16.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.573+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f300a2f50 con 0x7f8f300a4c20 2024-09-15T23:55:16.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.574+0000 7f8f26ffd640 1 -- 172.21.15.121:0/498724633 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f8f30124ff0 con 0x7f8f300a4c20 2024-09-15T23:55:16.575 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:16.575 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:16.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 msgr2=0x7f8f1403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 0x7f8f1403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f20007fd0 tx=0x7f8f20007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 msgr2=0x7f8f300a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009840 tx=0x7f8f2c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 shutdown_connections 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f8f140382a0 0x7f8f1403a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 --2- 172.21.15.121:0/498724633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f300a4c20 0x7f8f300a1150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 >> 172.21.15.121:0/498724633 conn(0x7f8f300ac3e0 msgr2=0x7f8f300aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.576+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 shutdown_connections 2024-09-15T23:55:16.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.577+0000 7f8f38711640 1 -- 172.21.15.121:0/498724633 wait complete. 2024-09-15T23:55:16.588 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T23:55:16.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:16.654 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-15T23:55:16.653+0000 7f2b0e76c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.686+0000 7ff1a6d31640 1 Processor -- start 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.686+0000 7ff1a6d31640 1 -- start start 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.686+0000 7ff1a6d31640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1a009ba80 0x7ff1a009be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.686+0000 7ff1a6d31640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a009ef60 con 0x7ff1a009c3a0 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.686+0000 7ff1a6d31640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a00a0060 con 0x7ff1a009ba80 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff1a4acd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1a009ba80 0x7ff1a009be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff19ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff1a009c3a0 0x7ff1a0137ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45438/0 (socket says 172.21.15.121:45438) 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff1a4acd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1a009ba80 0x7ff1a009be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55588/0 (socket says 172.21.15.121:55588) 2024-09-15T23:55:16.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff19ffff640 1 -- 172.21.15.121:0/2099936582 learned_addr learned my addr 172.21.15.121:0/2099936582 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff1a4acd640 1 -- 172.21.15.121:0/2099936582 >> v1:172.21.15.121:6789/0 conn(0x7ff1a009c3a0 legacy=0x7ff1a0137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff1a4acd640 1 -- 172.21.15.121:0/2099936582 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a009e6e0 con 0x7ff1a009ba80 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.687+0000 7ff19f7fe640 1 -- 172.21.15.121:0/2099936582 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727297520 0 0) 0x7ff1a009ef60 con 0x7ff1a009c3a0 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a4acd640 1 --2- 172.21.15.121:0/2099936582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a009be60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff194009720 tx=0x7ff19402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a2a6a9e650e9da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff19f7fe640 1 -- 172.21.15.121:0/2099936582 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194037070 con 0x7ff1a009ba80 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff19f7fe640 1 -- 172.21.15.121:0/2099936582 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19402ad90 con 0x7ff1a009ba80 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff19f7fe640 1 -- 172.21.15.121:0/2099936582 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194032590 con 0x7ff1a009ba80 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 -- 172.21.15.121:0/2099936582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 msgr2=0x7ff1a009be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/2099936582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a009be60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff194009720 tx=0x7ff19402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 -- 172.21.15.121:0/2099936582 shutdown_connections 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/2099936582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a009be60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 -- 172.21.15.121:0/2099936582 >> 172.21.15.121:0/2099936582 conn(0x7ff1a0070cc0 msgr2=0x7ff1a00730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 -- 172.21.15.121:0/2099936582 shutdown_connections 2024-09-15T23:55:16.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.688+0000 7ff1a6d31640 1 -- 172.21.15.121:0/2099936582 wait complete. 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.689+0000 7ff1a6d31640 1 Processor -- start 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.689+0000 7ff1a6d31640 1 -- start start 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a6d31640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a6d31640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a00aa7f0 con 0x7ff1a009ba80 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a4acd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a4acd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55594/0 (socket says 172.21.15.121:55594) 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a4acd640 1 -- 172.21.15.121:0/113327665 learned_addr learned my addr 172.21.15.121:0/113327665 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a4acd640 1 -- 172.21.15.121:0/113327665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a00a7740 con 0x7ff1a009ba80 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a4acd640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff194035040 tx=0x7ff1940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194037040 con 0x7ff1a009ba80 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff194004030 con 0x7ff1a009ba80 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a0121110 con 0x7ff1a009ba80 2024-09-15T23:55:16.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194004310 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.690+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a0137a40 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.691+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff19403a040 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.692+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a00a8e90 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.692+0000 7ff19d7fa640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 0x7ff18403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.692+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7ff19406bbf0 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.692+0000 7ff19ffff640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 0x7ff18403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.692+0000 7ff19ffff640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 0x7ff18403a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.696+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff194042020 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.864+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1a009dfb0 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.865+0000 7ff19d7fa640 1 -- 172.21.15.121:0/113327665 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7ff19403ee20 con 0x7ff1a009ba80 2024-09-15T23:55:16.869 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:16.870 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:16.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 msgr2=0x7ff18403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 0x7ff18403a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff18c000c00 tx=0x7ff18c007970 comp rx=0 tx=0).stop 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 msgr2=0x7ff1a00a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff194035040 tx=0x7ff1940046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 shutdown_connections 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff1840382a0 0x7ff18403a760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 --2- 172.21.15.121:0/113327665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1a009ba80 0x7ff1a00a7d00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 >> 172.21.15.121:0/113327665 conn(0x7ff1a0070cc0 msgr2=0x7ff1a0138230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 shutdown_connections 2024-09-15T23:55:16.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.867+0000 7ff1a6d31640 1 -- 172.21.15.121:0/113327665 wait complete. 2024-09-15T23:55:16.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T23:55:16.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T23:55:16.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T23:55:16.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7f85ef966640 1 Processor -- start 2024-09-15T23:55:16.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7fdbc2453640 1 Processor -- start 2024-09-15T23:55:16.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7fdbc2453640 1 -- start start 2024-09-15T23:55:16.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7f85ef966640 1 -- start start 2024-09-15T23:55:16.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7f585ea23640 1 Processor -- start 2024-09-15T23:55:16.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.986+0000 7f585ea23640 1 -- start start 2024-09-15T23:55:16.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbc2453640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdbbc0a39c0 0x7fdbbc132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbc2453640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbbc0a16c0 con 0x7fdbbc133470 2024-09-15T23:55:16.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbc2453640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdbbc0a1490 con 0x7fdbbc0a39c0 2024-09-15T23:55:16.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ef966640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85e8070070 0x7f85e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ef966640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85e80725e0 con 0x7f85e8070990 2024-09-15T23:55:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ef966640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f85e80714c0 con 0x7f85e8070070 2024-09-15T23:55:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f585ea23640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5858131420 0x7f5858131800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f585ea23640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585809ff40 con 0x7f5858070070 2024-09-15T23:55:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f585ea23640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f5858073b30 con 0x7f5858131420 2024-09-15T23:55:16.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ed702640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85e8070070 0x7f85e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ecf01640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f85e8070990 0x7f85e813e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45446/0 (socket says 172.21.15.121:45446) 2024-09-15T23:55:16.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbbbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdbbc0a39c0 0x7fdbbc132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbbbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdbbc0a39c0 0x7fdbbc132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55600/0 (socket says 172.21.15.121:55600) 2024-09-15T23:55:16.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbbbfff640 1 -- 172.21.15.121:0/3148113376 learned_addr learned my addr 172.21.15.121:0/3148113376 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ecf01640 1 -- 172.21.15.121:0/259182112 learned_addr learned my addr 172.21.15.121:0/259182112 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f58577fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5858070070 0x7f58580704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45456/0 (socket says 172.21.15.121:45456) 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f58577fe640 1 -- 172.21.15.121:0/3228252764 learned_addr learned my addr 172.21.15.121:0/3228252764 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f5857fff640 1 --2- 172.21.15.121:0/3228252764 >> v2:172.21.15.121:3300/0 conn(0x7f5858131420 0x7f5858131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f5857fff640 1 -- 172.21.15.121:0/3228252764 >> v1:172.21.15.121:6789/0 conn(0x7f5858070070 legacy=0x7f58580704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f5857fff640 1 -- 172.21.15.121:0/3228252764 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58580a0be0 con 0x7f5858131420 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ed702640 1 -- 172.21.15.121:0/259182112 >> v1:172.21.15.121:6789/0 conn(0x7f85e8070990 legacy=0x7f85e813e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7f85ed702640 1 -- 172.21.15.121:0/259182112 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e80716f0 con 0x7f85e8070070 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.987+0000 7fdbbb7fe640 1 -- 172.21.15.121:0/3148113376 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387058421 0 0) 0x7fdbbc0a16c0 con 0x7fdbbc133470 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7fdbbb7fe640 1 -- 172.21.15.121:0/3148113376 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba8004630 con 0x7fdbbc133470 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7fdbbbfff640 1 -- 172.21.15.121:0/3148113376 >> v1:172.21.15.121:6789/0 conn(0x7fdbbc133470 legacy=0x7fdbbc135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7fdbbbfff640 1 -- 172.21.15.121:0/3148113376 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc0a4010 con 0x7fdbbc0a39c0 2024-09-15T23:55:16.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f85ed702640 1 --2- 172.21.15.121:0/259182112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e8070450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009720 tx=0x7f85e402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd2e23a94ba04a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f5857fff640 1 --2- 172.21.15.121:0/3228252764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858131420 0x7f5858131800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5848009720 tx=0x7f584802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7a2a6e750a410f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f85dffff640 1 -- 172.21.15.121:0/259182112 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4037070 con 0x7f85e8070070 2024-09-15T23:55:16.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f5856ffd640 1 -- 172.21.15.121:0/3228252764 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848037070 con 0x7f5858131420 2024-09-15T23:55:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f5856ffd640 1 -- 172.21.15.121:0/3228252764 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f584802ad90 con 0x7f5858131420 2024-09-15T23:55:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.988+0000 7f5856ffd640 1 -- 172.21.15.121:0/3228252764 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848032590 con 0x7f5858131420 2024-09-15T23:55:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85dffff640 1 -- 172.21.15.121:0/259182112 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e402ad10 con 0x7f85e8070070 2024-09-15T23:55:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85dffff640 1 -- 172.21.15.121:0/259182112 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4032440 con 0x7f85e8070070 2024-09-15T23:55:16.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7fdbbbfff640 1 --2- 172.21.15.121:0/3148113376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc132f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0097f0 tx=0x7fdbac02c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c9bbbf0565bc89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7fdbbb7fe640 1 -- 172.21.15.121:0/3148113376 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac038070 con 0x7fdbbc0a39c0 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7fdbbb7fe640 1 -- 172.21.15.121:0/3148113376 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac031640 con 0x7fdbbc0a39c0 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7fdbbb7fe640 1 -- 172.21.15.121:0/3148113376 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac031940 con 0x7fdbbc0a39c0 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 -- 172.21.15.121:0/3228252764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858131420 msgr2=0x7f5858131800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 --2- 172.21.15.121:0/3228252764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858131420 0x7f5858131800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5848009720 tx=0x7f584802a110 comp rx=0 tx=0).stop 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 -- 172.21.15.121:0/3228252764 shutdown_connections 2024-09-15T23:55:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 --2- 172.21.15.121:0/3228252764 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858131420 0x7f5858131800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 -- 172.21.15.121:0/3228252764 >> 172.21.15.121:0/3228252764 conn(0x7f585809aa70 msgr2=0x7f585809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 -- 172.21.15.121:0/3228252764 shutdown_connections 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f585ea23640 1 -- 172.21.15.121:0/3228252764 wait complete. 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85ef966640 1 -- 172.21.15.121:0/259182112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 msgr2=0x7f85e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85ef966640 1 --2- 172.21.15.121:0/259182112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e8070450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009720 tx=0x7f85e402a0d0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85ef966640 1 -- 172.21.15.121:0/259182112 shutdown_connections 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85ef966640 1 --2- 172.21.15.121:0/259182112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e8070450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.989+0000 7f85ef966640 1 -- 172.21.15.121:0/259182112 >> 172.21.15.121:0/259182112 conn(0x7f85e809aa70 msgr2=0x7f85e809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 -- 172.21.15.121:0/3148113376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 msgr2=0x7fdbbc132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 --2- 172.21.15.121:0/3148113376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc132f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0097f0 tx=0x7fdbac02c3f0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7f85ef966640 1 -- 172.21.15.121:0/259182112 shutdown_connections 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 -- 172.21.15.121:0/3148113376 shutdown_connections 2024-09-15T23:55:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 --2- 172.21.15.121:0/3148113376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc132f30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7f85ef966640 1 -- 172.21.15.121:0/259182112 wait complete. 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 -- 172.21.15.121:0/3148113376 >> 172.21.15.121:0/3148113376 conn(0x7fdbbc0a85e0 msgr2=0x7fdbbc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 -- 172.21.15.121:0/3148113376 shutdown_connections 2024-09-15T23:55:16.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7fdbc2453640 1 -- 172.21.15.121:0/3148113376 wait complete. 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7f585ea23640 1 Processor -- start 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7f585ea23640 1 -- start start 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.990+0000 7f85ef966640 1 Processor -- start 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ef966640 1 -- start start 2024-09-15T23:55:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7fdbc2453640 1 Processor -- start 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f585ea23640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7fdbc2453640 1 -- start start 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f585ea23640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5858067bc0 con 0x7f5858070070 2024-09-15T23:55:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ef966640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f5857fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f5857fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55624/0 (socket says 172.21.15.121:55624) 2024-09-15T23:55:17.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f5857fff640 1 -- 172.21.15.121:0/1245517562 learned_addr learned my addr 172.21.15.121:0/1245517562 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ef966640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85e8071b70 con 0x7f85e8070070 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ed702640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ed702640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55630/0 (socket says 172.21.15.121:55630) 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f85ed702640 1 -- 172.21.15.121:0/1050857954 learned_addr learned my addr 172.21.15.121:0/1050857954 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.991+0000 7f5857fff640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58580a8d10 con 0x7f5858070070 2024-09-15T23:55:17.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ed702640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e81a6250 con 0x7f85e8070070 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f5857fff640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f584802a150 tx=0x7f58480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ed702640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85e402a110 tx=0x7f85e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848041070 con 0x7f5858070070 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5848032e30 con 0x7f5858070070 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58580a5710 con 0x7f5858070070 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4041070 con 0x7f85e8070070 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e403c670 con 0x7f85e8070070 2024-09-15T23:55:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbc2453640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e81a9080 con 0x7f85e8070070 2024-09-15T23:55:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbc2453640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1329c0 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbbbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55642/0 (socket says 172.21.15.121:55642) 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbbbfff640 1 -- 172.21.15.121:0/2578052564 learned_addr learned my addr 172.21.15.121:0/2578052564 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7fdbbbfff640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc072060 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e81a9650 con 0x7f85e8070070 2024-09-15T23:55:17.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbbbfff640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036040 tx=0x7fdbac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5848037040 con 0x7f5858070070 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.992+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58580a4420 con 0x7f5858070070 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f585809d7f0 con 0x7f5858070070 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5848044070 con 0x7f5858070070 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e4037040 con 0x7f85e8070070 2024-09-15T23:55:17.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac038040 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbac043070 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbac033730 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc072ef0 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc070d70 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f5854ff9640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 0x7f584403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85e80a9720 con 0x7f85e8070070 2024-09-15T23:55:17.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f85e4044070 con 0x7f85e8070070 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.993+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f584806bd60 con 0x7f5858070070 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f5854ff9640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 0x7f5844041600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f58577fe640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 0x7f584403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f584802ad90 con 0x7f584403f1c0 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f584806e410 con 0x7f5858070070 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f585cfc0640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 0x7f5844041600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ddffb640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 0x7f85cc03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f85e406bb40 con 0x7f85e8070070 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ddffb640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 0x7f85cc0414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85e4034e90 con 0x7f85cc03f090 2024-09-15T23:55:17.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f85e406e270 con 0x7f85e8070070 2024-09-15T23:55:17.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85edf03640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 0x7f85cc0414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f85ecf01640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 0x7f85cc03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f585cfc0640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 0x7f5844041600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7f58577fe640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 0x7f584403a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f584c000f60 tx=0x7f584c007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.994+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdbac0338d0 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbbc0a90a0 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7f85edf03640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 0x7f85cc0414d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7f85ecf01640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 0x7f85cc03a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85d8007fd0 tx=0x7f85d8007b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb97fa640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 0x7fdb9c03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fdbac06c000 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb97fa640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 0x7fdb9c041670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbac035e90 con 0x7fdb9c03f230 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fdbac06f570 con 0x7fdbbc0a39c0 2024-09-15T23:55:17.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb3fff640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 0x7fdb9c03a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== osd.1 v2:172.21.15.121:6808/4042695749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f584802ad90 con 0x7f584403f1c0 2024-09-15T23:55:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbc09f0640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 0x7fdb9c041670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbc09f0640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 0x7fdb9c041670 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.995+0000 7fdbb3fff640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 0x7fdb9c03a7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.996+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== osd.2 v2:172.21.15.121:6812/1644151022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85e4034e90 con 0x7f85cc03f090 2024-09-15T23:55:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:16.996+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== osd.0 v2:172.21.15.121:6800/871193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbac035e90 con 0x7fdb9c03f230 2024-09-15T23:55:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.009+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 --> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58580a6700 con 0x7f584403f1c0 2024-09-15T23:55:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.009+0000 7f5854ff9640 1 -- 172.21.15.121:0/1245517562 <== osd.1 v2:172.21.15.121:6808/4042695749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f585000ad10 con 0x7f584403f1c0 2024-09-15T23:55:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.009+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 msgr2=0x7f5844041600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.009+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 0x7f5844041600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 msgr2=0x7f584403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 0x7f584403a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f584c000f60 tx=0x7f584c007a80 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 msgr2=0x7f58580a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f584802a150 tx=0x7f58480046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 shutdown_connections 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7f584403f1c0 0x7f5844041600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f58440382a0 0x7f584403a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 --2- 172.21.15.121:0/1245517562 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5858070070 0x7f58580a6160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 >> 172.21.15.121:0/1245517562 conn(0x7f585809aa70 msgr2=0x7f58581344e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 shutdown_connections 2024-09-15T23:55:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.010+0000 7f585ea23640 1 -- 172.21.15.121:0/1245517562 wait complete. 2024-09-15T23:55:17.021 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:17.021 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T23:55:17.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.027+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 --> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85e8072850 con 0x7f85cc03f090 2024-09-15T23:55:17.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.027+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 --> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdbbc073170 con 0x7fdb9c03f230 2024-09-15T23:55:17.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.027+0000 7f85ddffb640 1 -- 172.21.15.121:0/1050857954 <== osd.2 v2:172.21.15.121:6812/1644151022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f85e8072850 con 0x7f85cc03f090 2024-09-15T23:55:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.027+0000 7fdbb97fa640 1 -- 172.21.15.121:0/2578052564 <== osd.0 v2:172.21.15.121:6800/871193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdbbc073170 con 0x7fdb9c03f230 2024-09-15T23:55:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 msgr2=0x7f85cc0414d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 0x7f85cc0414d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 msgr2=0x7f85cc03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 0x7f85cc03a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85d8007fd0 tx=0x7f85d8007b20 comp rx=0 tx=0).stop 2024-09-15T23:55:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 msgr2=0x7fdb9c041670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 0x7fdb9c041670 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 msgr2=0x7f85e81a9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85e402a110 tx=0x7f85e40046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 shutdown_connections 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7f85cc03f090 0x7f85cc0414d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85cc038250 0x7f85cc03a710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 --2- 172.21.15.121:0/1050857954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85e8070070 0x7f85e81a9ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 >> 172.21.15.121:0/1050857954 conn(0x7f85e809aa70 msgr2=0x7f85e809d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 msgr2=0x7fdb9c03a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 0x7fdb9c03a7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4007920 comp rx=0 tx=0).stop 2024-09-15T23:55:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 msgr2=0x7fdbbc12fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdbac036040 tx=0x7fdbac0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 shutdown_connections 2024-09-15T23:55:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7f85ef966640 1 -- 172.21.15.121:0/1050857954 wait complete. 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 shutdown_connections 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fdb9c03f230 0x7fdb9c041670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fdb9c0382f0 0x7fdb9c03a7b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 --2- 172.21.15.121:0/2578052564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc0a39c0 0x7fdbbc12fa40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 >> 172.21.15.121:0/2578052564 conn(0x7fdbbc0a85e0 msgr2=0x7fdbbc131bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 shutdown_connections 2024-09-15T23:55:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.028+0000 7fdbc2453640 1 -- 172.21.15.121:0/2578052564 wait complete. 2024-09-15T23:55:17.040 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:17.040 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T23:55:17.041 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:17.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T23:55:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.124+0000 7fa833e27640 1 Processor -- start 2024-09-15T23:55:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.124+0000 7fa833e27640 1 -- start start 2024-09-15T23:55:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa833e27640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa82c0a4c20 0x7fa82c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa833e27640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c13a080 con 0x7fa82c13a280 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa833e27640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0a3d50 con 0x7fa82c0a4c20 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa8313c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa82c0a4c20 0x7fa82c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa8313c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa82c0a4c20 0x7fa82c13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55658/0 (socket says 172.21.15.121:55658) 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa8313c2640 1 -- 172.21.15.121:0/676713170 learned_addr learned my addr 172.21.15.121:0/676713170 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa8313c2640 1 -- 172.21.15.121:0/676713170 >> v1:172.21.15.121:6789/0 conn(0x7fa82c13a280 legacy=0x7fa82c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.125+0000 7fa8313c2640 1 -- 172.21.15.121:0/676713170 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0a3f80 con 0x7fa82c0a4c20 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.126+0000 7fa8313c2640 1 --2- 172.21.15.121:0/676713170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c13f060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188bdc092a06d214 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.126+0000 7fa830bc1640 1 -- 172.21.15.121:0/676713170 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81c037070 con 0x7fa82c0a4c20 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.126+0000 7fa830bc1640 1 -- 172.21.15.121:0/676713170 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c032440 con 0x7fa82c0a4c20 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.126+0000 7fa830bc1640 1 -- 172.21.15.121:0/676713170 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa81c02ae60 con 0x7fa82c0a4c20 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 -- 172.21.15.121:0/676713170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 msgr2=0x7fa82c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 --2- 172.21.15.121:0/676713170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c13f060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097f0 tx=0x7fa81c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 -- 172.21.15.121:0/676713170 shutdown_connections 2024-09-15T23:55:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 --2- 172.21.15.121:0/676713170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c13f060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 -- 172.21.15.121:0/676713170 >> 172.21.15.121:0/676713170 conn(0x7fa82c0ac3e0 msgr2=0x7fa82c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 -- 172.21.15.121:0/676713170 shutdown_connections 2024-09-15T23:55:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.127+0000 7fa833e27640 1 -- 172.21.15.121:0/676713170 wait complete. 2024-09-15T23:55:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa833e27640 1 Processor -- start 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa833e27640 1 -- start start 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa833e27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa833e27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0a7ec0 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa831bc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa831bc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55668/0 (socket says 172.21.15.121:55668) 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.128+0000 7fa831bc3640 1 -- 172.21.15.121:0/1207390563 learned_addr learned my addr 172.21.15.121:0/1207390563 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa831bc3640 1 -- 172.21.15.121:0/1207390563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c125070 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa831bc3640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c450 tx=0x7fa82800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828017070 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828005220 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8280035f0 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c124780 con 0x7fa82c0a4c20 2024-09-15T23:55:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.129+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c124470 con 0x7fa82c0a4c20 2024-09-15T23:55:17.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.130+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa82801a070 con 0x7fa82c0a4c20 2024-09-15T23:55:17.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.130+0000 7fa8227fc640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 0x7fa81003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.130+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fa82804a4a0 con 0x7fa82c0a4c20 2024-09-15T23:55:17.132 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.130+0000 7fa8313c2640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 0x7fa81003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.130+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c122c20 con 0x7fa82c0a4c20 2024-09-15T23:55:17.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.131+0000 7fa8313c2640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 0x7fa81003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa81c034000 tx=0x7fa81c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.135+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa82801ac60 con 0x7fa82c0a4c20 2024-09-15T23:55:17.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.183+0000 7f6e50af1640 1 Processor -- start 2024-09-15T23:55:17.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.183+0000 7f6e50af1640 1 -- start start 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e50af1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6e4c13a220 0x7f6e4c13a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e50af1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4c09f2f0 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e50af1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6e4c0a07d0 con 0x7f6e4c13a220 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e4a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6e4c13a220 0x7f6e4c13a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e4a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6e4c13a220 0x7f6e4c13a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55682/0 (socket says 172.21.15.121:55682) 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e4a59c640 1 -- 172.21.15.121:0/2639466010 learned_addr learned my addr 172.21.15.121:0/2639466010 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e49d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6e4c0a1c80 0x7f6e4c136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45466/0 (socket says 172.21.15.121:45466) 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e4a59c640 1 -- 172.21.15.121:0/2639466010 >> v1:172.21.15.121:6789/0 conn(0x7f6e4c0a1c80 legacy=0x7f6e4c136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.184+0000 7f6e4a59c640 1 -- 172.21.15.121:0/2639466010 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c139dd0 con 0x7f6e4c13a220 2024-09-15T23:55:17.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.185+0000 7f6e4a59c640 1 --2- 172.21.15.121:0/2639466010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c13a220 0x7f6e4c13a600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e440097f0 tx=0x7f6e4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb0ce0cc48d9c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.185+0000 7f6e4959a640 1 -- 172.21.15.121:0/2639466010 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e44037070 con 0x7f6e4c13a220 2024-09-15T23:55:17.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.185+0000 7f6e4959a640 1 -- 172.21.15.121:0/2639466010 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e44032440 con 0x7f6e4c13a220 2024-09-15T23:55:17.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.185+0000 7f6e4959a640 1 -- 172.21.15.121:0/2639466010 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e4402ae60 con 0x7f6e4c13a220 2024-09-15T23:55:17.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 -- 172.21.15.121:0/2639466010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c13a220 msgr2=0x7f6e4c13a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 --2- 172.21.15.121:0/2639466010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c13a220 0x7f6e4c13a600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e440097f0 tx=0x7f6e4402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 -- 172.21.15.121:0/2639466010 shutdown_connections 2024-09-15T23:55:17.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 --2- 172.21.15.121:0/2639466010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c13a220 0x7f6e4c13a600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 -- 172.21.15.121:0/2639466010 >> 172.21.15.121:0/2639466010 conn(0x7f6e4c06d820 msgr2=0x7f6e4c06dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 -- 172.21.15.121:0/2639466010 shutdown_connections 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.186+0000 7f6e50af1640 1 -- 172.21.15.121:0/2639466010 wait complete. 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.187+0000 7f6e50af1640 1 Processor -- start 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.187+0000 7f6e50af1640 1 -- start start 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.187+0000 7f6e50af1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.187+0000 7f6e50af1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c139a20 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.187+0000 7f6e4a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e4a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55688/0 (socket says 172.21.15.121:55688) 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e4a59c640 1 -- 172.21.15.121:0/3286898548 learned_addr learned my addr 172.21.15.121:0/3286898548 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e4a59c640 1 -- 172.21.15.121:0/3286898548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c0aa0a0 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e4a59c640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e440090b0 tx=0x7f6e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e44041070 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4403c7a0 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c0a96b0 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e44037040 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.188+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c0a9950 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.189+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6e44044070 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.189+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c0a7d80 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.189+0000 7f6e3affd640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 0x7f6e2c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.189+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f6e4406bd10 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.189+0000 7f6e49d9b640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 0x7f6e2c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.190+0000 7f6e49d9b640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 0x7f6e2c03a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e40007fd0 tx=0x7f6e40007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.194+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e4c0aa0a0 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.206+0000 7f4dfc442640 1 Processor -- start 2024-09-15T23:55:17.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.206+0000 7f4dfc442640 1 -- start start 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4dfc442640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4df4135f30 0x7f4df413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4dfc442640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df40a08c0 con 0x7f4df4135b50 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4dfc442640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4df409b310 con 0x7f4df4135f30 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4df99dd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4df4135f30 0x7f4df413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4dfa1de640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4df4135b50 0x7f4df409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45478/0 (socket says 172.21.15.121:45478) 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4dfa1de640 1 -- 172.21.15.121:0/2262360531 learned_addr learned my addr 172.21.15.121:0/2262360531 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:17.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4df99dd640 1 -- 172.21.15.121:0/2262360531 >> v1:172.21.15.121:6789/0 conn(0x7f4df4135b50 legacy=0x7f4df409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.207+0000 7f4df99dd640 1 -- 172.21.15.121:0/2262360531 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df40a2270 con 0x7f4df4135f30 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.208+0000 7f4df99dd640 1 --2- 172.21.15.121:0/2262360531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135f30 0x7f4df413bb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009720 tx=0x7f4de402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1539f340ca6641d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.208+0000 7f4df91dc640 1 -- 172.21.15.121:0/2262360531 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de4037070 con 0x7f4df4135f30 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.208+0000 7f4df91dc640 1 -- 172.21.15.121:0/2262360531 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de402ae20 con 0x7f4df4135f30 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.208+0000 7f4df91dc640 1 -- 172.21.15.121:0/2262360531 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4de4032590 con 0x7f4df4135f30 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 -- 172.21.15.121:0/2262360531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135f30 msgr2=0x7f4df413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 --2- 172.21.15.121:0/2262360531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135f30 0x7f4df413bb80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009720 tx=0x7f4de402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 -- 172.21.15.121:0/2262360531 shutdown_connections 2024-09-15T23:55:17.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 --2- 172.21.15.121:0/2262360531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135f30 0x7f4df413bb80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 -- 172.21.15.121:0/2262360531 >> 172.21.15.121:0/2262360531 conn(0x7f4df40a85e0 msgr2=0x7f4df40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 -- 172.21.15.121:0/2262360531 shutdown_connections 2024-09-15T23:55:17.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.209+0000 7f4dfc442640 1 -- 172.21.15.121:0/2262360531 wait complete. 2024-09-15T23:55:17.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.210+0000 7f4dfc442640 1 Processor -- start 2024-09-15T23:55:17.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.210+0000 7f4dfc442640 1 -- start start 2024-09-15T23:55:17.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.210+0000 7f4dfc442640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.210+0000 7f4dfc442640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4df4136350 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfa1de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfa1de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55714/0 (socket says 172.21.15.121:55714) 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfa1de640 1 -- 172.21.15.121:0/1317484711 learned_addr learned my addr 172.21.15.121:0/1317484711 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfa1de640 1 -- 172.21.15.121:0/1317484711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df41237c0 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfa1de640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c4a0 tx=0x7f4df000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0017070 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0005c10 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0007070 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df41242b0 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.211+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df41230e0 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.212+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4df001a070 con 0x7f4df4135b50 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.212+0000 7f4deaffd640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 0x7f4dd803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:17.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.212+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f4df004a5d0 con 0x7f4df4135b50 2024-09-15T23:55:17.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.212+0000 7f4df99dd640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 0x7f4dd803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:17.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.213+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df409aae0 con 0x7f4df4135b50 2024-09-15T23:55:17.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.213+0000 7f4df99dd640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 0x7f4dd803a710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4de4034000 tx=0x7f4de402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:17.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.217+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4df001b400 con 0x7f4df4135b50 2024-09-15T23:55:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.361+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa82c124950 con 0x7fa82c0a4c20 2024-09-15T23:55:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.362+0000 7fa8227fc640 1 -- 172.21.15.121:0/1207390563 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa82801a9a0 con 0x7fa82c0a4c20 2024-09-15T23:55:17.363 INFO:teuthology.orchestra.run.smithi121.stdout:38654705668 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.363+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 msgr2=0x7fa81003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.363+0000 7fa833e27640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 0x7fa81003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa81c034000 tx=0x7fa81c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 msgr2=0x7fa82c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c450 tx=0x7fa82800c910 comp rx=0 tx=0).stop 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 shutdown_connections 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa8100382a0 0x7fa81003a760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 --2- 172.21.15.121:0/1207390563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa82c0a4c20 0x7fa82c0a0ff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 >> 172.21.15.121:0/1207390563 conn(0x7fa82c0ac3e0 msgr2=0x7fa82c0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 shutdown_connections 2024-09-15T23:55:17.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.364+0000 7fa833e27640 1 -- 172.21.15.121:0/1207390563 wait complete. 2024-09-15T23:55:17.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.369+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6e4c0a0100 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.370 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.370+0000 7f6e3affd640 1 -- 172.21.15.121:0/3286898548 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e4403a760 con 0x7f6e4c0a1c80 2024-09-15T23:55:17.371 INFO:teuthology.orchestra.run.smithi121.stdout:38654705668 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 msgr2=0x7f6e2c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 0x7f6e2c03a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e40007fd0 tx=0x7f6e40007dc0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 msgr2=0x7f6e4c0a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e440090b0 tx=0x7f6e440046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 shutdown_connections 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e2c0382a0 0x7f6e2c03a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 --2- 172.21.15.121:0/3286898548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e4c0a1c80 0x7f6e4c0a6000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 >> 172.21.15.121:0/3286898548 conn(0x7f6e4c06d820 msgr2=0x7f6e4c1346d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 shutdown_connections 2024-09-15T23:55:17.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.372+0000 7f6e50af1640 1 -- 172.21.15.121:0/3286898548 wait complete. 2024-09-15T23:55:17.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-15T23:55:17.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-15T23:55:17.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.410+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4df40a1f10 con 0x7f4df4135b50 2024-09-15T23:55:17.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.410+0000 7f4deaffd640 1 -- 172.21.15.121:0/1317484711 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4df0010c00 con 0x7f4df4135b50 2024-09-15T23:55:17.412 INFO:teuthology.orchestra.run.smithi121.stdout:38654705668 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 msgr2=0x7f4dd803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 0x7f4dd803a710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4de4034000 tx=0x7f4de402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 msgr2=0x7f4df411fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c4a0 tx=0x7f4df000c960 comp rx=0 tx=0).stop 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 shutdown_connections 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4dd8038250 0x7f4dd803a710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 --2- 172.21.15.121:0/1317484711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df4135b50 0x7f4df411fce0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 >> 172.21.15.121:0/1317484711 conn(0x7f4df40a85e0 msgr2=0x7f4df409f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 shutdown_connections 2024-09-15T23:55:17.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:17.412+0000 7f4dfc442640 1 -- 172.21.15.121:0/1317484711 wait complete. 2024-09-15T23:55:17.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-09-15T23:55:18.376 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T23:55:18.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T23:55:18.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T23:55:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.488+0000 7f7f6afc4640 1 Processor -- start 2024-09-15T23:55:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.488+0000 7f7f6afc4640 1 -- start start 2024-09-15T23:55:18.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f6afc4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f640a4740 0x7f7f640a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f6afc4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f640a4540 con 0x7f7f640a0ef0 2024-09-15T23:55:18.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f6afc4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7f640a0460 con 0x7f7f640a4740 2024-09-15T23:55:18.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f68d60640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f640a4740 0x7f7f640a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f68d60640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7f640a4740 0x7f7f640a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55718/0 (socket says 172.21.15.121:55718) 2024-09-15T23:55:18.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f68d60640 1 -- 172.21.15.121:0/3861491126 learned_addr learned my addr 172.21.15.121:0/3861491126 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:18.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f68d60640 1 -- 172.21.15.121:0/3861491126 >> v1:172.21.15.121:6789/0 conn(0x7f7f640a0ef0 legacy=0x7f7f64136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f637fe640 1 -- 172.21.15.121:0/3861491126 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235937651 0 0) 0x7f7f640a4540 con 0x7f7f640a0ef0 2024-09-15T23:55:18.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.489+0000 7f7f68d60640 1 -- 172.21.15.121:0/3861491126 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f640a4270 con 0x7f7f640a4740 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.490+0000 7f7f68d60640 1 --2- 172.21.15.121:0/3861491126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a4740 0x7f7f640a4b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097f0 tx=0x7f7f5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507be3d22965a9db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.490+0000 7f7f637fe640 1 -- 172.21.15.121:0/3861491126 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f58037070 con 0x7f7f640a4740 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.490+0000 7f7f637fe640 1 -- 172.21.15.121:0/3861491126 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58032440 con 0x7f7f640a4740 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.490+0000 7f7f637fe640 1 -- 172.21.15.121:0/3861491126 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f5802ae60 con 0x7f7f640a4740 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 -- 172.21.15.121:0/3861491126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a4740 msgr2=0x7f7f640a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/3861491126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a4740 0x7f7f640a4b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f580097f0 tx=0x7f7f5802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 -- 172.21.15.121:0/3861491126 shutdown_connections 2024-09-15T23:55:18.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/3861491126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a4740 0x7f7f640a4b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 -- 172.21.15.121:0/3861491126 >> 172.21.15.121:0/3861491126 conn(0x7f7f640a9260 msgr2=0x7f7f640a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 -- 172.21.15.121:0/3861491126 shutdown_connections 2024-09-15T23:55:18.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.491+0000 7f7f6afc4640 1 -- 172.21.15.121:0/3861491126 wait complete. 2024-09-15T23:55:18.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.492+0000 7f7f6afc4640 1 Processor -- start 2024-09-15T23:55:18.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.492+0000 7f7f6afc4640 1 -- start start 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.493+0000 7f7f6afc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.493+0000 7f7f6afc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f640a22f0 con 0x7f7f640a0ef0 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.493+0000 7f7f68d60640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.493+0000 7f7f68d60640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55722/0 (socket says 172.21.15.121:55722) 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.493+0000 7f7f68d60640 1 -- 172.21.15.121:0/220832410 learned_addr learned my addr 172.21.15.121:0/220832410 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:18.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f68d60640 1 -- 172.21.15.121:0/220832410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f640735a0 con 0x7f7f640a0ef0 2024-09-15T23:55:18.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f68d60640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f58035040 tx=0x7f7f580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f58037040 con 0x7f7f640a0ef0 2024-09-15T23:55:18.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58004180 con 0x7f7f640a0ef0 2024-09-15T23:55:18.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f580044a0 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6409d090 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.494+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6409d350 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.495+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7f5803a070 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.495+0000 7f7f617fa640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 0x7f7f4803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.495+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f7f5806bc00 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.495+0000 7f7f63fff640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 0x7f7f4803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.495+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f6409be10 con 0x7f7f640a0ef0 2024-09-15T23:55:18.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.496+0000 7f7f63fff640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 0x7f7f4803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007fd0 tx=0x7f7f50007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.504+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f58041020 con 0x7f7f640a0ef0 2024-09-15T23:55:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.534+0000 7f4bc7c53640 1 Processor -- start 2024-09-15T23:55:18.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc7c53640 1 -- start start 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc7c53640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4bc00a4c20 0x7f4bc013f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc7c53640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bc013a080 con 0x7f4bc013a280 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc7c53640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f4bc00a3d50 con 0x7f4bc00a4c20 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc51ee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f4bc00a4c20 0x7f4bc013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc59ef640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f4bc013a280 0x7f4bc013a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45488/0 (socket says 172.21.15.121:45488) 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.535+0000 7f4bc59ef640 1 -- 172.21.15.121:0/1107337151 learned_addr learned my addr 172.21.15.121:0/1107337151 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.536+0000 7f4bc51ee640 1 -- 172.21.15.121:0/1107337151 >> v1:172.21.15.121:6789/0 conn(0x7f4bc013a280 legacy=0x7f4bc013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.536+0000 7f4bc49ed640 1 -- 172.21.15.121:0/1107337151 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882222434 0 0) 0x7f4bc013a080 con 0x7f4bc013a280 2024-09-15T23:55:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.536+0000 7f4bc51ee640 1 -- 172.21.15.121:0/1107337151 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00a3f80 con 0x7f4bc00a4c20 2024-09-15T23:55:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.537+0000 7f4bc51ee640 1 --2- 172.21.15.121:0/1107337151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc013f060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009720 tx=0x7f4bb002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548aa5dae2f45f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.537+0000 7f4bc49ed640 1 -- 172.21.15.121:0/1107337151 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0037070 con 0x7f4bc00a4c20 2024-09-15T23:55:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.537+0000 7f4bc49ed640 1 -- 172.21.15.121:0/1107337151 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb002ad90 con 0x7f4bc00a4c20 2024-09-15T23:55:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.537+0000 7f4bc49ed640 1 -- 172.21.15.121:0/1107337151 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bb0032590 con 0x7f4bc00a4c20 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 -- 172.21.15.121:0/1107337151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 msgr2=0x7f4bc013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/1107337151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc013f060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009720 tx=0x7f4bb002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 -- 172.21.15.121:0/1107337151 shutdown_connections 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/1107337151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc013f060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 -- 172.21.15.121:0/1107337151 >> 172.21.15.121:0/1107337151 conn(0x7f4bc00ac3e0 msgr2=0x7f4bc00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 -- 172.21.15.121:0/1107337151 shutdown_connections 2024-09-15T23:55:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.538+0000 7f4bc7c53640 1 -- 172.21.15.121:0/1107337151 wait complete. 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc7c53640 1 Processor -- start 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc7c53640 1 -- start start 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc7c53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc7c53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc00a7ec0 con 0x7f4bc00a4c20 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc59ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.539+0000 7f4bc59ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55740/0 (socket says 172.21.15.121:55740) 2024-09-15T23:55:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bc59ef640 1 -- 172.21.15.121:0/3399827892 learned_addr learned my addr 172.21.15.121:0/3399827892 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bc59ef640 1 -- 172.21.15.121:0/3399827892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc00a2a70 con 0x7f4bc00a4c20 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bc59ef640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c420 tx=0x7f4bbc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc018070 con 0x7f4bc00a4c20 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0074d0 con 0x7f4bc00a4c20 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc009f760 con 0x7f4bc00a4c20 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bbc004950 con 0x7f4bc00a4c20 2024-09-15T23:55:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.540+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc009f480 con 0x7f4bc00a4c20 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.541+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4bbc01b070 con 0x7f4bc00a4c20 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.541+0000 7f4bb67fc640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 0x7f4ba403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.541+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc00a2f50 con 0x7f4bc00a4c20 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.541+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f4bbc04a5d0 con 0x7f4bc00a4c20 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.541+0000 7f4bc51ee640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 0x7f4ba403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.542+0000 7f4bc51ee640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 0x7f4ba403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0034000 tx=0x7f4bb002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.550+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bbc011950 con 0x7f4bc00a4c20 2024-09-15T23:55:18.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.569+0000 7f3e18c4c640 1 Processor -- start 2024-09-15T23:55:18.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.569+0000 7f3e18c4c640 1 -- start start 2024-09-15T23:55:18.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e18c4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3e1406d7b0 0x7f3e1409d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e18c4c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1406eac0 con 0x7f3e1406ccc0 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e18c4c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1409ced0 con 0x7f3e1406d7b0 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e0bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3e1406d7b0 0x7f3e1409d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e1259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3e1406ccc0 0x7f3e1406d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45496/0 (socket says 172.21.15.121:45496) 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e1259c640 1 -- 172.21.15.121:0/2392580858 learned_addr learned my addr 172.21.15.121:0/2392580858 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e0bfff640 1 -- 172.21.15.121:0/2392580858 >> v1:172.21.15.121:6789/0 conn(0x7f3e1406ccc0 legacy=0x7f3e1406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.570+0000 7f3e0bfff640 1 -- 172.21.15.121:0/2392580858 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1406e270 con 0x7f3e1406d7b0 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.571+0000 7f3e0bfff640 1 --2- 172.21.15.121:0/2392580858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406d7b0 0x7f3e1409d6c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009720 tx=0x7f3dfc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1735421ff63bd6b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.571+0000 7f3e11d9b640 1 -- 172.21.15.121:0/2392580858 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dfc037070 con 0x7f3e1406d7b0 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.571+0000 7f3e11d9b640 1 -- 172.21.15.121:0/2392580858 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc02ad90 con 0x7f3e1406d7b0 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.571+0000 7f3e11d9b640 1 -- 172.21.15.121:0/2392580858 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3dfc032590 con 0x7f3e1406d7b0 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 -- 172.21.15.121:0/2392580858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406d7b0 msgr2=0x7f3e1409d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/2392580858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406d7b0 0x7f3e1409d6c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009720 tx=0x7f3dfc02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 -- 172.21.15.121:0/2392580858 shutdown_connections 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/2392580858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406d7b0 0x7f3e1409d6c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 -- 172.21.15.121:0/2392580858 >> 172.21.15.121:0/2392580858 conn(0x7f3e14071aa0 msgr2=0x7f3e1409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 -- 172.21.15.121:0/2392580858 shutdown_connections 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.572+0000 7f3e18c4c640 1 -- 172.21.15.121:0/2392580858 wait complete. 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e18c4c640 1 Processor -- start 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e18c4c640 1 -- start start 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e18c4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e18c4c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1409cc10 con 0x7f3e1406ccc0 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e1259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e1259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55758/0 (socket says 172.21.15.121:55758) 2024-09-15T23:55:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.573+0000 7f3e1259c640 1 -- 172.21.15.121:0/1712664997 learned_addr learned my addr 172.21.15.121:0/1712664997 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e1259c640 1 -- 172.21.15.121:0/1712664997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e140aa630 con 0x7f3e1406ccc0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e1259c640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c4a0 tx=0x7f3e0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e04017070 con 0x7f3e1406ccc0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e04005c10 con 0x7f3e1406ccc0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e140a9250 con 0x7f3e1406ccc0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e04007070 con 0x7f3e1406ccc0 2024-09-15T23:55:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.574+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1413e590 con 0x7f3e1406ccc0 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.575+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3e0401a070 con 0x7f3e1406ccc0 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.575+0000 7f3e0affd640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 0x7f3df403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.575+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f3e0404a4c0 con 0x7f3e1406ccc0 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.575+0000 7f3e0bfff640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 0x7f3df403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.575+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1409d6c0 con 0x7f3e1406ccc0 2024-09-15T23:55:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.576+0000 7f3e0bfff640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 0x7f3df403a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc034000 tx=0x7f3dfc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.580+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e0401b3b0 con 0x7f3e1406ccc0 2024-09-15T23:55:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.696+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7f6409f7d0 con 0x7f7f640a0ef0 2024-09-15T23:55:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.696+0000 7f7f617fa640 1 -- 172.21.15.121:0/220832410 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7f5803c670 con 0x7f7f640a0ef0 2024-09-15T23:55:18.697 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 msgr2=0x7f7f4803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 0x7f7f4803a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007fd0 tx=0x7f7f50007900 comp rx=0 tx=0).stop 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 msgr2=0x7f7f64132980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f58035040 tx=0x7f7f580046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 shutdown_connections 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7f480382a0 0x7f7f4803a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 --2- 172.21.15.121:0/220832410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f640a0ef0 0x7f7f64132980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 >> 172.21.15.121:0/220832410 conn(0x7f7f640a9260 msgr2=0x7f7f640a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 shutdown_connections 2024-09-15T23:55:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.698+0000 7f7f6afc4640 1 -- 172.21.15.121:0/220832410 wait complete. 2024-09-15T23:55:18.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-15T23:55:18.711 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.726+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4bc00732e0 con 0x7f4bc00a4c20 2024-09-15T23:55:18.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.727+0000 7f4bb67fc640 1 -- 172.21.15.121:0/3399827892 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4bbc011bb0 con 0x7f4bc00a4c20 2024-09-15T23:55:18.728 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:18.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 msgr2=0x7f4ba403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 0x7f4ba403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0034000 tx=0x7f4bb002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 msgr2=0x7f4bc00a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c420 tx=0x7f4bbc00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 shutdown_connections 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f4ba4038250 0x7f4ba403a710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 --2- 172.21.15.121:0/3399827892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bc00a4c20 0x7f4bc00a1d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 >> 172.21.15.121:0/3399827892 conn(0x7f4bc00ac3e0 msgr2=0x7f4bc00a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 shutdown_connections 2024-09-15T23:55:18.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.729+0000 7f4bc7c53640 1 -- 172.21.15.121:0/3399827892 wait complete. 2024-09-15T23:55:18.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-15T23:55:18.741 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:18.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.755+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3e1406bde0 con 0x7f3e1406ccc0 2024-09-15T23:55:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.756+0000 7f3e0affd640 1 -- 172.21.15.121:0/1712664997 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e04010c00 con 0x7f3e1406ccc0 2024-09-15T23:55:18.757 INFO:teuthology.orchestra.run.smithi121.stdout:38654705669 2024-09-15T23:55:18.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 msgr2=0x7f3df403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 0x7f3df403a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc034000 tx=0x7f3dfc02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 msgr2=0x7f3e141ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c4a0 tx=0x7f3e0400c960 comp rx=0 tx=0).stop 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 shutdown_connections 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3df40382a0 0x7f3df403a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 --2- 172.21.15.121:0/1712664997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e1406ccc0 0x7f3e141ce840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 >> 172.21.15.121:0/1712664997 conn(0x7f3e14071aa0 msgr2=0x7f3e1413a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 shutdown_connections 2024-09-15T23:55:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.758+0000 7f3e18c4c640 1 -- 172.21.15.121:0/1712664997 wait complete. 2024-09-15T23:55:18.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-09-15T23:55:18.770 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:18.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:55:18.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.907+0000 7ffb80a2e640 1 Processor -- start 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.907+0000 7ffb80a2e640 1 -- start start 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb80a2e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffb7c13a280 0x7ffb7c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb80a2e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c13a080 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb80a2e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7c0a3d50 con 0x7ffb7c13a280 2024-09-15T23:55:18.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb7a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ffb7c13a280 0x7ffb7c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb79d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ffb7c0a4c20 0x7ffb7c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45498/0 (socket says 172.21.15.121:45498) 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb79d9b640 1 -- 172.21.15.121:0/2685238487 learned_addr learned my addr 172.21.15.121:0/2685238487 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb7a59c640 1 -- 172.21.15.121:0/2685238487 >> v1:172.21.15.121:6789/0 conn(0x7ffb7c0a4c20 legacy=0x7ffb7c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.908+0000 7ffb7a59c640 1 -- 172.21.15.121:0/2685238487 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c0a3f80 con 0x7ffb7c13a280 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.909+0000 7ffb7a59c640 1 --2- 172.21.15.121:0/2685238487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c13a280 0x7ffb7c13a660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9634ecd3807f1541 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.909+0000 7ffb7959a640 1 -- 172.21.15.121:0/2685238487 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c007670 con 0x7ffb7c13a280 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.909+0000 7ffb7959a640 1 -- 172.21.15.121:0/2685238487 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6c007810 con 0x7ffb7c13a280 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.909+0000 7ffb7959a640 1 -- 172.21.15.121:0/2685238487 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c007b10 con 0x7ffb7c13a280 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 -- 172.21.15.121:0/2685238487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c13a280 msgr2=0x7ffb7c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/2685238487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c13a280 0x7ffb7c13a660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c02a660 comp rx=0 tx=0).stop 2024-09-15T23:55:18.912 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 -- 172.21.15.121:0/2685238487 shutdown_connections 2024-09-15T23:55:18.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/2685238487 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c13a280 0x7ffb7c13a660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:18.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 -- 172.21.15.121:0/2685238487 >> 172.21.15.121:0/2685238487 conn(0x7ffb7c0ac3e0 msgr2=0x7ffb7c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:18.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 -- 172.21.15.121:0/2685238487 shutdown_connections 2024-09-15T23:55:18.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.910+0000 7ffb80a2e640 1 -- 172.21.15.121:0/2685238487 wait complete. 2024-09-15T23:55:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb80a2e640 1 Processor -- start 2024-09-15T23:55:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb80a2e640 1 -- start start 2024-09-15T23:55:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb80a2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb80a2e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c139d40 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb7a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb7a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55772/0 (socket says 172.21.15.121:55772) 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb7a59c640 1 -- 172.21.15.121:0/3974780249 learned_addr learned my addr 172.21.15.121:0/3974780249 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.911+0000 7ffb7a59c640 1 -- 172.21.15.121:0/3974780249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c125a30 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb7a59c640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c040070 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6c031a90 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c123a80 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb6c031d70 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.912+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c0a21c0 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffb6c039040 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb6affd640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 0x7ffb5c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c06dab0 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7ffb6c02ae00 con 0x7ffb7c0a4c20 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb79d9b640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 0x7ffb5c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:18.917 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.913+0000 7ffb79d9b640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 0x7ffb5c03a790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007fd0 tx=0x7ffb70007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:18.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:18.918+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb6c03a3b0 con 0x7ffb7c0a4c20 2024-09-15T23:55:19.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.079+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb7c0a2f50 con 0x7ffb5c0382d0 2024-09-15T23:55:19.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.085+0000 7ffb6affd640 1 -- 172.21.15.121:0/3974780249 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245915 (secure 0 0 0) 0x7ffb7c0a2f50 con 0x7ffb5c0382d0 2024-09-15T23:55:19.088 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:19.090 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:19.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 msgr2=0x7ffb5c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 0x7ffb5c03a790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007fd0 tx=0x7ffb70007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 msgr2=0x7ffb7c125450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d90 tx=0x7ffb6c004a40 comp rx=0 tx=0).stop 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 shutdown_connections 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ffb5c0382d0 0x7ffb5c03a790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 --2- 172.21.15.121:0/3974780249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb7c0a4c20 0x7ffb7c125450 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 >> 172.21.15.121:0/3974780249 conn(0x7ffb7c0ac3e0 msgr2=0x7ffb7c0ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 shutdown_connections 2024-09-15T23:55:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.088+0000 7ffb80a2e640 1 -- 172.21.15.121:0/3974780249 wait complete. 2024-09-15T23:55:19.099 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T23:55:18.024595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82744,"kb_used_data":1656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032776,"statfs":{"total":289910292480,"available":289825562624,"internally_reserved":0,"allocated":1695744,"data_stored":1320280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.362384"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683414+0000","last_change":"2024-09-15T23:55:12.689010+0000","last_active":"2024-09-15T23:55:13.683414+0000","last_peered":"2024-09-15T23:55:13.683414+0000","last_clean":"2024-09-15T23:55:13.683414+0000","last_became_active":"2024-09-15T23:55:12.688116+0000","last_became_peered":"2024-09-15T23:55:12.688116+0000","last_unstale":"2024-09-15T23:55:13.683414+0000","last_undegraded":"2024-09-15T23:55:13.683414+0000","last_fullsized":"2024-09-15T23:55:13.683414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:51.099276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686456+0000","last_change":"2024-09-15T23:55:12.691799+0000","last_active":"2024-09-15T23:55:13.686456+0000","last_peered":"2024-09-15T23:55:13.686456+0000","last_clean":"2024-09-15T23:55:13.686456+0000","last_became_active":"2024-09-15T23:55:12.691528+0000","last_became_peered":"2024-09-15T23:55:12.691528+0000","last_unstale":"2024-09-15T23:55:13.686456+0000","last_undegraded":"2024-09-15T23:55:13.686456+0000","last_fullsized":"2024-09-15T23:55:13.686456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:02.111895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683747+0000","last_change":"2024-09-15T23:55:12.698265+0000","last_active":"2024-09-15T23:55:13.683747+0000","last_peered":"2024-09-15T23:55:13.683747+0000","last_clean":"2024-09-15T23:55:13.683747+0000","last_became_active":"2024-09-15T23:55:12.696115+0000","last_became_peered":"2024-09-15T23:55:12.696115+0000","last_unstale":"2024-09-15T23:55:13.683747+0000","last_undegraded":"2024-09-15T23:55:13.683747+0000","last_fullsized":"2024-09-15T23:55:13.683747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:47.238303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637574+0000","last_change":"2024-09-15T23:55:12.708793+0000","last_active":"2024-09-15T23:55:15.637574+0000","last_peered":"2024-09-15T23:55:15.637574+0000","last_clean":"2024-09-15T23:55:15.637574+0000","last_became_active":"2024-09-15T23:55:12.708546+0000","last_became_peered":"2024-09-15T23:55:12.708546+0000","last_unstale":"2024-09-15T23:55:15.637574+0000","last_undegraded":"2024-09-15T23:55:15.637574+0000","last_fullsized":"2024-09-15T23:55:15.637574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:50.224153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683799+0000","last_change":"2024-09-15T23:55:12.689949+0000","last_active":"2024-09-15T23:55:13.683799+0000","last_peered":"2024-09-15T23:55:13.683799+0000","last_clean":"2024-09-15T23:55:13.683799+0000","last_became_active":"2024-09-15T23:55:12.689502+0000","last_became_peered":"2024-09-15T23:55:12.689502+0000","last_unstale":"2024-09-15T23:55:13.683799+0000","last_undegraded":"2024-09-15T23:55:13.683799+0000","last_fullsized":"2024-09-15T23:55:13.683799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:22.212299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637456+0000","last_change":"2024-09-15T23:55:12.710819+0000","last_active":"2024-09-15T23:55:15.637456+0000","last_peered":"2024-09-15T23:55:15.637456+0000","last_clean":"2024-09-15T23:55:15.637456+0000","last_became_active":"2024-09-15T23:55:12.709647+0000","last_became_peered":"2024-09-15T23:55:12.709647+0000","last_unstale":"2024-09-15T23:55:15.637456+0000","last_undegraded":"2024-09-15T23:55:15.637456+0000","last_fullsized":"2024-09-15T23:55:15.637456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:21.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682968+0000","last_change":"2024-09-15T23:55:12.683855+0000","last_active":"2024-09-15T23:55:13.682968+0000","last_peered":"2024-09-15T23:55:13.682968+0000","last_clean":"2024-09-15T23:55:13.682968+0000","last_became_active":"2024-09-15T23:55:12.683568+0000","last_became_peered":"2024-09-15T23:55:12.683568+0000","last_unstale":"2024-09-15T23:55:13.682968+0000","last_undegraded":"2024-09-15T23:55:13.682968+0000","last_fullsized":"2024-09-15T23:55:13.682968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:44.667913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637181+0000","last_change":"2024-09-15T23:55:12.712357+0000","last_active":"2024-09-15T23:55:15.637181+0000","last_peered":"2024-09-15T23:55:15.637181+0000","last_clean":"2024-09-15T23:55:15.637181+0000","last_became_active":"2024-09-15T23:55:12.711161+0000","last_became_peered":"2024-09-15T23:55:12.711161+0000","last_unstale":"2024-09-15T23:55:15.637181+0000","last_undegraded":"2024-09-15T23:55:15.637181+0000","last_fullsized":"2024-09-15T23:55:15.637181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:05.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687145+0000","last_change":"2024-09-15T23:55:12.698143+0000","last_active":"2024-09-15T23:55:13.687145+0000","last_peered":"2024-09-15T23:55:13.687145+0000","last_clean":"2024-09-15T23:55:13.687145+0000","last_became_active":"2024-09-15T23:55:12.697913+0000","last_became_peered":"2024-09-15T23:55:12.697913+0000","last_unstale":"2024-09-15T23:55:13.687145+0000","last_undegraded":"2024-09-15T23:55:13.687145+0000","last_fullsized":"2024-09-15T23:55:13.687145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:20.691068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683467+0000","last_change":"2024-09-15T23:55:12.691954+0000","last_active":"2024-09-15T23:55:13.683467+0000","last_peered":"2024-09-15T23:55:13.683467+0000","last_clean":"2024-09-15T23:55:13.683467+0000","last_became_active":"2024-09-15T23:55:12.691679+0000","last_became_peered":"2024-09-15T23:55:12.691679+0000","last_unstale":"2024-09-15T23:55:13.683467+0000","last_undegraded":"2024-09-15T23:55:13.683467+0000","last_fullsized":"2024-09-15T23:55:13.683467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:42.206893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682945+0000","last_change":"2024-09-15T23:55:12.697740+0000","last_active":"2024-09-15T23:55:13.682945+0000","last_peered":"2024-09-15T23:55:13.682945+0000","last_clean":"2024-09-15T23:55:13.682945+0000","last_became_active":"2024-09-15T23:55:12.695173+0000","last_became_peered":"2024-09-15T23:55:12.695173+0000","last_unstale":"2024-09-15T23:55:13.682945+0000","last_undegraded":"2024-09-15T23:55:13.682945+0000","last_fullsized":"2024-09-15T23:55:13.682945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:46.138511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682871+0000","last_change":"2024-09-15T23:55:12.688930+0000","last_active":"2024-09-15T23:55:13.682871+0000","last_peered":"2024-09-15T23:55:13.682871+0000","last_clean":"2024-09-15T23:55:13.682871+0000","last_became_active":"2024-09-15T23:55:12.688599+0000","last_became_peered":"2024-09-15T23:55:12.688599+0000","last_unstale":"2024-09-15T23:55:13.682871+0000","last_undegraded":"2024-09-15T23:55:13.682871+0000","last_fullsized":"2024-09-15T23:55:13.682871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:55.648901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684268+0000","last_change":"2024-09-15T23:55:12.699041+0000","last_active":"2024-09-15T23:55:13.684268+0000","last_peered":"2024-09-15T23:55:13.684268+0000","last_clean":"2024-09-15T23:55:13.684268+0000","last_became_active":"2024-09-15T23:55:12.698719+0000","last_became_peered":"2024-09-15T23:55:12.698719+0000","last_unstale":"2024-09-15T23:55:13.684268+0000","last_undegraded":"2024-09-15T23:55:13.684268+0000","last_fullsized":"2024-09-15T23:55:13.684268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:37.689614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683214+0000","last_change":"2024-09-15T23:55:12.699903+0000","last_active":"2024-09-15T23:55:13.683214+0000","last_peered":"2024-09-15T23:55:13.683214+0000","last_clean":"2024-09-15T23:55:13.683214+0000","last_became_active":"2024-09-15T23:55:12.699658+0000","last_became_peered":"2024-09-15T23:55:12.699658+0000","last_unstale":"2024-09-15T23:55:13.683214+0000","last_undegraded":"2024-09-15T23:55:13.683214+0000","last_fullsized":"2024-09-15T23:55:13.683214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:03.909897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686075+0000","last_change":"2024-09-15T23:55:12.697628+0000","last_active":"2024-09-15T23:55:13.686075+0000","last_peered":"2024-09-15T23:55:13.686075+0000","last_clean":"2024-09-15T23:55:13.686075+0000","last_became_active":"2024-09-15T23:55:12.697376+0000","last_became_peered":"2024-09-15T23:55:12.697376+0000","last_unstale":"2024-09-15T23:55:13.686075+0000","last_undegraded":"2024-09-15T23:55:13.686075+0000","last_fullsized":"2024-09-15T23:55:13.686075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:09.986785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637212+0000","last_change":"2024-09-15T23:55:12.712697+0000","last_active":"2024-09-15T23:55:15.637212+0000","last_peered":"2024-09-15T23:55:15.637212+0000","last_clean":"2024-09-15T23:55:15.637212+0000","last_became_active":"2024-09-15T23:55:12.712204+0000","last_became_peered":"2024-09-15T23:55:12.712204+0000","last_unstale":"2024-09-15T23:55:15.637212+0000","last_undegraded":"2024-09-15T23:55:15.637212+0000","last_fullsized":"2024-09-15T23:55:15.637212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:41.814713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687277+0000","last_change":"2024-09-15T23:55:12.691645+0000","last_active":"2024-09-15T23:55:13.687277+0000","last_peered":"2024-09-15T23:55:13.687277+0000","last_clean":"2024-09-15T23:55:13.687277+0000","last_became_active":"2024-09-15T23:55:12.691220+0000","last_became_peered":"2024-09-15T23:55:12.691220+0000","last_unstale":"2024-09-15T23:55:13.687277+0000","last_undegraded":"2024-09-15T23:55:13.687277+0000","last_fullsized":"2024-09-15T23:55:13.687277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:37.381027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637777+0000","last_change":"2024-09-15T23:55:12.696986+0000","last_active":"2024-09-15T23:55:15.637777+0000","last_peered":"2024-09-15T23:55:15.637777+0000","last_clean":"2024-09-15T23:55:15.637777+0000","last_became_active":"2024-09-15T23:55:12.696708+0000","last_became_peered":"2024-09-15T23:55:12.696708+0000","last_unstale":"2024-09-15T23:55:15.637777+0000","last_undegraded":"2024-09-15T23:55:15.637777+0000","last_fullsized":"2024-09-15T23:55:15.637777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:22.386822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683885+0000","last_change":"2024-09-15T23:55:12.697966+0000","last_active":"2024-09-15T23:55:13.683885+0000","last_peered":"2024-09-15T23:55:13.683885+0000","last_clean":"2024-09-15T23:55:13.683885+0000","last_became_active":"2024-09-15T23:55:12.695494+0000","last_became_peered":"2024-09-15T23:55:12.695494+0000","last_unstale":"2024-09-15T23:55:13.683885+0000","last_undegraded":"2024-09-15T23:55:13.683885+0000","last_fullsized":"2024-09-15T23:55:13.683885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:05.385449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682911+0000","last_change":"2024-09-15T23:55:12.696664+0000","last_active":"2024-09-15T23:55:13.682911+0000","last_peered":"2024-09-15T23:55:13.682911+0000","last_clean":"2024-09-15T23:55:13.682911+0000","last_became_active":"2024-09-15T23:55:12.696407+0000","last_became_peered":"2024-09-15T23:55:12.696407+0000","last_unstale":"2024-09-15T23:55:13.682911+0000","last_undegraded":"2024-09-15T23:55:13.682911+0000","last_fullsized":"2024-09-15T23:55:13.682911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:36.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682773+0000","last_change":"2024-09-15T23:55:12.686358+0000","last_active":"2024-09-15T23:55:13.682773+0000","last_peered":"2024-09-15T23:55:13.682773+0000","last_clean":"2024-09-15T23:55:13.682773+0000","last_became_active":"2024-09-15T23:55:12.685997+0000","last_became_peered":"2024-09-15T23:55:12.685997+0000","last_unstale":"2024-09-15T23:55:13.682773+0000","last_undegraded":"2024-09-15T23:55:13.682773+0000","last_fullsized":"2024-09-15T23:55:13.682773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:23.859752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686045+0000","last_change":"2024-09-15T23:55:12.700605+0000","last_active":"2024-09-15T23:55:13.686045+0000","last_peered":"2024-09-15T23:55:13.686045+0000","last_clean":"2024-09-15T23:55:13.686045+0000","last_became_active":"2024-09-15T23:55:12.700273+0000","last_became_peered":"2024-09-15T23:55:12.700273+0000","last_unstale":"2024-09-15T23:55:13.686045+0000","last_undegraded":"2024-09-15T23:55:13.686045+0000","last_fullsized":"2024-09-15T23:55:13.686045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.347154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682467+0000","last_change":"2024-09-15T23:55:12.686146+0000","last_active":"2024-09-15T23:55:13.682467+0000","last_peered":"2024-09-15T23:55:13.682467+0000","last_clean":"2024-09-15T23:55:13.682467+0000","last_became_active":"2024-09-15T23:55:12.685705+0000","last_became_peered":"2024-09-15T23:55:12.685705+0000","last_unstale":"2024-09-15T23:55:13.682467+0000","last_undegraded":"2024-09-15T23:55:13.682467+0000","last_fullsized":"2024-09-15T23:55:13.682467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:23.918922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682502+0000","last_change":"2024-09-15T23:55:12.701281+0000","last_active":"2024-09-15T23:55:13.682502+0000","last_peered":"2024-09-15T23:55:13.682502+0000","last_clean":"2024-09-15T23:55:13.682502+0000","last_became_active":"2024-09-15T23:55:12.701047+0000","last_became_peered":"2024-09-15T23:55:12.701047+0000","last_unstale":"2024-09-15T23:55:13.682502+0000","last_undegraded":"2024-09-15T23:55:13.682502+0000","last_fullsized":"2024-09-15T23:55:13.682502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:20.691068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637860+0000","last_change":"2024-09-15T23:55:12.702183+0000","last_active":"2024-09-15T23:55:15.637860+0000","last_peered":"2024-09-15T23:55:15.637860+0000","last_clean":"2024-09-15T23:55:15.637860+0000","last_became_active":"2024-09-15T23:55:12.701921+0000","last_became_peered":"2024-09-15T23:55:12.701921+0000","last_unstale":"2024-09-15T23:55:15.637860+0000","last_undegraded":"2024-09-15T23:55:15.637860+0000","last_fullsized":"2024-09-15T23:55:15.637860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:52.477871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637821+0000","last_change":"2024-09-15T23:55:12.697158+0000","last_active":"2024-09-15T23:55:15.637821+0000","last_peered":"2024-09-15T23:55:15.637821+0000","last_clean":"2024-09-15T23:55:15.637821+0000","last_became_active":"2024-09-15T23:55:12.696919+0000","last_became_peered":"2024-09-15T23:55:12.696919+0000","last_unstale":"2024-09-15T23:55:15.637821+0000","last_undegraded":"2024-09-15T23:55:15.637821+0000","last_fullsized":"2024-09-15T23:55:15.637821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:29.873199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686362+0000","last_change":"2024-09-15T23:55:12.684313+0000","last_active":"2024-09-15T23:55:13.686362+0000","last_peered":"2024-09-15T23:55:13.686362+0000","last_clean":"2024-09-15T23:55:13.686362+0000","last_became_active":"2024-09-15T23:55:12.684051+0000","last_became_peered":"2024-09-15T23:55:12.684051+0000","last_unstale":"2024-09-15T23:55:13.686362+0000","last_undegraded":"2024-09-15T23:55:13.686362+0000","last_fullsized":"2024-09-15T23:55:13.686362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:45.032468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683002+0000","last_change":"2024-09-15T23:55:12.691786+0000","last_active":"2024-09-15T23:55:13.683002+0000","last_peered":"2024-09-15T23:55:13.683002+0000","last_clean":"2024-09-15T23:55:13.683002+0000","last_became_active":"2024-09-15T23:55:12.691014+0000","last_became_peered":"2024-09-15T23:55:12.691014+0000","last_unstale":"2024-09-15T23:55:13.683002+0000","last_undegraded":"2024-09-15T23:55:13.683002+0000","last_fullsized":"2024-09-15T23:55:13.683002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:20.402935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683238+0000","last_change":"2024-09-15T23:55:12.692693+0000","last_active":"2024-09-15T23:55:13.683238+0000","last_peered":"2024-09-15T23:55:13.683238+0000","last_clean":"2024-09-15T23:55:13.683238+0000","last_became_active":"2024-09-15T23:55:12.692388+0000","last_became_peered":"2024-09-15T23:55:12.692388+0000","last_unstale":"2024-09-15T23:55:13.683238+0000","last_undegraded":"2024-09-15T23:55:13.683238+0000","last_fullsized":"2024-09-15T23:55:13.683238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:34.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683088+0000","last_change":"2024-09-15T23:55:12.694633+0000","last_active":"2024-09-15T23:55:13.683088+0000","last_peered":"2024-09-15T23:55:13.683088+0000","last_clean":"2024-09-15T23:55:13.683088+0000","last_became_active":"2024-09-15T23:55:12.694187+0000","last_became_peered":"2024-09-15T23:55:12.694187+0000","last_unstale":"2024-09-15T23:55:13.683088+0000","last_undegraded":"2024-09-15T23:55:13.683088+0000","last_fullsized":"2024-09-15T23:55:13.683088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:04.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637332+0000","last_change":"2024-09-15T23:55:12.702217+0000","last_active":"2024-09-15T23:55:15.637332+0000","last_peered":"2024-09-15T23:55:15.637332+0000","last_clean":"2024-09-15T23:55:15.637332+0000","last_became_active":"2024-09-15T23:55:12.701635+0000","last_became_peered":"2024-09-15T23:55:12.701635+0000","last_unstale":"2024-09-15T23:55:15.637332+0000","last_undegraded":"2024-09-15T23:55:15.637332+0000","last_fullsized":"2024-09-15T23:55:15.637332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:57.384372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637396+0000","last_change":"2024-09-15T23:55:12.712448+0000","last_active":"2024-09-15T23:55:15.637396+0000","last_peered":"2024-09-15T23:55:15.637396+0000","last_clean":"2024-09-15T23:55:15.637396+0000","last_became_active":"2024-09-15T23:55:12.711476+0000","last_became_peered":"2024-09-15T23:55:12.711476+0000","last_unstale":"2024-09-15T23:55:15.637396+0000","last_undegraded":"2024-09-15T23:55:15.637396+0000","last_fullsized":"2024-09-15T23:55:15.637396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:59.933964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686072+0000","last_change":"2024-09-15T23:55:12.694322+0000","last_active":"2024-09-15T23:55:13.686072+0000","last_peered":"2024-09-15T23:55:13.686072+0000","last_clean":"2024-09-15T23:55:13.686072+0000","last_became_active":"2024-09-15T23:55:12.694058+0000","last_became_peered":"2024-09-15T23:55:12.694058+0000","last_unstale":"2024-09-15T23:55:13.686072+0000","last_undegraded":"2024-09-15T23:55:13.686072+0000","last_fullsized":"2024-09-15T23:55:13.686072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:56.223906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686315+0000","last_change":"2024-09-15T23:55:11.689438+0000","last_active":"2024-09-15T23:55:13.686315+0000","last_peered":"2024-09-15T23:55:13.686315+0000","last_clean":"2024-09-15T23:55:13.686315+0000","last_became_active":"2024-09-15T23:55:11.688715+0000","last_became_peered":"2024-09-15T23:55:11.688715+0000","last_unstale":"2024-09-15T23:55:13.686315+0000","last_undegraded":"2024-09-15T23:55:13.686315+0000","last_fullsized":"2024-09-15T23:55:13.686315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683578+0000","last_change":"2024-09-15T23:55:12.685542+0000","last_active":"2024-09-15T23:55:13.683578+0000","last_peered":"2024-09-15T23:55:13.683578+0000","last_clean":"2024-09-15T23:55:13.683578+0000","last_became_active":"2024-09-15T23:55:12.685271+0000","last_became_peered":"2024-09-15T23:55:12.685271+0000","last_unstale":"2024-09-15T23:55:13.683578+0000","last_undegraded":"2024-09-15T23:55:13.683578+0000","last_fullsized":"2024-09-15T23:55:13.683578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.069363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637567+0000","last_change":"2024-09-15T23:55:11.690527+0000","last_active":"2024-09-15T23:55:15.637567+0000","last_peered":"2024-09-15T23:55:15.637567+0000","last_clean":"2024-09-15T23:55:15.637567+0000","last_became_active":"2024-09-15T23:55:11.690256+0000","last_became_peered":"2024-09-15T23:55:11.690256+0000","last_unstale":"2024-09-15T23:55:15.637567+0000","last_undegraded":"2024-09-15T23:55:15.637567+0000","last_fullsized":"2024-09-15T23:55:15.637567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.749058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682846+0000","last_change":"2024-09-15T23:55:11.687201+0000","last_active":"2024-09-15T23:55:13.682846+0000","last_peered":"2024-09-15T23:55:13.682846+0000","last_clean":"2024-09-15T23:55:13.682846+0000","last_became_active":"2024-09-15T23:55:11.687041+0000","last_became_peered":"2024-09-15T23:55:11.687041+0000","last_unstale":"2024-09-15T23:55:13.682846+0000","last_undegraded":"2024-09-15T23:55:13.682846+0000","last_fullsized":"2024-09-15T23:55:13.682846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637745+0000","last_change":"2024-09-15T23:55:12.712572+0000","last_active":"2024-09-15T23:55:15.637745+0000","last_peered":"2024-09-15T23:55:15.637745+0000","last_clean":"2024-09-15T23:55:15.637745+0000","last_became_active":"2024-09-15T23:55:12.711835+0000","last_became_peered":"2024-09-15T23:55:12.711835+0000","last_unstale":"2024-09-15T23:55:15.637745+0000","last_undegraded":"2024-09-15T23:55:15.637745+0000","last_fullsized":"2024-09-15T23:55:15.637745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:14.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682453+0000","last_change":"2024-09-15T23:55:11.695048+0000","last_active":"2024-09-15T23:55:13.682453+0000","last_peered":"2024-09-15T23:55:13.682453+0000","last_clean":"2024-09-15T23:55:13.682453+0000","last_became_active":"2024-09-15T23:55:11.694766+0000","last_became_peered":"2024-09-15T23:55:11.694766+0000","last_unstale":"2024-09-15T23:55:13.682453+0000","last_undegraded":"2024-09-15T23:55:13.682453+0000","last_fullsized":"2024-09-15T23:55:13.682453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686069+0000","last_change":"2024-09-15T23:55:12.685430+0000","last_active":"2024-09-15T23:55:13.686069+0000","last_peered":"2024-09-15T23:55:13.686069+0000","last_clean":"2024-09-15T23:55:13.686069+0000","last_became_active":"2024-09-15T23:55:12.685161+0000","last_became_peered":"2024-09-15T23:55:12.685161+0000","last_unstale":"2024-09-15T23:55:13.686069+0000","last_undegraded":"2024-09-15T23:55:13.686069+0000","last_fullsized":"2024-09-15T23:55:13.686069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:10.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687182+0000","last_change":"2024-09-15T23:55:11.680383+0000","last_active":"2024-09-15T23:55:13.687182+0000","last_peered":"2024-09-15T23:55:13.687182+0000","last_clean":"2024-09-15T23:55:13.687182+0000","last_became_active":"2024-09-15T23:55:11.680116+0000","last_became_peered":"2024-09-15T23:55:11.680116+0000","last_unstale":"2024-09-15T23:55:13.687182+0000","last_undegraded":"2024-09-15T23:55:13.687182+0000","last_fullsized":"2024-09-15T23:55:13.687182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637959+0000","last_change":"2024-09-15T23:55:12.695948+0000","last_active":"2024-09-15T23:55:15.637959+0000","last_peered":"2024-09-15T23:55:15.637959+0000","last_clean":"2024-09-15T23:55:15.637959+0000","last_became_active":"2024-09-15T23:55:12.695680+0000","last_became_peered":"2024-09-15T23:55:12.695680+0000","last_unstale":"2024-09-15T23:55:15.637959+0000","last_undegraded":"2024-09-15T23:55:15.637959+0000","last_fullsized":"2024-09-15T23:55:15.637959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:08.657505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683561+0000","last_change":"2024-09-15T23:55:11.684947+0000","last_active":"2024-09-15T23:55:13.683561+0000","last_peered":"2024-09-15T23:55:13.683561+0000","last_clean":"2024-09-15T23:55:13.683561+0000","last_became_active":"2024-09-15T23:55:11.684524+0000","last_became_peered":"2024-09-15T23:55:11.684524+0000","last_unstale":"2024-09-15T23:55:13.683561+0000","last_undegraded":"2024-09-15T23:55:13.683561+0000","last_fullsized":"2024-09-15T23:55:13.683561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683670+0000","last_change":"2024-09-15T23:55:12.692510+0000","last_active":"2024-09-15T23:55:13.683670+0000","last_peered":"2024-09-15T23:55:13.683670+0000","last_clean":"2024-09-15T23:55:13.683670+0000","last_became_active":"2024-09-15T23:55:12.692271+0000","last_became_peered":"2024-09-15T23:55:12.692271+0000","last_unstale":"2024-09-15T23:55:13.683670+0000","last_undegraded":"2024-09-15T23:55:13.683670+0000","last_fullsized":"2024-09-15T23:55:13.683670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:29.261729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686543+0000","last_change":"2024-09-15T23:55:11.689697+0000","last_active":"2024-09-15T23:55:13.686543+0000","last_peered":"2024-09-15T23:55:13.686543+0000","last_clean":"2024-09-15T23:55:13.686543+0000","last_became_active":"2024-09-15T23:55:11.689121+0000","last_became_peered":"2024-09-15T23:55:11.689121+0000","last_unstale":"2024-09-15T23:55:13.686543+0000","last_undegraded":"2024-09-15T23:55:13.686543+0000","last_fullsized":"2024-09-15T23:55:13.686543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686441+0000","last_change":"2024-09-15T23:55:12.690608+0000","last_active":"2024-09-15T23:55:13.686441+0000","last_peered":"2024-09-15T23:55:13.686441+0000","last_clean":"2024-09-15T23:55:13.686441+0000","last_became_active":"2024-09-15T23:55:12.690352+0000","last_became_peered":"2024-09-15T23:55:12.690352+0000","last_unstale":"2024-09-15T23:55:13.686441+0000","last_undegraded":"2024-09-15T23:55:13.686441+0000","last_fullsized":"2024-09-15T23:55:13.686441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:04.611155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637588+0000","last_change":"2024-09-15T23:55:11.685728+0000","last_active":"2024-09-15T23:55:15.637588+0000","last_peered":"2024-09-15T23:55:15.637588+0000","last_clean":"2024-09-15T23:55:15.637588+0000","last_became_active":"2024-09-15T23:55:11.685469+0000","last_became_peered":"2024-09-15T23:55:11.685469+0000","last_unstale":"2024-09-15T23:55:15.637588+0000","last_undegraded":"2024-09-15T23:55:15.637588+0000","last_fullsized":"2024-09-15T23:55:15.637588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:25.521672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683092+0000","last_change":"2024-09-15T23:55:12.697521+0000","last_active":"2024-09-15T23:55:13.683092+0000","last_peered":"2024-09-15T23:55:13.683092+0000","last_clean":"2024-09-15T23:55:13.683092+0000","last_became_active":"2024-09-15T23:55:12.694852+0000","last_became_peered":"2024-09-15T23:55:12.694852+0000","last_unstale":"2024-09-15T23:55:13.683092+0000","last_undegraded":"2024-09-15T23:55:13.683092+0000","last_fullsized":"2024-09-15T23:55:13.683092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:08.494222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683755+0000","last_change":"2024-09-15T23:55:11.687469+0000","last_active":"2024-09-15T23:55:13.683755+0000","last_peered":"2024-09-15T23:55:13.683755+0000","last_clean":"2024-09-15T23:55:13.683755+0000","last_became_active":"2024-09-15T23:55:11.687140+0000","last_became_peered":"2024-09-15T23:55:11.687140+0000","last_unstale":"2024-09-15T23:55:13.683755+0000","last_undegraded":"2024-09-15T23:55:13.683755+0000","last_fullsized":"2024-09-15T23:55:13.683755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683333+0000","last_change":"2024-09-15T23:55:12.694577+0000","last_active":"2024-09-15T23:55:13.683333+0000","last_peered":"2024-09-15T23:55:13.683333+0000","last_clean":"2024-09-15T23:55:13.683333+0000","last_became_active":"2024-09-15T23:55:12.693352+0000","last_became_peered":"2024-09-15T23:55:12.693352+0000","last_unstale":"2024-09-15T23:55:13.683333+0000","last_undegraded":"2024-09-15T23:55:13.683333+0000","last_fullsized":"2024-09-15T23:55:13.683333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.036005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637659+0000","last_change":"2024-09-15T23:55:11.686342+0000","last_active":"2024-09-15T23:55:15.637659+0000","last_peered":"2024-09-15T23:55:15.637659+0000","last_clean":"2024-09-15T23:55:15.637659+0000","last_became_active":"2024-09-15T23:55:11.686052+0000","last_became_peered":"2024-09-15T23:55:11.686052+0000","last_unstale":"2024-09-15T23:55:15.637659+0000","last_undegraded":"2024-09-15T23:55:15.637659+0000","last_fullsized":"2024-09-15T23:55:15.637659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:50.303621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686164+0000","last_change":"2024-09-15T23:55:12.699612+0000","last_active":"2024-09-15T23:55:13.686164+0000","last_peered":"2024-09-15T23:55:13.686164+0000","last_clean":"2024-09-15T23:55:13.686164+0000","last_became_active":"2024-09-15T23:55:12.699166+0000","last_became_peered":"2024-09-15T23:55:12.699166+0000","last_unstale":"2024-09-15T23:55:13.686164+0000","last_undegraded":"2024-09-15T23:55:13.686164+0000","last_fullsized":"2024-09-15T23:55:13.686164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:59.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682946+0000","last_change":"2024-09-15T23:55:11.685669+0000","last_active":"2024-09-15T23:55:13.682946+0000","last_peered":"2024-09-15T23:55:13.682946+0000","last_clean":"2024-09-15T23:55:13.682946+0000","last_became_active":"2024-09-15T23:55:11.685404+0000","last_became_peered":"2024-09-15T23:55:11.685404+0000","last_unstale":"2024-09-15T23:55:13.682946+0000","last_undegraded":"2024-09-15T23:55:13.682946+0000","last_fullsized":"2024-09-15T23:55:13.682946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.685822+0000","last_change":"2024-09-15T23:55:12.706980+0000","last_active":"2024-09-15T23:55:13.685822+0000","last_peered":"2024-09-15T23:55:13.685822+0000","last_clean":"2024-09-15T23:55:13.685822+0000","last_became_active":"2024-09-15T23:55:12.706336+0000","last_became_peered":"2024-09-15T23:55:12.706336+0000","last_unstale":"2024-09-15T23:55:13.685822+0000","last_undegraded":"2024-09-15T23:55:13.685822+0000","last_fullsized":"2024-09-15T23:55:13.685822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:06.699466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638050+0000","last_change":"2024-09-15T23:55:11.690815+0000","last_active":"2024-09-15T23:55:15.638050+0000","last_peered":"2024-09-15T23:55:15.638050+0000","last_clean":"2024-09-15T23:55:15.638050+0000","last_became_active":"2024-09-15T23:55:11.690538+0000","last_became_peered":"2024-09-15T23:55:11.690538+0000","last_unstale":"2024-09-15T23:55:15.638050+0000","last_undegraded":"2024-09-15T23:55:15.638050+0000","last_fullsized":"2024-09-15T23:55:15.638050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:34.734800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637361+0000","last_change":"2024-09-15T23:55:12.705659+0000","last_active":"2024-09-15T23:55:15.637361+0000","last_peered":"2024-09-15T23:55:15.637361+0000","last_clean":"2024-09-15T23:55:15.637361+0000","last_became_active":"2024-09-15T23:55:12.705408+0000","last_became_peered":"2024-09-15T23:55:12.705408+0000","last_unstale":"2024-09-15T23:55:15.637361+0000","last_undegraded":"2024-09-15T23:55:15.637361+0000","last_fullsized":"2024-09-15T23:55:15.637361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.129649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684101+0000","last_change":"2024-09-15T23:55:11.685486+0000","last_active":"2024-09-15T23:55:13.684101+0000","last_peered":"2024-09-15T23:55:13.684101+0000","last_clean":"2024-09-15T23:55:13.684101+0000","last_became_active":"2024-09-15T23:55:11.685191+0000","last_became_peered":"2024-09-15T23:55:11.685191+0000","last_unstale":"2024-09-15T23:55:13.684101+0000","last_undegraded":"2024-09-15T23:55:13.684101+0000","last_fullsized":"2024-09-15T23:55:13.684101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638090+0000","last_change":"2024-09-15T23:55:12.710015+0000","last_active":"2024-09-15T23:55:15.638090+0000","last_peered":"2024-09-15T23:55:15.638090+0000","last_clean":"2024-09-15T23:55:15.638090+0000","last_became_active":"2024-09-15T23:55:12.709501+0000","last_became_peered":"2024-09-15T23:55:12.709501+0000","last_unstale":"2024-09-15T23:55:15.638090+0000","last_undegraded":"2024-09-15T23:55:15.638090+0000","last_fullsized":"2024-09-15T23:55:15.638090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.459498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638156+0000","last_change":"2024-09-15T23:55:11.690840+0000","last_active":"2024-09-15T23:55:15.638156+0000","last_peered":"2024-09-15T23:55:15.638156+0000","last_clean":"2024-09-15T23:55:15.638156+0000","last_became_active":"2024-09-15T23:55:11.690562+0000","last_became_peered":"2024-09-15T23:55:11.690562+0000","last_unstale":"2024-09-15T23:55:15.638156+0000","last_undegraded":"2024-09-15T23:55:15.638156+0000","last_fullsized":"2024-09-15T23:55:15.638156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:05.205328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683711+0000","last_change":"2024-09-15T23:55:12.697590+0000","last_active":"2024-09-15T23:55:13.683711+0000","last_peered":"2024-09-15T23:55:13.683711+0000","last_clean":"2024-09-15T23:55:13.683711+0000","last_became_active":"2024-09-15T23:55:12.697210+0000","last_became_peered":"2024-09-15T23:55:12.697210+0000","last_unstale":"2024-09-15T23:55:13.683711+0000","last_undegraded":"2024-09-15T23:55:13.683711+0000","last_fullsized":"2024-09-15T23:55:13.683711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.915748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686679+0000","last_change":"2024-09-15T23:55:11.680934+0000","last_active":"2024-09-15T23:55:13.686679+0000","last_peered":"2024-09-15T23:55:13.686679+0000","last_clean":"2024-09-15T23:55:13.686679+0000","last_became_active":"2024-09-15T23:55:11.679943+0000","last_became_peered":"2024-09-15T23:55:11.679943+0000","last_unstale":"2024-09-15T23:55:13.686679+0000","last_undegraded":"2024-09-15T23:55:13.686679+0000","last_fullsized":"2024-09-15T23:55:13.686679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683047+0000","last_change":"2024-09-15T23:55:12.697768+0000","last_active":"2024-09-15T23:55:13.683047+0000","last_peered":"2024-09-15T23:55:13.683047+0000","last_clean":"2024-09-15T23:55:13.683047+0000","last_became_active":"2024-09-15T23:55:12.696964+0000","last_became_peered":"2024-09-15T23:55:12.696964+0000","last_unstale":"2024-09-15T23:55:13.683047+0000","last_undegraded":"2024-09-15T23:55:13.683047+0000","last_fullsized":"2024-09-15T23:55:13.683047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:41.449600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637668+0000","last_change":"2024-09-15T23:55:11.689063+0000","last_active":"2024-09-15T23:55:15.637668+0000","last_peered":"2024-09-15T23:55:15.637668+0000","last_clean":"2024-09-15T23:55:15.637668+0000","last_became_active":"2024-09-15T23:55:11.688818+0000","last_became_peered":"2024-09-15T23:55:11.688818+0000","last_unstale":"2024-09-15T23:55:15.637668+0000","last_undegraded":"2024-09-15T23:55:15.637668+0000","last_fullsized":"2024-09-15T23:55:15.637668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:11.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686364+0000","last_change":"2024-09-15T23:55:12.694288+0000","last_active":"2024-09-15T23:55:13.686364+0000","last_peered":"2024-09-15T23:55:13.686364+0000","last_clean":"2024-09-15T23:55:13.686364+0000","last_became_active":"2024-09-15T23:55:12.693688+0000","last_became_peered":"2024-09-15T23:55:12.693688+0000","last_unstale":"2024-09-15T23:55:13.686364+0000","last_undegraded":"2024-09-15T23:55:13.686364+0000","last_fullsized":"2024-09-15T23:55:13.686364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:32.130285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":147,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686434+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:13.686434+0000","last_peered":"2024-09-15T23:55:13.686434+0000","last_clean":"2024-09-15T23:55:13.686434+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:13.686434+0000","last_undegraded":"2024-09-15T23:55:13.686434+0000","last_fullsized":"2024-09-15T23:55:13.686434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686402+0000","last_change":"2024-09-15T23:55:11.684064+0000","last_active":"2024-09-15T23:55:13.686402+0000","last_peered":"2024-09-15T23:55:13.686402+0000","last_clean":"2024-09-15T23:55:13.686402+0000","last_became_active":"2024-09-15T23:55:11.683537+0000","last_became_peered":"2024-09-15T23:55:11.683537+0000","last_unstale":"2024-09-15T23:55:13.686402+0000","last_undegraded":"2024-09-15T23:55:13.686402+0000","last_fullsized":"2024-09-15T23:55:13.686402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686534+0000","last_change":"2024-09-15T23:55:12.690740+0000","last_active":"2024-09-15T23:55:13.686534+0000","last_peered":"2024-09-15T23:55:13.686534+0000","last_clean":"2024-09-15T23:55:13.686534+0000","last_became_active":"2024-09-15T23:55:12.690500+0000","last_became_peered":"2024-09-15T23:55:12.690500+0000","last_unstale":"2024-09-15T23:55:13.686534+0000","last_undegraded":"2024-09-15T23:55:13.686534+0000","last_fullsized":"2024-09-15T23:55:13.686534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:09.860747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638076+0000","last_change":"2024-09-15T23:55:11.691560+0000","last_active":"2024-09-15T23:55:15.638076+0000","last_peered":"2024-09-15T23:55:15.638076+0000","last_clean":"2024-09-15T23:55:15.638076+0000","last_became_active":"2024-09-15T23:55:11.691111+0000","last_became_peered":"2024-09-15T23:55:11.691111+0000","last_unstale":"2024-09-15T23:55:15.638076+0000","last_undegraded":"2024-09-15T23:55:15.638076+0000","last_fullsized":"2024-09-15T23:55:15.638076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:40.745603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682610+0000","last_change":"2024-09-15T23:55:12.692568+0000","last_active":"2024-09-15T23:55:13.682610+0000","last_peered":"2024-09-15T23:55:13.682610+0000","last_clean":"2024-09-15T23:55:13.682610+0000","last_became_active":"2024-09-15T23:55:12.692021+0000","last_became_peered":"2024-09-15T23:55:12.692021+0000","last_unstale":"2024-09-15T23:55:13.682610+0000","last_undegraded":"2024-09-15T23:55:13.682610+0000","last_fullsized":"2024-09-15T23:55:13.682610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:37.381027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637502+0000","last_change":"2024-09-15T23:55:11.686567+0000","last_active":"2024-09-15T23:55:15.637502+0000","last_peered":"2024-09-15T23:55:15.637502+0000","last_clean":"2024-09-15T23:55:15.637502+0000","last_became_active":"2024-09-15T23:55:11.686326+0000","last_became_peered":"2024-09-15T23:55:11.686326+0000","last_unstale":"2024-09-15T23:55:15.637502+0000","last_undegraded":"2024-09-15T23:55:15.637502+0000","last_fullsized":"2024-09-15T23:55:15.637502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686671+0000","last_change":"2024-09-15T23:55:12.684331+0000","last_active":"2024-09-15T23:55:13.686671+0000","last_peered":"2024-09-15T23:55:13.686671+0000","last_clean":"2024-09-15T23:55:13.686671+0000","last_became_active":"2024-09-15T23:55:12.684077+0000","last_became_peered":"2024-09-15T23:55:12.684077+0000","last_unstale":"2024-09-15T23:55:13.686671+0000","last_undegraded":"2024-09-15T23:55:13.686671+0000","last_fullsized":"2024-09-15T23:55:13.686671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:23.918922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683435+0000","last_change":"2024-09-15T23:55:11.681692+0000","last_active":"2024-09-15T23:55:13.683435+0000","last_peered":"2024-09-15T23:55:13.683435+0000","last_clean":"2024-09-15T23:55:13.683435+0000","last_became_active":"2024-09-15T23:55:11.681438+0000","last_became_peered":"2024-09-15T23:55:11.681438+0000","last_unstale":"2024-09-15T23:55:13.683435+0000","last_undegraded":"2024-09-15T23:55:13.683435+0000","last_fullsized":"2024-09-15T23:55:13.683435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683651+0000","last_change":"2024-09-15T23:55:12.689132+0000","last_active":"2024-09-15T23:55:13.683651+0000","last_peered":"2024-09-15T23:55:13.683651+0000","last_clean":"2024-09-15T23:55:13.683651+0000","last_became_active":"2024-09-15T23:55:12.688172+0000","last_became_peered":"2024-09-15T23:55:12.688172+0000","last_unstale":"2024-09-15T23:55:13.683651+0000","last_undegraded":"2024-09-15T23:55:13.683651+0000","last_fullsized":"2024-09-15T23:55:13.683651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:30.701458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686536+0000","last_change":"2024-09-15T23:55:11.690745+0000","last_active":"2024-09-15T23:55:13.686536+0000","last_peered":"2024-09-15T23:55:13.686536+0000","last_clean":"2024-09-15T23:55:13.686536+0000","last_became_active":"2024-09-15T23:55:11.690190+0000","last_became_peered":"2024-09-15T23:55:11.690190+0000","last_unstale":"2024-09-15T23:55:13.686536+0000","last_undegraded":"2024-09-15T23:55:13.686536+0000","last_fullsized":"2024-09-15T23:55:13.686536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638089+0000","last_change":"2024-09-15T23:55:12.702288+0000","last_active":"2024-09-15T23:55:15.638089+0000","last_peered":"2024-09-15T23:55:15.638089+0000","last_clean":"2024-09-15T23:55:15.638089+0000","last_became_active":"2024-09-15T23:55:12.701837+0000","last_became_peered":"2024-09-15T23:55:12.701837+0000","last_unstale":"2024-09-15T23:55:15.638089+0000","last_undegraded":"2024-09-15T23:55:15.638089+0000","last_fullsized":"2024-09-15T23:55:15.638089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:54.387948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686745+0000","last_change":"2024-09-15T23:55:11.689383+0000","last_active":"2024-09-15T23:55:13.686745+0000","last_peered":"2024-09-15T23:55:13.686745+0000","last_clean":"2024-09-15T23:55:13.686745+0000","last_became_active":"2024-09-15T23:55:11.688499+0000","last_became_peered":"2024-09-15T23:55:11.688499+0000","last_unstale":"2024-09-15T23:55:13.686745+0000","last_undegraded":"2024-09-15T23:55:13.686745+0000","last_fullsized":"2024-09-15T23:55:13.686745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686599+0000","last_change":"2024-09-15T23:55:12.683877+0000","last_active":"2024-09-15T23:55:13.686599+0000","last_peered":"2024-09-15T23:55:13.686599+0000","last_clean":"2024-09-15T23:55:13.686599+0000","last_became_active":"2024-09-15T23:55:12.683590+0000","last_became_peered":"2024-09-15T23:55:12.683590+0000","last_unstale":"2024-09-15T23:55:13.686599+0000","last_undegraded":"2024-09-15T23:55:13.686599+0000","last_fullsized":"2024-09-15T23:55:13.686599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:59.271320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686584+0000","last_change":"2024-09-15T23:55:11.691447+0000","last_active":"2024-09-15T23:55:13.686584+0000","last_peered":"2024-09-15T23:55:13.686584+0000","last_clean":"2024-09-15T23:55:13.686584+0000","last_became_active":"2024-09-15T23:55:11.691128+0000","last_became_peered":"2024-09-15T23:55:11.691128+0000","last_unstale":"2024-09-15T23:55:13.686584+0000","last_undegraded":"2024-09-15T23:55:13.686584+0000","last_fullsized":"2024-09-15T23:55:13.686584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637842+0000","last_change":"2024-09-15T23:55:12.704420+0000","last_active":"2024-09-15T23:55:15.637842+0000","last_peered":"2024-09-15T23:55:15.637842+0000","last_clean":"2024-09-15T23:55:15.637842+0000","last_became_active":"2024-09-15T23:55:12.704171+0000","last_became_peered":"2024-09-15T23:55:12.704171+0000","last_unstale":"2024-09-15T23:55:15.637842+0000","last_undegraded":"2024-09-15T23:55:15.637842+0000","last_fullsized":"2024-09-15T23:55:15.637842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687278+0000","last_change":"2024-09-15T23:55:11.689361+0000","last_active":"2024-09-15T23:55:13.687278+0000","last_peered":"2024-09-15T23:55:13.687278+0000","last_clean":"2024-09-15T23:55:13.687278+0000","last_became_active":"2024-09-15T23:55:11.688414+0000","last_became_peered":"2024-09-15T23:55:11.688414+0000","last_unstale":"2024-09-15T23:55:13.687278+0000","last_undegraded":"2024-09-15T23:55:13.687278+0000","last_fullsized":"2024-09-15T23:55:13.687278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683482+0000","last_change":"2024-09-15T23:55:12.688327+0000","last_active":"2024-09-15T23:55:13.683482+0000","last_peered":"2024-09-15T23:55:13.683482+0000","last_clean":"2024-09-15T23:55:13.683482+0000","last_became_active":"2024-09-15T23:55:12.688057+0000","last_became_peered":"2024-09-15T23:55:12.688057+0000","last_unstale":"2024-09-15T23:55:13.683482+0000","last_undegraded":"2024-09-15T23:55:13.683482+0000","last_fullsized":"2024-09-15T23:55:13.683482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:22.743163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682543+0000","last_change":"2024-09-15T23:55:11.685621+0000","last_active":"2024-09-15T23:55:13.682543+0000","last_peered":"2024-09-15T23:55:13.682543+0000","last_clean":"2024-09-15T23:55:13.682543+0000","last_became_active":"2024-09-15T23:55:11.685362+0000","last_became_peered":"2024-09-15T23:55:11.685362+0000","last_unstale":"2024-09-15T23:55:13.682543+0000","last_undegraded":"2024-09-15T23:55:13.682543+0000","last_fullsized":"2024-09-15T23:55:13.682543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682446+0000","last_change":"2024-09-15T23:55:12.693033+0000","last_active":"2024-09-15T23:55:13.682446+0000","last_peered":"2024-09-15T23:55:13.682446+0000","last_clean":"2024-09-15T23:55:13.682446+0000","last_became_active":"2024-09-15T23:55:12.692321+0000","last_became_peered":"2024-09-15T23:55:12.692321+0000","last_unstale":"2024-09-15T23:55:13.682446+0000","last_undegraded":"2024-09-15T23:55:13.682446+0000","last_fullsized":"2024-09-15T23:55:13.682446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:59.271320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686169+0000","last_change":"2024-09-15T23:55:11.689154+0000","last_active":"2024-09-15T23:55:13.686169+0000","last_peered":"2024-09-15T23:55:13.686169+0000","last_clean":"2024-09-15T23:55:13.686169+0000","last_became_active":"2024-09-15T23:55:11.688854+0000","last_became_peered":"2024-09-15T23:55:11.688854+0000","last_unstale":"2024-09-15T23:55:13.686169+0000","last_undegraded":"2024-09-15T23:55:13.686169+0000","last_fullsized":"2024-09-15T23:55:13.686169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637918+0000","last_change":"2024-09-15T23:55:12.705007+0000","last_active":"2024-09-15T23:55:15.637918+0000","last_peered":"2024-09-15T23:55:15.637918+0000","last_clean":"2024-09-15T23:55:15.637918+0000","last_became_active":"2024-09-15T23:55:12.704753+0000","last_became_peered":"2024-09-15T23:55:12.704753+0000","last_unstale":"2024-09-15T23:55:15.637918+0000","last_undegraded":"2024-09-15T23:55:15.637918+0000","last_fullsized":"2024-09-15T23:55:15.637918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:36.635728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686172+0000","last_change":"2024-09-15T23:55:11.689771+0000","last_active":"2024-09-15T23:55:13.686172+0000","last_peered":"2024-09-15T23:55:13.686172+0000","last_clean":"2024-09-15T23:55:13.686172+0000","last_became_active":"2024-09-15T23:55:11.689083+0000","last_became_peered":"2024-09-15T23:55:11.689083+0000","last_unstale":"2024-09-15T23:55:13.686172+0000","last_undegraded":"2024-09-15T23:55:13.686172+0000","last_fullsized":"2024-09-15T23:55:13.686172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686302+0000","last_change":"2024-09-15T23:55:12.699401+0000","last_active":"2024-09-15T23:55:13.686302+0000","last_peered":"2024-09-15T23:55:13.686302+0000","last_clean":"2024-09-15T23:55:13.686302+0000","last_became_active":"2024-09-15T23:55:12.698873+0000","last_became_peered":"2024-09-15T23:55:12.698873+0000","last_unstale":"2024-09-15T23:55:13.686302+0000","last_undegraded":"2024-09-15T23:55:13.686302+0000","last_fullsized":"2024-09-15T23:55:13.686302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684166+0000","last_change":"2024-09-15T23:55:11.683719+0000","last_active":"2024-09-15T23:55:13.684166+0000","last_peered":"2024-09-15T23:55:13.684166+0000","last_clean":"2024-09-15T23:55:13.684166+0000","last_became_active":"2024-09-15T23:55:11.682811+0000","last_became_peered":"2024-09-15T23:55:11.682811+0000","last_unstale":"2024-09-15T23:55:13.684166+0000","last_undegraded":"2024-09-15T23:55:13.684166+0000","last_fullsized":"2024-09-15T23:55:13.684166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683350+0000","last_change":"2024-09-15T23:55:12.694426+0000","last_active":"2024-09-15T23:55:13.683350+0000","last_peered":"2024-09-15T23:55:13.683350+0000","last_clean":"2024-09-15T23:55:13.683350+0000","last_became_active":"2024-09-15T23:55:12.693056+0000","last_became_peered":"2024-09-15T23:55:12.693056+0000","last_unstale":"2024-09-15T23:55:13.683350+0000","last_undegraded":"2024-09-15T23:55:13.683350+0000","last_fullsized":"2024-09-15T23:55:13.683350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:15.056593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637972+0000","last_change":"2024-09-15T23:55:12.702080+0000","last_active":"2024-09-15T23:55:15.637972+0000","last_peered":"2024-09-15T23:55:15.637972+0000","last_clean":"2024-09-15T23:55:15.637972+0000","last_became_active":"2024-09-15T23:55:12.701497+0000","last_became_peered":"2024-09-15T23:55:12.701497+0000","last_unstale":"2024-09-15T23:55:15.637972+0000","last_undegraded":"2024-09-15T23:55:15.637972+0000","last_fullsized":"2024-09-15T23:55:15.637972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:52.542412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683148+0000","last_change":"2024-09-15T23:55:11.682360+0000","last_active":"2024-09-15T23:55:13.683148+0000","last_peered":"2024-09-15T23:55:13.683148+0000","last_clean":"2024-09-15T23:55:13.683148+0000","last_became_active":"2024-09-15T23:55:11.682073+0000","last_became_peered":"2024-09-15T23:55:11.682073+0000","last_unstale":"2024-09-15T23:55:13.683148+0000","last_undegraded":"2024-09-15T23:55:13.683148+0000","last_fullsized":"2024-09-15T23:55:13.683148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:07.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686400+0000","last_change":"2024-09-15T23:55:12.700670+0000","last_active":"2024-09-15T23:55:13.686400+0000","last_peered":"2024-09-15T23:55:13.686400+0000","last_clean":"2024-09-15T23:55:13.686400+0000","last_became_active":"2024-09-15T23:55:12.699711+0000","last_became_peered":"2024-09-15T23:55:12.699711+0000","last_unstale":"2024-09-15T23:55:13.686400+0000","last_undegraded":"2024-09-15T23:55:13.686400+0000","last_fullsized":"2024-09-15T23:55:13.686400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:28.197430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683890+0000","last_change":"2024-09-15T23:55:11.693722+0000","last_active":"2024-09-15T23:55:13.683890+0000","last_peered":"2024-09-15T23:55:13.683890+0000","last_clean":"2024-09-15T23:55:13.683890+0000","last_became_active":"2024-09-15T23:55:11.693487+0000","last_became_peered":"2024-09-15T23:55:11.693487+0000","last_unstale":"2024-09-15T23:55:13.683890+0000","last_undegraded":"2024-09-15T23:55:13.683890+0000","last_fullsized":"2024-09-15T23:55:13.683890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683541+0000","last_change":"2024-09-15T23:55:12.689223+0000","last_active":"2024-09-15T23:55:13.683541+0000","last_peered":"2024-09-15T23:55:13.683541+0000","last_clean":"2024-09-15T23:55:13.683541+0000","last_became_active":"2024-09-15T23:55:12.688397+0000","last_became_peered":"2024-09-15T23:55:12.688397+0000","last_unstale":"2024-09-15T23:55:13.683541+0000","last_undegraded":"2024-09-15T23:55:13.683541+0000","last_fullsized":"2024-09-15T23:55:13.683541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.662577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638062+0000","last_change":"2024-09-15T23:55:11.691511+0000","last_active":"2024-09-15T23:55:15.638062+0000","last_peered":"2024-09-15T23:55:15.638062+0000","last_clean":"2024-09-15T23:55:15.638062+0000","last_became_active":"2024-09-15T23:55:11.690348+0000","last_became_peered":"2024-09-15T23:55:11.690348+0000","last_unstale":"2024-09-15T23:55:15.638062+0000","last_undegraded":"2024-09-15T23:55:15.638062+0000","last_fullsized":"2024-09-15T23:55:15.638062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.969491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637941+0000","last_change":"2024-09-15T23:55:12.696145+0000","last_active":"2024-09-15T23:55:15.637941+0000","last_peered":"2024-09-15T23:55:15.637941+0000","last_clean":"2024-09-15T23:55:15.637941+0000","last_became_active":"2024-09-15T23:55:12.695891+0000","last_became_peered":"2024-09-15T23:55:12.695891+0000","last_unstale":"2024-09-15T23:55:15.637941+0000","last_undegraded":"2024-09-15T23:55:15.637941+0000","last_fullsized":"2024-09-15T23:55:15.637941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.386037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683944+0000","last_change":"2024-09-15T23:55:11.686294+0000","last_active":"2024-09-15T23:55:13.683944+0000","last_peered":"2024-09-15T23:55:13.683944+0000","last_clean":"2024-09-15T23:55:13.683944+0000","last_became_active":"2024-09-15T23:55:11.685978+0000","last_became_peered":"2024-09-15T23:55:11.685978+0000","last_unstale":"2024-09-15T23:55:13.683944+0000","last_undegraded":"2024-09-15T23:55:13.683944+0000","last_fullsized":"2024-09-15T23:55:13.683944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":46624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":637652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":636004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:19.103 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:19.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.237+0000 7f0f83423640 1 Processor -- start 2024-09-15T23:55:19.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f83423640 1 -- start start 2024-09-15T23:55:19.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f83423640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f7c135b50 0x7f0f7c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f83423640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c09b020 con 0x7f0f7c135f30 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f83423640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c09b310 con 0x7f0f7c135b50 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f811bf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f7c135b50 0x7f0f7c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f811bf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f7c135b50 0x7f0f7c09aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55778/0 (socket says 172.21.15.121:55778) 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f809be640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0f7c135f30 0x7f0f7c0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45500/0 (socket says 172.21.15.121:45500) 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.238+0000 7f0f811bf640 1 -- 172.21.15.121:0/453985049 learned_addr learned my addr 172.21.15.121:0/453985049 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f811bf640 1 -- 172.21.15.121:0/453985049 >> v1:172.21.15.121:6789/0 conn(0x7f0f7c135f30 legacy=0x7f0f7c0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f811bf640 1 -- 172.21.15.121:0/453985049 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c0a08c0 con 0x7f0f7c135b50 2024-09-15T23:55:19.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f811bf640 1 --2- 172.21.15.121:0/453985049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c09aae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097f0 tx=0x7f0f7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceaf0aa5512992a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f6ffff640 1 -- 172.21.15.121:0/453985049 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78037070 con 0x7f0f7c135b50 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f6ffff640 1 -- 172.21.15.121:0/453985049 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78032440 con 0x7f0f7c135b50 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.239+0000 7f0f6ffff640 1 -- 172.21.15.121:0/453985049 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78032740 con 0x7f0f7c135b50 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 -- 172.21.15.121:0/453985049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 msgr2=0x7f0f7c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 --2- 172.21.15.121:0/453985049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c09aae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0f780097f0 tx=0x7f0f7802a270 comp rx=0 tx=0).stop 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 -- 172.21.15.121:0/453985049 shutdown_connections 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 --2- 172.21.15.121:0/453985049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c09aae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 -- 172.21.15.121:0/453985049 >> 172.21.15.121:0/453985049 conn(0x7f0f7c0a85e0 msgr2=0x7f0f7c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 -- 172.21.15.121:0/453985049 shutdown_connections 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.240+0000 7f0f83423640 1 -- 172.21.15.121:0/453985049 wait complete. 2024-09-15T23:55:19.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f83423640 1 Processor -- start 2024-09-15T23:55:19.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f83423640 1 -- start start 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f83423640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f83423640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0a5430 con 0x7f0f7c135b50 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f811bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f811bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55782/0 (socket says 172.21.15.121:55782) 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.241+0000 7f0f811bf640 1 -- 172.21.15.121:0/1380613881 learned_addr learned my addr 172.21.15.121:0/1380613881 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f811bf640 1 -- 172.21.15.121:0/1380613881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c123840 con 0x7f0f7c135b50 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f811bf640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f78035040 tx=0x7f0f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78041020 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f780306c0 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c1243d0 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78037040 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.242+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c121a00 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.243+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0f78044020 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.243+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c136350 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.243+0000 7f0f6dffb640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 0x7f0f6003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.243+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f0f7806bbf0 con 0x7f0f7c135b50 2024-09-15T23:55:19.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.243+0000 7f0f809be640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 0x7f0f6003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.244+0000 7f0f809be640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 0x7f0f6003a760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f700015f0 tx=0x7f0f70007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.248+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f7804b030 con 0x7f0f7c135b50 2024-09-15T23:55:19.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.409+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f7c0a1f10 con 0x7f0f600382a0 2024-09-15T23:55:19.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.414+0000 7f0f6dffb640 1 -- 172.21.15.121:0/1380613881 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245915 (secure 0 0 0) 0x7f0f7c0a1f10 con 0x7f0f600382a0 2024-09-15T23:55:19.418 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:19.419 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:19.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 msgr2=0x7f0f6003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 0x7f0f6003a760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f700015f0 tx=0x7f0f70007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:19.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 msgr2=0x7f0f7c11fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f78035040 tx=0x7f0f780046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 shutdown_connections 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0f600382a0 0x7f0f6003a760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 --2- 172.21.15.121:0/1380613881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f7c135b50 0x7f0f7c11fd60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 >> 172.21.15.121:0/1380613881 conn(0x7f0f7c0a85e0 msgr2=0x7f0f7c0a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 shutdown_connections 2024-09-15T23:55:19.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.418+0000 7f0f83423640 1 -- 172.21.15.121:0/1380613881 wait complete. 2024-09-15T23:55:19.429 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T23:55:18.024595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82744,"kb_used_data":1656,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032776,"statfs":{"total":289910292480,"available":289825562624,"internally_reserved":0,"allocated":1695744,"data_stored":1320280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":82963791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.362384"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683414+0000","last_change":"2024-09-15T23:55:12.689010+0000","last_active":"2024-09-15T23:55:13.683414+0000","last_peered":"2024-09-15T23:55:13.683414+0000","last_clean":"2024-09-15T23:55:13.683414+0000","last_became_active":"2024-09-15T23:55:12.688116+0000","last_became_peered":"2024-09-15T23:55:12.688116+0000","last_unstale":"2024-09-15T23:55:13.683414+0000","last_undegraded":"2024-09-15T23:55:13.683414+0000","last_fullsized":"2024-09-15T23:55:13.683414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:51.099276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686456+0000","last_change":"2024-09-15T23:55:12.691799+0000","last_active":"2024-09-15T23:55:13.686456+0000","last_peered":"2024-09-15T23:55:13.686456+0000","last_clean":"2024-09-15T23:55:13.686456+0000","last_became_active":"2024-09-15T23:55:12.691528+0000","last_became_peered":"2024-09-15T23:55:12.691528+0000","last_unstale":"2024-09-15T23:55:13.686456+0000","last_undegraded":"2024-09-15T23:55:13.686456+0000","last_fullsized":"2024-09-15T23:55:13.686456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:02.111895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683747+0000","last_change":"2024-09-15T23:55:12.698265+0000","last_active":"2024-09-15T23:55:13.683747+0000","last_peered":"2024-09-15T23:55:13.683747+0000","last_clean":"2024-09-15T23:55:13.683747+0000","last_became_active":"2024-09-15T23:55:12.696115+0000","last_became_peered":"2024-09-15T23:55:12.696115+0000","last_unstale":"2024-09-15T23:55:13.683747+0000","last_undegraded":"2024-09-15T23:55:13.683747+0000","last_fullsized":"2024-09-15T23:55:13.683747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:47.238303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637574+0000","last_change":"2024-09-15T23:55:12.708793+0000","last_active":"2024-09-15T23:55:15.637574+0000","last_peered":"2024-09-15T23:55:15.637574+0000","last_clean":"2024-09-15T23:55:15.637574+0000","last_became_active":"2024-09-15T23:55:12.708546+0000","last_became_peered":"2024-09-15T23:55:12.708546+0000","last_unstale":"2024-09-15T23:55:15.637574+0000","last_undegraded":"2024-09-15T23:55:15.637574+0000","last_fullsized":"2024-09-15T23:55:15.637574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:50.224153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683799+0000","last_change":"2024-09-15T23:55:12.689949+0000","last_active":"2024-09-15T23:55:13.683799+0000","last_peered":"2024-09-15T23:55:13.683799+0000","last_clean":"2024-09-15T23:55:13.683799+0000","last_became_active":"2024-09-15T23:55:12.689502+0000","last_became_peered":"2024-09-15T23:55:12.689502+0000","last_unstale":"2024-09-15T23:55:13.683799+0000","last_undegraded":"2024-09-15T23:55:13.683799+0000","last_fullsized":"2024-09-15T23:55:13.683799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:22.212299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637456+0000","last_change":"2024-09-15T23:55:12.710819+0000","last_active":"2024-09-15T23:55:15.637456+0000","last_peered":"2024-09-15T23:55:15.637456+0000","last_clean":"2024-09-15T23:55:15.637456+0000","last_became_active":"2024-09-15T23:55:12.709647+0000","last_became_peered":"2024-09-15T23:55:12.709647+0000","last_unstale":"2024-09-15T23:55:15.637456+0000","last_undegraded":"2024-09-15T23:55:15.637456+0000","last_fullsized":"2024-09-15T23:55:15.637456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:21.342380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682968+0000","last_change":"2024-09-15T23:55:12.683855+0000","last_active":"2024-09-15T23:55:13.682968+0000","last_peered":"2024-09-15T23:55:13.682968+0000","last_clean":"2024-09-15T23:55:13.682968+0000","last_became_active":"2024-09-15T23:55:12.683568+0000","last_became_peered":"2024-09-15T23:55:12.683568+0000","last_unstale":"2024-09-15T23:55:13.682968+0000","last_undegraded":"2024-09-15T23:55:13.682968+0000","last_fullsized":"2024-09-15T23:55:13.682968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:44.667913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637181+0000","last_change":"2024-09-15T23:55:12.712357+0000","last_active":"2024-09-15T23:55:15.637181+0000","last_peered":"2024-09-15T23:55:15.637181+0000","last_clean":"2024-09-15T23:55:15.637181+0000","last_became_active":"2024-09-15T23:55:12.711161+0000","last_became_peered":"2024-09-15T23:55:12.711161+0000","last_unstale":"2024-09-15T23:55:15.637181+0000","last_undegraded":"2024-09-15T23:55:15.637181+0000","last_fullsized":"2024-09-15T23:55:15.637181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:05.383190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687145+0000","last_change":"2024-09-15T23:55:12.698143+0000","last_active":"2024-09-15T23:55:13.687145+0000","last_peered":"2024-09-15T23:55:13.687145+0000","last_clean":"2024-09-15T23:55:13.687145+0000","last_became_active":"2024-09-15T23:55:12.697913+0000","last_became_peered":"2024-09-15T23:55:12.697913+0000","last_unstale":"2024-09-15T23:55:13.687145+0000","last_undegraded":"2024-09-15T23:55:13.687145+0000","last_fullsized":"2024-09-15T23:55:13.687145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:20.691068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683467+0000","last_change":"2024-09-15T23:55:12.691954+0000","last_active":"2024-09-15T23:55:13.683467+0000","last_peered":"2024-09-15T23:55:13.683467+0000","last_clean":"2024-09-15T23:55:13.683467+0000","last_became_active":"2024-09-15T23:55:12.691679+0000","last_became_peered":"2024-09-15T23:55:12.691679+0000","last_unstale":"2024-09-15T23:55:13.683467+0000","last_undegraded":"2024-09-15T23:55:13.683467+0000","last_fullsized":"2024-09-15T23:55:13.683467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:42.206893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682945+0000","last_change":"2024-09-15T23:55:12.697740+0000","last_active":"2024-09-15T23:55:13.682945+0000","last_peered":"2024-09-15T23:55:13.682945+0000","last_clean":"2024-09-15T23:55:13.682945+0000","last_became_active":"2024-09-15T23:55:12.695173+0000","last_became_peered":"2024-09-15T23:55:12.695173+0000","last_unstale":"2024-09-15T23:55:13.682945+0000","last_undegraded":"2024-09-15T23:55:13.682945+0000","last_fullsized":"2024-09-15T23:55:13.682945+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:46.138511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682871+0000","last_change":"2024-09-15T23:55:12.688930+0000","last_active":"2024-09-15T23:55:13.682871+0000","last_peered":"2024-09-15T23:55:13.682871+0000","last_clean":"2024-09-15T23:55:13.682871+0000","last_became_active":"2024-09-15T23:55:12.688599+0000","last_became_peered":"2024-09-15T23:55:12.688599+0000","last_unstale":"2024-09-15T23:55:13.682871+0000","last_undegraded":"2024-09-15T23:55:13.682871+0000","last_fullsized":"2024-09-15T23:55:13.682871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:55.648901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684268+0000","last_change":"2024-09-15T23:55:12.699041+0000","last_active":"2024-09-15T23:55:13.684268+0000","last_peered":"2024-09-15T23:55:13.684268+0000","last_clean":"2024-09-15T23:55:13.684268+0000","last_became_active":"2024-09-15T23:55:12.698719+0000","last_became_peered":"2024-09-15T23:55:12.698719+0000","last_unstale":"2024-09-15T23:55:13.684268+0000","last_undegraded":"2024-09-15T23:55:13.684268+0000","last_fullsized":"2024-09-15T23:55:13.684268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:37.689614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683214+0000","last_change":"2024-09-15T23:55:12.699903+0000","last_active":"2024-09-15T23:55:13.683214+0000","last_peered":"2024-09-15T23:55:13.683214+0000","last_clean":"2024-09-15T23:55:13.683214+0000","last_became_active":"2024-09-15T23:55:12.699658+0000","last_became_peered":"2024-09-15T23:55:12.699658+0000","last_unstale":"2024-09-15T23:55:13.683214+0000","last_undegraded":"2024-09-15T23:55:13.683214+0000","last_fullsized":"2024-09-15T23:55:13.683214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:03.909897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686075+0000","last_change":"2024-09-15T23:55:12.697628+0000","last_active":"2024-09-15T23:55:13.686075+0000","last_peered":"2024-09-15T23:55:13.686075+0000","last_clean":"2024-09-15T23:55:13.686075+0000","last_became_active":"2024-09-15T23:55:12.697376+0000","last_became_peered":"2024-09-15T23:55:12.697376+0000","last_unstale":"2024-09-15T23:55:13.686075+0000","last_undegraded":"2024-09-15T23:55:13.686075+0000","last_fullsized":"2024-09-15T23:55:13.686075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:09.986785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637212+0000","last_change":"2024-09-15T23:55:12.712697+0000","last_active":"2024-09-15T23:55:15.637212+0000","last_peered":"2024-09-15T23:55:15.637212+0000","last_clean":"2024-09-15T23:55:15.637212+0000","last_became_active":"2024-09-15T23:55:12.712204+0000","last_became_peered":"2024-09-15T23:55:12.712204+0000","last_unstale":"2024-09-15T23:55:15.637212+0000","last_undegraded":"2024-09-15T23:55:15.637212+0000","last_fullsized":"2024-09-15T23:55:15.637212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:41.814713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687277+0000","last_change":"2024-09-15T23:55:12.691645+0000","last_active":"2024-09-15T23:55:13.687277+0000","last_peered":"2024-09-15T23:55:13.687277+0000","last_clean":"2024-09-15T23:55:13.687277+0000","last_became_active":"2024-09-15T23:55:12.691220+0000","last_became_peered":"2024-09-15T23:55:12.691220+0000","last_unstale":"2024-09-15T23:55:13.687277+0000","last_undegraded":"2024-09-15T23:55:13.687277+0000","last_fullsized":"2024-09-15T23:55:13.687277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:37.381027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637777+0000","last_change":"2024-09-15T23:55:12.696986+0000","last_active":"2024-09-15T23:55:15.637777+0000","last_peered":"2024-09-15T23:55:15.637777+0000","last_clean":"2024-09-15T23:55:15.637777+0000","last_became_active":"2024-09-15T23:55:12.696708+0000","last_became_peered":"2024-09-15T23:55:12.696708+0000","last_unstale":"2024-09-15T23:55:15.637777+0000","last_undegraded":"2024-09-15T23:55:15.637777+0000","last_fullsized":"2024-09-15T23:55:15.637777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:22.386822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683885+0000","last_change":"2024-09-15T23:55:12.697966+0000","last_active":"2024-09-15T23:55:13.683885+0000","last_peered":"2024-09-15T23:55:13.683885+0000","last_clean":"2024-09-15T23:55:13.683885+0000","last_became_active":"2024-09-15T23:55:12.695494+0000","last_became_peered":"2024-09-15T23:55:12.695494+0000","last_unstale":"2024-09-15T23:55:13.683885+0000","last_undegraded":"2024-09-15T23:55:13.683885+0000","last_fullsized":"2024-09-15T23:55:13.683885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:05.385449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682911+0000","last_change":"2024-09-15T23:55:12.696664+0000","last_active":"2024-09-15T23:55:13.682911+0000","last_peered":"2024-09-15T23:55:13.682911+0000","last_clean":"2024-09-15T23:55:13.682911+0000","last_became_active":"2024-09-15T23:55:12.696407+0000","last_became_peered":"2024-09-15T23:55:12.696407+0000","last_unstale":"2024-09-15T23:55:13.682911+0000","last_undegraded":"2024-09-15T23:55:13.682911+0000","last_fullsized":"2024-09-15T23:55:13.682911+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:36.490912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682773+0000","last_change":"2024-09-15T23:55:12.686358+0000","last_active":"2024-09-15T23:55:13.682773+0000","last_peered":"2024-09-15T23:55:13.682773+0000","last_clean":"2024-09-15T23:55:13.682773+0000","last_became_active":"2024-09-15T23:55:12.685997+0000","last_became_peered":"2024-09-15T23:55:12.685997+0000","last_unstale":"2024-09-15T23:55:13.682773+0000","last_undegraded":"2024-09-15T23:55:13.682773+0000","last_fullsized":"2024-09-15T23:55:13.682773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:23.859752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686045+0000","last_change":"2024-09-15T23:55:12.700605+0000","last_active":"2024-09-15T23:55:13.686045+0000","last_peered":"2024-09-15T23:55:13.686045+0000","last_clean":"2024-09-15T23:55:13.686045+0000","last_became_active":"2024-09-15T23:55:12.700273+0000","last_became_peered":"2024-09-15T23:55:12.700273+0000","last_unstale":"2024-09-15T23:55:13.686045+0000","last_undegraded":"2024-09-15T23:55:13.686045+0000","last_fullsized":"2024-09-15T23:55:13.686045+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.347154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682467+0000","last_change":"2024-09-15T23:55:12.686146+0000","last_active":"2024-09-15T23:55:13.682467+0000","last_peered":"2024-09-15T23:55:13.682467+0000","last_clean":"2024-09-15T23:55:13.682467+0000","last_became_active":"2024-09-15T23:55:12.685705+0000","last_became_peered":"2024-09-15T23:55:12.685705+0000","last_unstale":"2024-09-15T23:55:13.682467+0000","last_undegraded":"2024-09-15T23:55:13.682467+0000","last_fullsized":"2024-09-15T23:55:13.682467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:23.918922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682502+0000","last_change":"2024-09-15T23:55:12.701281+0000","last_active":"2024-09-15T23:55:13.682502+0000","last_peered":"2024-09-15T23:55:13.682502+0000","last_clean":"2024-09-15T23:55:13.682502+0000","last_became_active":"2024-09-15T23:55:12.701047+0000","last_became_peered":"2024-09-15T23:55:12.701047+0000","last_unstale":"2024-09-15T23:55:13.682502+0000","last_undegraded":"2024-09-15T23:55:13.682502+0000","last_fullsized":"2024-09-15T23:55:13.682502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:20.691068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637860+0000","last_change":"2024-09-15T23:55:12.702183+0000","last_active":"2024-09-15T23:55:15.637860+0000","last_peered":"2024-09-15T23:55:15.637860+0000","last_clean":"2024-09-15T23:55:15.637860+0000","last_became_active":"2024-09-15T23:55:12.701921+0000","last_became_peered":"2024-09-15T23:55:12.701921+0000","last_unstale":"2024-09-15T23:55:15.637860+0000","last_undegraded":"2024-09-15T23:55:15.637860+0000","last_fullsized":"2024-09-15T23:55:15.637860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:52.477871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637821+0000","last_change":"2024-09-15T23:55:12.697158+0000","last_active":"2024-09-15T23:55:15.637821+0000","last_peered":"2024-09-15T23:55:15.637821+0000","last_clean":"2024-09-15T23:55:15.637821+0000","last_became_active":"2024-09-15T23:55:12.696919+0000","last_became_peered":"2024-09-15T23:55:12.696919+0000","last_unstale":"2024-09-15T23:55:15.637821+0000","last_undegraded":"2024-09-15T23:55:15.637821+0000","last_fullsized":"2024-09-15T23:55:15.637821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:29.873199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686362+0000","last_change":"2024-09-15T23:55:12.684313+0000","last_active":"2024-09-15T23:55:13.686362+0000","last_peered":"2024-09-15T23:55:13.686362+0000","last_clean":"2024-09-15T23:55:13.686362+0000","last_became_active":"2024-09-15T23:55:12.684051+0000","last_became_peered":"2024-09-15T23:55:12.684051+0000","last_unstale":"2024-09-15T23:55:13.686362+0000","last_undegraded":"2024-09-15T23:55:13.686362+0000","last_fullsized":"2024-09-15T23:55:13.686362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:45.032468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683002+0000","last_change":"2024-09-15T23:55:12.691786+0000","last_active":"2024-09-15T23:55:13.683002+0000","last_peered":"2024-09-15T23:55:13.683002+0000","last_clean":"2024-09-15T23:55:13.683002+0000","last_became_active":"2024-09-15T23:55:12.691014+0000","last_became_peered":"2024-09-15T23:55:12.691014+0000","last_unstale":"2024-09-15T23:55:13.683002+0000","last_undegraded":"2024-09-15T23:55:13.683002+0000","last_fullsized":"2024-09-15T23:55:13.683002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:20.402935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683238+0000","last_change":"2024-09-15T23:55:12.692693+0000","last_active":"2024-09-15T23:55:13.683238+0000","last_peered":"2024-09-15T23:55:13.683238+0000","last_clean":"2024-09-15T23:55:13.683238+0000","last_became_active":"2024-09-15T23:55:12.692388+0000","last_became_peered":"2024-09-15T23:55:12.692388+0000","last_unstale":"2024-09-15T23:55:13.683238+0000","last_undegraded":"2024-09-15T23:55:13.683238+0000","last_fullsized":"2024-09-15T23:55:13.683238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:34.601535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683088+0000","last_change":"2024-09-15T23:55:12.694633+0000","last_active":"2024-09-15T23:55:13.683088+0000","last_peered":"2024-09-15T23:55:13.683088+0000","last_clean":"2024-09-15T23:55:13.683088+0000","last_became_active":"2024-09-15T23:55:12.694187+0000","last_became_peered":"2024-09-15T23:55:12.694187+0000","last_unstale":"2024-09-15T23:55:13.683088+0000","last_undegraded":"2024-09-15T23:55:13.683088+0000","last_fullsized":"2024-09-15T23:55:13.683088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:04.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637332+0000","last_change":"2024-09-15T23:55:12.702217+0000","last_active":"2024-09-15T23:55:15.637332+0000","last_peered":"2024-09-15T23:55:15.637332+0000","last_clean":"2024-09-15T23:55:15.637332+0000","last_became_active":"2024-09-15T23:55:12.701635+0000","last_became_peered":"2024-09-15T23:55:12.701635+0000","last_unstale":"2024-09-15T23:55:15.637332+0000","last_undegraded":"2024-09-15T23:55:15.637332+0000","last_fullsized":"2024-09-15T23:55:15.637332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:57.384372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637396+0000","last_change":"2024-09-15T23:55:12.712448+0000","last_active":"2024-09-15T23:55:15.637396+0000","last_peered":"2024-09-15T23:55:15.637396+0000","last_clean":"2024-09-15T23:55:15.637396+0000","last_became_active":"2024-09-15T23:55:12.711476+0000","last_became_peered":"2024-09-15T23:55:12.711476+0000","last_unstale":"2024-09-15T23:55:15.637396+0000","last_undegraded":"2024-09-15T23:55:15.637396+0000","last_fullsized":"2024-09-15T23:55:15.637396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:59.933964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686072+0000","last_change":"2024-09-15T23:55:12.694322+0000","last_active":"2024-09-15T23:55:13.686072+0000","last_peered":"2024-09-15T23:55:13.686072+0000","last_clean":"2024-09-15T23:55:13.686072+0000","last_became_active":"2024-09-15T23:55:12.694058+0000","last_became_peered":"2024-09-15T23:55:12.694058+0000","last_unstale":"2024-09-15T23:55:13.686072+0000","last_undegraded":"2024-09-15T23:55:13.686072+0000","last_fullsized":"2024-09-15T23:55:13.686072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:56.223906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686315+0000","last_change":"2024-09-15T23:55:11.689438+0000","last_active":"2024-09-15T23:55:13.686315+0000","last_peered":"2024-09-15T23:55:13.686315+0000","last_clean":"2024-09-15T23:55:13.686315+0000","last_became_active":"2024-09-15T23:55:11.688715+0000","last_became_peered":"2024-09-15T23:55:11.688715+0000","last_unstale":"2024-09-15T23:55:13.686315+0000","last_undegraded":"2024-09-15T23:55:13.686315+0000","last_fullsized":"2024-09-15T23:55:13.686315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683578+0000","last_change":"2024-09-15T23:55:12.685542+0000","last_active":"2024-09-15T23:55:13.683578+0000","last_peered":"2024-09-15T23:55:13.683578+0000","last_clean":"2024-09-15T23:55:13.683578+0000","last_became_active":"2024-09-15T23:55:12.685271+0000","last_became_peered":"2024-09-15T23:55:12.685271+0000","last_unstale":"2024-09-15T23:55:13.683578+0000","last_undegraded":"2024-09-15T23:55:13.683578+0000","last_fullsized":"2024-09-15T23:55:13.683578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.069363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637567+0000","last_change":"2024-09-15T23:55:11.690527+0000","last_active":"2024-09-15T23:55:15.637567+0000","last_peered":"2024-09-15T23:55:15.637567+0000","last_clean":"2024-09-15T23:55:15.637567+0000","last_became_active":"2024-09-15T23:55:11.690256+0000","last_became_peered":"2024-09-15T23:55:11.690256+0000","last_unstale":"2024-09-15T23:55:15.637567+0000","last_undegraded":"2024-09-15T23:55:15.637567+0000","last_fullsized":"2024-09-15T23:55:15.637567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.749058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682846+0000","last_change":"2024-09-15T23:55:11.687201+0000","last_active":"2024-09-15T23:55:13.682846+0000","last_peered":"2024-09-15T23:55:13.682846+0000","last_clean":"2024-09-15T23:55:13.682846+0000","last_became_active":"2024-09-15T23:55:11.687041+0000","last_became_peered":"2024-09-15T23:55:11.687041+0000","last_unstale":"2024-09-15T23:55:13.682846+0000","last_undegraded":"2024-09-15T23:55:13.682846+0000","last_fullsized":"2024-09-15T23:55:13.682846+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637745+0000","last_change":"2024-09-15T23:55:12.712572+0000","last_active":"2024-09-15T23:55:15.637745+0000","last_peered":"2024-09-15T23:55:15.637745+0000","last_clean":"2024-09-15T23:55:15.637745+0000","last_became_active":"2024-09-15T23:55:12.711835+0000","last_became_peered":"2024-09-15T23:55:12.711835+0000","last_unstale":"2024-09-15T23:55:15.637745+0000","last_undegraded":"2024-09-15T23:55:15.637745+0000","last_fullsized":"2024-09-15T23:55:15.637745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:14.801061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682453+0000","last_change":"2024-09-15T23:55:11.695048+0000","last_active":"2024-09-15T23:55:13.682453+0000","last_peered":"2024-09-15T23:55:13.682453+0000","last_clean":"2024-09-15T23:55:13.682453+0000","last_became_active":"2024-09-15T23:55:11.694766+0000","last_became_peered":"2024-09-15T23:55:11.694766+0000","last_unstale":"2024-09-15T23:55:13.682453+0000","last_undegraded":"2024-09-15T23:55:13.682453+0000","last_fullsized":"2024-09-15T23:55:13.682453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686069+0000","last_change":"2024-09-15T23:55:12.685430+0000","last_active":"2024-09-15T23:55:13.686069+0000","last_peered":"2024-09-15T23:55:13.686069+0000","last_clean":"2024-09-15T23:55:13.686069+0000","last_became_active":"2024-09-15T23:55:12.685161+0000","last_became_peered":"2024-09-15T23:55:12.685161+0000","last_unstale":"2024-09-15T23:55:13.686069+0000","last_undegraded":"2024-09-15T23:55:13.686069+0000","last_fullsized":"2024-09-15T23:55:13.686069+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:10.903292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687182+0000","last_change":"2024-09-15T23:55:11.680383+0000","last_active":"2024-09-15T23:55:13.687182+0000","last_peered":"2024-09-15T23:55:13.687182+0000","last_clean":"2024-09-15T23:55:13.687182+0000","last_became_active":"2024-09-15T23:55:11.680116+0000","last_became_peered":"2024-09-15T23:55:11.680116+0000","last_unstale":"2024-09-15T23:55:13.687182+0000","last_undegraded":"2024-09-15T23:55:13.687182+0000","last_fullsized":"2024-09-15T23:55:13.687182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637959+0000","last_change":"2024-09-15T23:55:12.695948+0000","last_active":"2024-09-15T23:55:15.637959+0000","last_peered":"2024-09-15T23:55:15.637959+0000","last_clean":"2024-09-15T23:55:15.637959+0000","last_became_active":"2024-09-15T23:55:12.695680+0000","last_became_peered":"2024-09-15T23:55:12.695680+0000","last_unstale":"2024-09-15T23:55:15.637959+0000","last_undegraded":"2024-09-15T23:55:15.637959+0000","last_fullsized":"2024-09-15T23:55:15.637959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:08.657505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683561+0000","last_change":"2024-09-15T23:55:11.684947+0000","last_active":"2024-09-15T23:55:13.683561+0000","last_peered":"2024-09-15T23:55:13.683561+0000","last_clean":"2024-09-15T23:55:13.683561+0000","last_became_active":"2024-09-15T23:55:11.684524+0000","last_became_peered":"2024-09-15T23:55:11.684524+0000","last_unstale":"2024-09-15T23:55:13.683561+0000","last_undegraded":"2024-09-15T23:55:13.683561+0000","last_fullsized":"2024-09-15T23:55:13.683561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683670+0000","last_change":"2024-09-15T23:55:12.692510+0000","last_active":"2024-09-15T23:55:13.683670+0000","last_peered":"2024-09-15T23:55:13.683670+0000","last_clean":"2024-09-15T23:55:13.683670+0000","last_became_active":"2024-09-15T23:55:12.692271+0000","last_became_peered":"2024-09-15T23:55:12.692271+0000","last_unstale":"2024-09-15T23:55:13.683670+0000","last_undegraded":"2024-09-15T23:55:13.683670+0000","last_fullsized":"2024-09-15T23:55:13.683670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:29.261729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"16'3","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686543+0000","last_change":"2024-09-15T23:55:11.689697+0000","last_active":"2024-09-15T23:55:13.686543+0000","last_peered":"2024-09-15T23:55:13.686543+0000","last_clean":"2024-09-15T23:55:13.686543+0000","last_became_active":"2024-09-15T23:55:11.689121+0000","last_became_peered":"2024-09-15T23:55:11.689121+0000","last_unstale":"2024-09-15T23:55:13.686543+0000","last_undegraded":"2024-09-15T23:55:13.686543+0000","last_fullsized":"2024-09-15T23:55:13.686543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:01.294185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686441+0000","last_change":"2024-09-15T23:55:12.690608+0000","last_active":"2024-09-15T23:55:13.686441+0000","last_peered":"2024-09-15T23:55:13.686441+0000","last_clean":"2024-09-15T23:55:13.686441+0000","last_became_active":"2024-09-15T23:55:12.690352+0000","last_became_peered":"2024-09-15T23:55:12.690352+0000","last_unstale":"2024-09-15T23:55:13.686441+0000","last_undegraded":"2024-09-15T23:55:13.686441+0000","last_fullsized":"2024-09-15T23:55:13.686441+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:04.611155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"16'6","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637588+0000","last_change":"2024-09-15T23:55:11.685728+0000","last_active":"2024-09-15T23:55:15.637588+0000","last_peered":"2024-09-15T23:55:15.637588+0000","last_clean":"2024-09-15T23:55:15.637588+0000","last_became_active":"2024-09-15T23:55:11.685469+0000","last_became_peered":"2024-09-15T23:55:11.685469+0000","last_unstale":"2024-09-15T23:55:15.637588+0000","last_undegraded":"2024-09-15T23:55:15.637588+0000","last_fullsized":"2024-09-15T23:55:15.637588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:25.521672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683092+0000","last_change":"2024-09-15T23:55:12.697521+0000","last_active":"2024-09-15T23:55:13.683092+0000","last_peered":"2024-09-15T23:55:13.683092+0000","last_clean":"2024-09-15T23:55:13.683092+0000","last_became_active":"2024-09-15T23:55:12.694852+0000","last_became_peered":"2024-09-15T23:55:12.694852+0000","last_unstale":"2024-09-15T23:55:13.683092+0000","last_undegraded":"2024-09-15T23:55:13.683092+0000","last_fullsized":"2024-09-15T23:55:13.683092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:08.494222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683755+0000","last_change":"2024-09-15T23:55:11.687469+0000","last_active":"2024-09-15T23:55:13.683755+0000","last_peered":"2024-09-15T23:55:13.683755+0000","last_clean":"2024-09-15T23:55:13.683755+0000","last_became_active":"2024-09-15T23:55:11.687140+0000","last_became_peered":"2024-09-15T23:55:11.687140+0000","last_unstale":"2024-09-15T23:55:13.683755+0000","last_undegraded":"2024-09-15T23:55:13.683755+0000","last_fullsized":"2024-09-15T23:55:13.683755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:36.174759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683333+0000","last_change":"2024-09-15T23:55:12.694577+0000","last_active":"2024-09-15T23:55:13.683333+0000","last_peered":"2024-09-15T23:55:13.683333+0000","last_clean":"2024-09-15T23:55:13.683333+0000","last_became_active":"2024-09-15T23:55:12.693352+0000","last_became_peered":"2024-09-15T23:55:12.693352+0000","last_unstale":"2024-09-15T23:55:13.683333+0000","last_undegraded":"2024-09-15T23:55:13.683333+0000","last_fullsized":"2024-09-15T23:55:13.683333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.036005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637659+0000","last_change":"2024-09-15T23:55:11.686342+0000","last_active":"2024-09-15T23:55:15.637659+0000","last_peered":"2024-09-15T23:55:15.637659+0000","last_clean":"2024-09-15T23:55:15.637659+0000","last_became_active":"2024-09-15T23:55:11.686052+0000","last_became_peered":"2024-09-15T23:55:11.686052+0000","last_unstale":"2024-09-15T23:55:15.637659+0000","last_undegraded":"2024-09-15T23:55:15.637659+0000","last_fullsized":"2024-09-15T23:55:15.637659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:50.303621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686164+0000","last_change":"2024-09-15T23:55:12.699612+0000","last_active":"2024-09-15T23:55:13.686164+0000","last_peered":"2024-09-15T23:55:13.686164+0000","last_clean":"2024-09-15T23:55:13.686164+0000","last_became_active":"2024-09-15T23:55:12.699166+0000","last_became_peered":"2024-09-15T23:55:12.699166+0000","last_unstale":"2024-09-15T23:55:13.686164+0000","last_undegraded":"2024-09-15T23:55:13.686164+0000","last_fullsized":"2024-09-15T23:55:13.686164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:59.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682946+0000","last_change":"2024-09-15T23:55:11.685669+0000","last_active":"2024-09-15T23:55:13.682946+0000","last_peered":"2024-09-15T23:55:13.682946+0000","last_clean":"2024-09-15T23:55:13.682946+0000","last_became_active":"2024-09-15T23:55:11.685404+0000","last_became_peered":"2024-09-15T23:55:11.685404+0000","last_unstale":"2024-09-15T23:55:13.682946+0000","last_undegraded":"2024-09-15T23:55:13.682946+0000","last_fullsized":"2024-09-15T23:55:13.682946+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.685822+0000","last_change":"2024-09-15T23:55:12.706980+0000","last_active":"2024-09-15T23:55:13.685822+0000","last_peered":"2024-09-15T23:55:13.685822+0000","last_clean":"2024-09-15T23:55:13.685822+0000","last_became_active":"2024-09-15T23:55:12.706336+0000","last_became_peered":"2024-09-15T23:55:12.706336+0000","last_unstale":"2024-09-15T23:55:13.685822+0000","last_undegraded":"2024-09-15T23:55:13.685822+0000","last_fullsized":"2024-09-15T23:55:13.685822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:06.699466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"16'8","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638050+0000","last_change":"2024-09-15T23:55:11.690815+0000","last_active":"2024-09-15T23:55:15.638050+0000","last_peered":"2024-09-15T23:55:15.638050+0000","last_clean":"2024-09-15T23:55:15.638050+0000","last_became_active":"2024-09-15T23:55:11.690538+0000","last_became_peered":"2024-09-15T23:55:11.690538+0000","last_unstale":"2024-09-15T23:55:15.638050+0000","last_undegraded":"2024-09-15T23:55:15.638050+0000","last_fullsized":"2024-09-15T23:55:15.638050+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:34.734800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637361+0000","last_change":"2024-09-15T23:55:12.705659+0000","last_active":"2024-09-15T23:55:15.637361+0000","last_peered":"2024-09-15T23:55:15.637361+0000","last_clean":"2024-09-15T23:55:15.637361+0000","last_became_active":"2024-09-15T23:55:12.705408+0000","last_became_peered":"2024-09-15T23:55:12.705408+0000","last_unstale":"2024-09-15T23:55:15.637361+0000","last_undegraded":"2024-09-15T23:55:15.637361+0000","last_fullsized":"2024-09-15T23:55:15.637361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:23.129649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684101+0000","last_change":"2024-09-15T23:55:11.685486+0000","last_active":"2024-09-15T23:55:13.684101+0000","last_peered":"2024-09-15T23:55:13.684101+0000","last_clean":"2024-09-15T23:55:13.684101+0000","last_became_active":"2024-09-15T23:55:11.685191+0000","last_became_peered":"2024-09-15T23:55:11.685191+0000","last_unstale":"2024-09-15T23:55:13.684101+0000","last_undegraded":"2024-09-15T23:55:13.684101+0000","last_fullsized":"2024-09-15T23:55:13.684101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:44.569040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638090+0000","last_change":"2024-09-15T23:55:12.710015+0000","last_active":"2024-09-15T23:55:15.638090+0000","last_peered":"2024-09-15T23:55:15.638090+0000","last_clean":"2024-09-15T23:55:15.638090+0000","last_became_active":"2024-09-15T23:55:12.709501+0000","last_became_peered":"2024-09-15T23:55:12.709501+0000","last_unstale":"2024-09-15T23:55:15.638090+0000","last_undegraded":"2024-09-15T23:55:15.638090+0000","last_fullsized":"2024-09-15T23:55:15.638090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:25.459498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638156+0000","last_change":"2024-09-15T23:55:11.690840+0000","last_active":"2024-09-15T23:55:15.638156+0000","last_peered":"2024-09-15T23:55:15.638156+0000","last_clean":"2024-09-15T23:55:15.638156+0000","last_became_active":"2024-09-15T23:55:11.690562+0000","last_became_peered":"2024-09-15T23:55:11.690562+0000","last_unstale":"2024-09-15T23:55:15.638156+0000","last_undegraded":"2024-09-15T23:55:15.638156+0000","last_fullsized":"2024-09-15T23:55:15.638156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:05.205328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683711+0000","last_change":"2024-09-15T23:55:12.697590+0000","last_active":"2024-09-15T23:55:13.683711+0000","last_peered":"2024-09-15T23:55:13.683711+0000","last_clean":"2024-09-15T23:55:13.683711+0000","last_became_active":"2024-09-15T23:55:12.697210+0000","last_became_peered":"2024-09-15T23:55:12.697210+0000","last_unstale":"2024-09-15T23:55:13.683711+0000","last_undegraded":"2024-09-15T23:55:13.683711+0000","last_fullsized":"2024-09-15T23:55:13.683711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:44.915748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686679+0000","last_change":"2024-09-15T23:55:11.680934+0000","last_active":"2024-09-15T23:55:13.686679+0000","last_peered":"2024-09-15T23:55:13.686679+0000","last_clean":"2024-09-15T23:55:13.686679+0000","last_became_active":"2024-09-15T23:55:11.679943+0000","last_became_peered":"2024-09-15T23:55:11.679943+0000","last_unstale":"2024-09-15T23:55:13.686679+0000","last_undegraded":"2024-09-15T23:55:13.686679+0000","last_fullsized":"2024-09-15T23:55:13.686679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:21.130135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683047+0000","last_change":"2024-09-15T23:55:12.697768+0000","last_active":"2024-09-15T23:55:13.683047+0000","last_peered":"2024-09-15T23:55:13.683047+0000","last_clean":"2024-09-15T23:55:13.683047+0000","last_became_active":"2024-09-15T23:55:12.696964+0000","last_became_peered":"2024-09-15T23:55:12.696964+0000","last_unstale":"2024-09-15T23:55:13.683047+0000","last_undegraded":"2024-09-15T23:55:13.683047+0000","last_fullsized":"2024-09-15T23:55:13.683047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:41.449600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637668+0000","last_change":"2024-09-15T23:55:11.689063+0000","last_active":"2024-09-15T23:55:15.637668+0000","last_peered":"2024-09-15T23:55:15.637668+0000","last_clean":"2024-09-15T23:55:15.637668+0000","last_became_active":"2024-09-15T23:55:11.688818+0000","last_became_peered":"2024-09-15T23:55:11.688818+0000","last_unstale":"2024-09-15T23:55:15.637668+0000","last_undegraded":"2024-09-15T23:55:15.637668+0000","last_fullsized":"2024-09-15T23:55:15.637668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:11.699017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686364+0000","last_change":"2024-09-15T23:55:12.694288+0000","last_active":"2024-09-15T23:55:13.686364+0000","last_peered":"2024-09-15T23:55:13.686364+0000","last_clean":"2024-09-15T23:55:13.686364+0000","last_became_active":"2024-09-15T23:55:12.693688+0000","last_became_peered":"2024-09-15T23:55:12.693688+0000","last_unstale":"2024-09-15T23:55:13.686364+0000","last_undegraded":"2024-09-15T23:55:13.686364+0000","last_fullsized":"2024-09-15T23:55:13.686364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:32.130285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":147,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686434+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:13.686434+0000","last_peered":"2024-09-15T23:55:13.686434+0000","last_clean":"2024-09-15T23:55:13.686434+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:13.686434+0000","last_undegraded":"2024-09-15T23:55:13.686434+0000","last_fullsized":"2024-09-15T23:55:13.686434+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686402+0000","last_change":"2024-09-15T23:55:11.684064+0000","last_active":"2024-09-15T23:55:13.686402+0000","last_peered":"2024-09-15T23:55:13.686402+0000","last_clean":"2024-09-15T23:55:13.686402+0000","last_became_active":"2024-09-15T23:55:11.683537+0000","last_became_peered":"2024-09-15T23:55:11.683537+0000","last_unstale":"2024-09-15T23:55:13.686402+0000","last_undegraded":"2024-09-15T23:55:13.686402+0000","last_fullsized":"2024-09-15T23:55:13.686402+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686534+0000","last_change":"2024-09-15T23:55:12.690740+0000","last_active":"2024-09-15T23:55:13.686534+0000","last_peered":"2024-09-15T23:55:13.686534+0000","last_clean":"2024-09-15T23:55:13.686534+0000","last_became_active":"2024-09-15T23:55:12.690500+0000","last_became_peered":"2024-09-15T23:55:12.690500+0000","last_unstale":"2024-09-15T23:55:13.686534+0000","last_undegraded":"2024-09-15T23:55:13.686534+0000","last_fullsized":"2024-09-15T23:55:13.686534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:09.860747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638076+0000","last_change":"2024-09-15T23:55:11.691560+0000","last_active":"2024-09-15T23:55:15.638076+0000","last_peered":"2024-09-15T23:55:15.638076+0000","last_clean":"2024-09-15T23:55:15.638076+0000","last_became_active":"2024-09-15T23:55:11.691111+0000","last_became_peered":"2024-09-15T23:55:11.691111+0000","last_unstale":"2024-09-15T23:55:15.638076+0000","last_undegraded":"2024-09-15T23:55:15.638076+0000","last_fullsized":"2024-09-15T23:55:15.638076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:40.745603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682610+0000","last_change":"2024-09-15T23:55:12.692568+0000","last_active":"2024-09-15T23:55:13.682610+0000","last_peered":"2024-09-15T23:55:13.682610+0000","last_clean":"2024-09-15T23:55:13.682610+0000","last_became_active":"2024-09-15T23:55:12.692021+0000","last_became_peered":"2024-09-15T23:55:12.692021+0000","last_unstale":"2024-09-15T23:55:13.682610+0000","last_undegraded":"2024-09-15T23:55:13.682610+0000","last_fullsized":"2024-09-15T23:55:13.682610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:37.381027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637502+0000","last_change":"2024-09-15T23:55:11.686567+0000","last_active":"2024-09-15T23:55:15.637502+0000","last_peered":"2024-09-15T23:55:15.637502+0000","last_clean":"2024-09-15T23:55:15.637502+0000","last_became_active":"2024-09-15T23:55:11.686326+0000","last_became_peered":"2024-09-15T23:55:11.686326+0000","last_unstale":"2024-09-15T23:55:15.637502+0000","last_undegraded":"2024-09-15T23:55:15.637502+0000","last_fullsized":"2024-09-15T23:55:15.637502+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:34.612583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686671+0000","last_change":"2024-09-15T23:55:12.684331+0000","last_active":"2024-09-15T23:55:13.686671+0000","last_peered":"2024-09-15T23:55:13.686671+0000","last_clean":"2024-09-15T23:55:13.686671+0000","last_became_active":"2024-09-15T23:55:12.684077+0000","last_became_peered":"2024-09-15T23:55:12.684077+0000","last_unstale":"2024-09-15T23:55:13.686671+0000","last_undegraded":"2024-09-15T23:55:13.686671+0000","last_fullsized":"2024-09-15T23:55:13.686671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:23.918922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683435+0000","last_change":"2024-09-15T23:55:11.681692+0000","last_active":"2024-09-15T23:55:13.683435+0000","last_peered":"2024-09-15T23:55:13.683435+0000","last_clean":"2024-09-15T23:55:13.683435+0000","last_became_active":"2024-09-15T23:55:11.681438+0000","last_became_peered":"2024-09-15T23:55:11.681438+0000","last_unstale":"2024-09-15T23:55:13.683435+0000","last_undegraded":"2024-09-15T23:55:13.683435+0000","last_fullsized":"2024-09-15T23:55:13.683435+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683651+0000","last_change":"2024-09-15T23:55:12.689132+0000","last_active":"2024-09-15T23:55:13.683651+0000","last_peered":"2024-09-15T23:55:13.683651+0000","last_clean":"2024-09-15T23:55:13.683651+0000","last_became_active":"2024-09-15T23:55:12.688172+0000","last_became_peered":"2024-09-15T23:55:12.688172+0000","last_unstale":"2024-09-15T23:55:13.683651+0000","last_undegraded":"2024-09-15T23:55:13.683651+0000","last_fullsized":"2024-09-15T23:55:13.683651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:30.701458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686536+0000","last_change":"2024-09-15T23:55:11.690745+0000","last_active":"2024-09-15T23:55:13.686536+0000","last_peered":"2024-09-15T23:55:13.686536+0000","last_clean":"2024-09-15T23:55:13.686536+0000","last_became_active":"2024-09-15T23:55:11.690190+0000","last_became_peered":"2024-09-15T23:55:11.690190+0000","last_unstale":"2024-09-15T23:55:13.686536+0000","last_undegraded":"2024-09-15T23:55:13.686536+0000","last_fullsized":"2024-09-15T23:55:13.686536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:15.793016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638089+0000","last_change":"2024-09-15T23:55:12.702288+0000","last_active":"2024-09-15T23:55:15.638089+0000","last_peered":"2024-09-15T23:55:15.638089+0000","last_clean":"2024-09-15T23:55:15.638089+0000","last_became_active":"2024-09-15T23:55:12.701837+0000","last_became_peered":"2024-09-15T23:55:12.701837+0000","last_unstale":"2024-09-15T23:55:15.638089+0000","last_undegraded":"2024-09-15T23:55:15.638089+0000","last_fullsized":"2024-09-15T23:55:15.638089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:54.387948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686745+0000","last_change":"2024-09-15T23:55:11.689383+0000","last_active":"2024-09-15T23:55:13.686745+0000","last_peered":"2024-09-15T23:55:13.686745+0000","last_clean":"2024-09-15T23:55:13.686745+0000","last_became_active":"2024-09-15T23:55:11.688499+0000","last_became_peered":"2024-09-15T23:55:11.688499+0000","last_unstale":"2024-09-15T23:55:13.686745+0000","last_undegraded":"2024-09-15T23:55:13.686745+0000","last_fullsized":"2024-09-15T23:55:13.686745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686599+0000","last_change":"2024-09-15T23:55:12.683877+0000","last_active":"2024-09-15T23:55:13.686599+0000","last_peered":"2024-09-15T23:55:13.686599+0000","last_clean":"2024-09-15T23:55:13.686599+0000","last_became_active":"2024-09-15T23:55:12.683590+0000","last_became_peered":"2024-09-15T23:55:12.683590+0000","last_unstale":"2024-09-15T23:55:13.686599+0000","last_undegraded":"2024-09-15T23:55:13.686599+0000","last_fullsized":"2024-09-15T23:55:13.686599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:59.271320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"17'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686584+0000","last_change":"2024-09-15T23:55:11.691447+0000","last_active":"2024-09-15T23:55:13.686584+0000","last_peered":"2024-09-15T23:55:13.686584+0000","last_clean":"2024-09-15T23:55:13.686584+0000","last_became_active":"2024-09-15T23:55:11.691128+0000","last_became_peered":"2024-09-15T23:55:11.691128+0000","last_unstale":"2024-09-15T23:55:13.686584+0000","last_undegraded":"2024-09-15T23:55:13.686584+0000","last_fullsized":"2024-09-15T23:55:13.686584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:36.726394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637842+0000","last_change":"2024-09-15T23:55:12.704420+0000","last_active":"2024-09-15T23:55:15.637842+0000","last_peered":"2024-09-15T23:55:15.637842+0000","last_clean":"2024-09-15T23:55:15.637842+0000","last_became_active":"2024-09-15T23:55:12.704171+0000","last_became_peered":"2024-09-15T23:55:12.704171+0000","last_unstale":"2024-09-15T23:55:15.637842+0000","last_undegraded":"2024-09-15T23:55:15.637842+0000","last_fullsized":"2024-09-15T23:55:15.637842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:38.881307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.687278+0000","last_change":"2024-09-15T23:55:11.689361+0000","last_active":"2024-09-15T23:55:13.687278+0000","last_peered":"2024-09-15T23:55:13.687278+0000","last_clean":"2024-09-15T23:55:13.687278+0000","last_became_active":"2024-09-15T23:55:11.688414+0000","last_became_peered":"2024-09-15T23:55:11.688414+0000","last_unstale":"2024-09-15T23:55:13.687278+0000","last_undegraded":"2024-09-15T23:55:13.687278+0000","last_fullsized":"2024-09-15T23:55:13.687278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:32.152519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683482+0000","last_change":"2024-09-15T23:55:12.688327+0000","last_active":"2024-09-15T23:55:13.683482+0000","last_peered":"2024-09-15T23:55:13.683482+0000","last_clean":"2024-09-15T23:55:13.683482+0000","last_became_active":"2024-09-15T23:55:12.688057+0000","last_became_peered":"2024-09-15T23:55:12.688057+0000","last_unstale":"2024-09-15T23:55:13.683482+0000","last_undegraded":"2024-09-15T23:55:13.683482+0000","last_fullsized":"2024-09-15T23:55:13.683482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:22.743163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682543+0000","last_change":"2024-09-15T23:55:11.685621+0000","last_active":"2024-09-15T23:55:13.682543+0000","last_peered":"2024-09-15T23:55:13.682543+0000","last_clean":"2024-09-15T23:55:13.682543+0000","last_became_active":"2024-09-15T23:55:11.685362+0000","last_became_peered":"2024-09-15T23:55:11.685362+0000","last_unstale":"2024-09-15T23:55:13.682543+0000","last_undegraded":"2024-09-15T23:55:13.682543+0000","last_fullsized":"2024-09-15T23:55:13.682543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:59.223956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.682446+0000","last_change":"2024-09-15T23:55:12.693033+0000","last_active":"2024-09-15T23:55:13.682446+0000","last_peered":"2024-09-15T23:55:13.682446+0000","last_clean":"2024-09-15T23:55:13.682446+0000","last_became_active":"2024-09-15T23:55:12.692321+0000","last_became_peered":"2024-09-15T23:55:12.692321+0000","last_unstale":"2024-09-15T23:55:13.682446+0000","last_undegraded":"2024-09-15T23:55:13.682446+0000","last_fullsized":"2024-09-15T23:55:13.682446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:59.271320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686169+0000","last_change":"2024-09-15T23:55:11.689154+0000","last_active":"2024-09-15T23:55:13.686169+0000","last_peered":"2024-09-15T23:55:13.686169+0000","last_clean":"2024-09-15T23:55:13.686169+0000","last_became_active":"2024-09-15T23:55:11.688854+0000","last_became_peered":"2024-09-15T23:55:11.688854+0000","last_unstale":"2024-09-15T23:55:13.686169+0000","last_undegraded":"2024-09-15T23:55:13.686169+0000","last_fullsized":"2024-09-15T23:55:13.686169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637918+0000","last_change":"2024-09-15T23:55:12.705007+0000","last_active":"2024-09-15T23:55:15.637918+0000","last_peered":"2024-09-15T23:55:15.637918+0000","last_clean":"2024-09-15T23:55:15.637918+0000","last_became_active":"2024-09-15T23:55:12.704753+0000","last_became_peered":"2024-09-15T23:55:12.704753+0000","last_unstale":"2024-09-15T23:55:15.637918+0000","last_undegraded":"2024-09-15T23:55:15.637918+0000","last_fullsized":"2024-09-15T23:55:15.637918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:36.635728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686172+0000","last_change":"2024-09-15T23:55:11.689771+0000","last_active":"2024-09-15T23:55:13.686172+0000","last_peered":"2024-09-15T23:55:13.686172+0000","last_clean":"2024-09-15T23:55:13.686172+0000","last_became_active":"2024-09-15T23:55:11.689083+0000","last_became_peered":"2024-09-15T23:55:11.689083+0000","last_unstale":"2024-09-15T23:55:13.686172+0000","last_undegraded":"2024-09-15T23:55:13.686172+0000","last_fullsized":"2024-09-15T23:55:13.686172+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686302+0000","last_change":"2024-09-15T23:55:12.699401+0000","last_active":"2024-09-15T23:55:13.686302+0000","last_peered":"2024-09-15T23:55:13.686302+0000","last_clean":"2024-09-15T23:55:13.686302+0000","last_became_active":"2024-09-15T23:55:12.698873+0000","last_became_peered":"2024-09-15T23:55:12.698873+0000","last_unstale":"2024-09-15T23:55:13.686302+0000","last_undegraded":"2024-09-15T23:55:13.686302+0000","last_fullsized":"2024-09-15T23:55:13.686302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:35.506990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.684166+0000","last_change":"2024-09-15T23:55:11.683719+0000","last_active":"2024-09-15T23:55:13.684166+0000","last_peered":"2024-09-15T23:55:13.684166+0000","last_clean":"2024-09-15T23:55:13.684166+0000","last_became_active":"2024-09-15T23:55:11.682811+0000","last_became_peered":"2024-09-15T23:55:11.682811+0000","last_unstale":"2024-09-15T23:55:13.684166+0000","last_undegraded":"2024-09-15T23:55:13.684166+0000","last_fullsized":"2024-09-15T23:55:13.684166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683350+0000","last_change":"2024-09-15T23:55:12.694426+0000","last_active":"2024-09-15T23:55:13.683350+0000","last_peered":"2024-09-15T23:55:13.683350+0000","last_clean":"2024-09-15T23:55:13.683350+0000","last_became_active":"2024-09-15T23:55:12.693056+0000","last_became_peered":"2024-09-15T23:55:12.693056+0000","last_unstale":"2024-09-15T23:55:13.683350+0000","last_undegraded":"2024-09-15T23:55:13.683350+0000","last_fullsized":"2024-09-15T23:55:13.683350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:15.056593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637972+0000","last_change":"2024-09-15T23:55:12.702080+0000","last_active":"2024-09-15T23:55:15.637972+0000","last_peered":"2024-09-15T23:55:15.637972+0000","last_clean":"2024-09-15T23:55:15.637972+0000","last_became_active":"2024-09-15T23:55:12.701497+0000","last_became_peered":"2024-09-15T23:55:12.701497+0000","last_unstale":"2024-09-15T23:55:15.637972+0000","last_undegraded":"2024-09-15T23:55:15.637972+0000","last_fullsized":"2024-09-15T23:55:15.637972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:52.542412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683148+0000","last_change":"2024-09-15T23:55:11.682360+0000","last_active":"2024-09-15T23:55:13.683148+0000","last_peered":"2024-09-15T23:55:13.683148+0000","last_clean":"2024-09-15T23:55:13.683148+0000","last_became_active":"2024-09-15T23:55:11.682073+0000","last_became_peered":"2024-09-15T23:55:11.682073+0000","last_unstale":"2024-09-15T23:55:13.683148+0000","last_undegraded":"2024-09-15T23:55:13.683148+0000","last_fullsized":"2024-09-15T23:55:13.683148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:07.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.686400+0000","last_change":"2024-09-15T23:55:12.700670+0000","last_active":"2024-09-15T23:55:13.686400+0000","last_peered":"2024-09-15T23:55:13.686400+0000","last_clean":"2024-09-15T23:55:13.686400+0000","last_became_active":"2024-09-15T23:55:12.699711+0000","last_became_peered":"2024-09-15T23:55:12.699711+0000","last_unstale":"2024-09-15T23:55:13.686400+0000","last_undegraded":"2024-09-15T23:55:13.686400+0000","last_fullsized":"2024-09-15T23:55:13.686400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:28.197430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"16'2","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683890+0000","last_change":"2024-09-15T23:55:11.693722+0000","last_active":"2024-09-15T23:55:13.683890+0000","last_peered":"2024-09-15T23:55:13.683890+0000","last_clean":"2024-09-15T23:55:13.683890+0000","last_became_active":"2024-09-15T23:55:11.693487+0000","last_became_peered":"2024-09-15T23:55:11.693487+0000","last_unstale":"2024-09-15T23:55:13.683890+0000","last_undegraded":"2024-09-15T23:55:13.683890+0000","last_fullsized":"2024-09-15T23:55:13.683890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:23.556737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683541+0000","last_change":"2024-09-15T23:55:12.689223+0000","last_active":"2024-09-15T23:55:13.683541+0000","last_peered":"2024-09-15T23:55:13.683541+0000","last_clean":"2024-09-15T23:55:13.683541+0000","last_became_active":"2024-09-15T23:55:12.688397+0000","last_became_peered":"2024-09-15T23:55:12.688397+0000","last_unstale":"2024-09-15T23:55:13.683541+0000","last_undegraded":"2024-09-15T23:55:13.683541+0000","last_fullsized":"2024-09-15T23:55:13.683541+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:35.662577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"16'1","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.638062+0000","last_change":"2024-09-15T23:55:11.691511+0000","last_active":"2024-09-15T23:55:15.638062+0000","last_peered":"2024-09-15T23:55:15.638062+0000","last_clean":"2024-09-15T23:55:15.638062+0000","last_became_active":"2024-09-15T23:55:11.690348+0000","last_became_peered":"2024-09-15T23:55:11.690348+0000","last_unstale":"2024-09-15T23:55:15.638062+0000","last_undegraded":"2024-09-15T23:55:15.638062+0000","last_fullsized":"2024-09-15T23:55:15.638062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:51.969491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:15.637941+0000","last_change":"2024-09-15T23:55:12.696145+0000","last_active":"2024-09-15T23:55:15.637941+0000","last_peered":"2024-09-15T23:55:15.637941+0000","last_clean":"2024-09-15T23:55:15.637941+0000","last_became_active":"2024-09-15T23:55:12.695891+0000","last_became_peered":"2024-09-15T23:55:12.695891+0000","last_unstale":"2024-09-15T23:55:15.637941+0000","last_undegraded":"2024-09-15T23:55:15.637941+0000","last_fullsized":"2024-09-15T23:55:15.637941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:11.660585+0000","last_clean_scrub_stamp":"2024-09-15T23:55:11.660585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:32.386037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"16'4","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-15T23:55:13.683944+0000","last_change":"2024-09-15T23:55:11.686294+0000","last_active":"2024-09-15T23:55:13.683944+0000","last_peered":"2024-09-15T23:55:13.683944+0000","last_clean":"2024-09-15T23:55:13.683944+0000","last_became_active":"2024-09-15T23:55:11.685978+0000","last_became_peered":"2024-09-15T23:55:11.685978+0000","last_unstale":"2024-09-15T23:55:13.683944+0000","last_undegraded":"2024-09-15T23:55:13.683944+0000","last_fullsized":"2024-09-15T23:55:13.683944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:10.654555+0000","last_clean_scrub_stamp":"2024-09-15T23:55:10.654555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:15.904167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":46624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":637652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":636004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:19.433 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:55:19.433 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T23:55:19.433 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T23:55:19.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T23:55:19.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.567+0000 7eff9d731640 1 Processor -- start 2024-09-15T23:55:19.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.567+0000 7eff9d731640 1 -- start start 2024-09-15T23:55:19.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff9d731640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff980a4c20 0x7eff980a72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff9d731640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff980a8340 con 0x7eff9813a4b0 2024-09-15T23:55:19.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff9d731640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7eff980a3d50 con 0x7eff980a4c20 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff967fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff980a4c20 0x7eff980a72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff967fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7eff980a4c20 0x7eff980a72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55792/0 (socket says 172.21.15.121:55792) 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff967fc640 1 -- 172.21.15.121:0/1276297297 learned_addr learned my addr 172.21.15.121:0/1276297297 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff96ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7eff9813a4b0 0x7eff980a6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45508/0 (socket says 172.21.15.121:45508) 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff967fc640 1 -- 172.21.15.121:0/1276297297 >> v1:172.21.15.121:6789/0 conn(0x7eff9813a4b0 legacy=0x7eff980a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.568+0000 7eff967fc640 1 -- 172.21.15.121:0/1276297297 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9813a080 con 0x7eff980a4c20 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff967fc640 1 --2- 172.21.15.121:0/1276297297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff980a72a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097f0 tx=0x7eff8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae26e1363c88bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff95ffb640 1 -- 172.21.15.121:0/1276297297 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c037070 con 0x7eff980a4c20 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff95ffb640 1 -- 172.21.15.121:0/1276297297 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c032440 con 0x7eff980a4c20 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff95ffb640 1 -- 172.21.15.121:0/1276297297 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff8c02ae60 con 0x7eff980a4c20 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 -- 172.21.15.121:0/1276297297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 msgr2=0x7eff980a72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 --2- 172.21.15.121:0/1276297297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff980a72a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097f0 tx=0x7eff8c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 -- 172.21.15.121:0/1276297297 shutdown_connections 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 --2- 172.21.15.121:0/1276297297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff980a72a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 -- 172.21.15.121:0/1276297297 >> 172.21.15.121:0/1276297297 conn(0x7eff980ac370 msgr2=0x7eff980ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 -- 172.21.15.121:0/1276297297 shutdown_connections 2024-09-15T23:55:19.572 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.569+0000 7eff9d731640 1 -- 172.21.15.121:0/1276297297 wait complete. 2024-09-15T23:55:19.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.570+0000 7eff9d731640 1 Processor -- start 2024-09-15T23:55:19.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.570+0000 7eff9d731640 1 -- start start 2024-09-15T23:55:19.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff9d731640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff9d731640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7eff98139cd0 con 0x7eff980a4c20 2024-09-15T23:55:19.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff96ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff96ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55796/0 (socket says 172.21.15.121:55796) 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff96ffd640 1 -- 172.21.15.121:0/947055628 learned_addr learned my addr 172.21.15.121:0/947055628 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff96ffd640 1 -- 172.21.15.121:0/947055628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff98125ab0 con 0x7eff980a4c20 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff96ffd640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c450 tx=0x7eff8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88007410 con 0x7eff980a4c20 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff880075b0 con 0x7eff980a4c20 2024-09-15T23:55:19.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff98124d60 con 0x7eff980a4c20 2024-09-15T23:55:19.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.571+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff88004910 con 0x7eff980a4c20 2024-09-15T23:55:19.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.572+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff981382b0 con 0x7eff980a4c20 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff8801a020 con 0x7eff980a4c20 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9806d7e0 con 0x7eff980a4c20 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff7f7fe640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 0x7eff8403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7eff8804aa20 con 0x7eff980a4c20 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff967fc640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 0x7eff8403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.573+0000 7eff967fc640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 0x7eff8403a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff8c034000 tx=0x7eff8c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.577+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff8801b9c0 con 0x7eff980a4c20 2024-09-15T23:55:19.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.781+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7eff981250e0 con 0x7eff980a4c20 2024-09-15T23:55:19.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.781+0000 7eff7f7fe640 1 -- 172.21.15.121:0/947055628 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7eff8801bc20 con 0x7eff980a4c20 2024-09-15T23:55:19.782 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:19.782 INFO:teuthology.orchestra.run.smithi121.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:55:19.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 msgr2=0x7eff8403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 0x7eff8403a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7eff8c034000 tx=0x7eff8c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:19.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 msgr2=0x7eff981254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7eff8800c450 tx=0x7eff8800c910 comp rx=0 tx=0).stop 2024-09-15T23:55:19.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 shutdown_connections 2024-09-15T23:55:19.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7eff840382a0 0x7eff8403a760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 --2- 172.21.15.121:0/947055628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7eff980a4c20 0x7eff981254b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 >> 172.21.15.121:0/947055628 conn(0x7eff980ac370 msgr2=0x7eff980ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 shutdown_connections 2024-09-15T23:55:19.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.783+0000 7eff9d731640 1 -- 172.21.15.121:0/947055628 wait complete. 2024-09-15T23:55:19.795 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T23:55:19.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.892+0000 7f6d205f6640 1 Processor -- start 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.892+0000 7f6d205f6640 1 -- start start 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d205f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d180a39c0 0x7f6d18132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d205f6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d180a16c0 con 0x7f6d18133470 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d205f6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6d180a1490 con 0x7f6d180a39c0 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1e392640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d180a39c0 0x7f6d18132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1db91640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6d18133470 0x7f6d18135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45510/0 (socket says 172.21.15.121:45510) 2024-09-15T23:55:19.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1e392640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d180a39c0 0x7f6d18132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55800/0 (socket says 172.21.15.121:55800) 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1db91640 1 -- 172.21.15.121:0/1485465873 learned_addr learned my addr 172.21.15.121:0/1485465873 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1e392640 1 -- 172.21.15.121:0/1485465873 >> v1:172.21.15.121:6789/0 conn(0x7f6d18133470 legacy=0x7f6d18135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1e392640 1 -- 172.21.15.121:0/1485465873 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180a4010 con 0x7f6d180a39c0 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.893+0000 7f6d1d390640 1 -- 172.21.15.121:0/1485465873 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552459073 0 0) 0x7f6d180a16c0 con 0x7f6d18133470 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d1e392640 1 --2- 172.21.15.121:0/1485465873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18132f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8c0 tx=0x7f6d1002b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46af398c194296c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d1d390640 1 -- 172.21.15.121:0/1485465873 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1000b040 con 0x7f6d180a39c0 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d1d390640 1 -- 172.21.15.121:0/1485465873 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10030640 con 0x7f6d180a39c0 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d1d390640 1 -- 172.21.15.121:0/1485465873 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10030940 con 0x7f6d180a39c0 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 -- 172.21.15.121:0/1485465873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 msgr2=0x7f6d18132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 --2- 172.21.15.121:0/1485465873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18132f30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8c0 tx=0x7f6d1002b4d0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 -- 172.21.15.121:0/1485465873 shutdown_connections 2024-09-15T23:55:19.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 --2- 172.21.15.121:0/1485465873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18132f30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:19.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 -- 172.21.15.121:0/1485465873 >> 172.21.15.121:0/1485465873 conn(0x7f6d180a85e0 msgr2=0x7f6d180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:19.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 -- 172.21.15.121:0/1485465873 shutdown_connections 2024-09-15T23:55:19.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.894+0000 7f6d205f6640 1 -- 172.21.15.121:0/1485465873 wait complete. 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.895+0000 7f6d205f6640 1 Processor -- start 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.895+0000 7f6d205f6640 1 -- start start 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d205f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d205f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181329c0 con 0x7f6d180a39c0 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d1e392640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d1e392640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55814/0 (socket says 172.21.15.121:55814) 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d1e392640 1 -- 172.21.15.121:0/2671064811 learned_addr learned my addr 172.21.15.121:0/2671064811 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:19.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d1e392640 1 -- 172.21.15.121:0/2671064811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1809e9e0 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d1e392640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8c0 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1003f030 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10033ad0 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10033df0 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d18070240 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.896+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1806ff30 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.897+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6d10042030 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.897+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d180711d0 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.898+0000 7f6d16ffd640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 0x7f6d0403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.898+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f6d10040070 con 0x7f6d180a39c0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.898+0000 7f6d1db91640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 0x7f6d0403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:19.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.898+0000 7f6d1db91640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 0x7f6d0403a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000c00 tx=0x7f6d0c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:19.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:19.902+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d1003b950 con 0x7f6d180a39c0 2024-09-15T23:55:20.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.103+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d180a23d0 con 0x7f6d180a39c0 2024-09-15T23:55:20.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.103+0000 7f6d16ffd640 1 -- 172.21.15.121:0/2671064811 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7f6d1003b430 con 0x7f6d180a39c0 2024-09-15T23:55:20.104 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:20.104 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:20.105 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:20.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 msgr2=0x7f6d0403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 0x7f6d0403a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000c00 tx=0x7f6d0c007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 msgr2=0x7f6d18070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8c0 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 shutdown_connections 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6d040382a0 0x7f6d0403a760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 --2- 172.21.15.121:0/2671064811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d180a39c0 0x7f6d18070c90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 >> 172.21.15.121:0/2671064811 conn(0x7f6d180a85e0 msgr2=0x7f6d180a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 shutdown_connections 2024-09-15T23:55:20.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.105+0000 7f6d205f6640 1 -- 172.21.15.121:0/2671064811 wait complete. 2024-09-15T23:55:20.119 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:20.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.217+0000 7ff892853640 1 Processor -- start 2024-09-15T23:55:20.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.217+0000 7ff892853640 1 -- start start 2024-09-15T23:55:20.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff892853640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff88c0a4c20 0x7ff88c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff892853640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c13a080 con 0x7ff88c13a280 2024-09-15T23:55:20.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff892853640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff88c0a3d50 con 0x7ff88c0a4c20 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff88c0a4c20 0x7ff88c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff88c13a280 0x7ff88c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45522/0 (socket says 172.21.15.121:45522) 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff88c0a4c20 0x7ff88c13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55820/0 (socket says 172.21.15.121:55820) 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88bfff640 1 -- 172.21.15.121:0/1592928009 learned_addr learned my addr 172.21.15.121:0/1592928009 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88b7fe640 1 -- 172.21.15.121:0/1592928009 >> v1:172.21.15.121:6789/0 conn(0x7ff88c13a280 legacy=0x7ff88c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88b7fe640 1 -- 172.21.15.121:0/1592928009 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c0a3f80 con 0x7ff88c0a4c20 2024-09-15T23:55:20.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.218+0000 7ff88affd640 1 -- 172.21.15.121:0/1592928009 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645233924 0 0) 0x7ff88c13a080 con 0x7ff88c13a280 2024-09-15T23:55:20.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.219+0000 7ff88b7fe640 1 --2- 172.21.15.121:0/1592928009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c13f060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff880009720 tx=0x7ff88002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b11e81dbd27341 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.219+0000 7ff88affd640 1 -- 172.21.15.121:0/1592928009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880037070 con 0x7ff88c0a4c20 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.219+0000 7ff88affd640 1 -- 172.21.15.121:0/1592928009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88002ad90 con 0x7ff88c0a4c20 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.219+0000 7ff88affd640 1 -- 172.21.15.121:0/1592928009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880032590 con 0x7ff88c0a4c20 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 -- 172.21.15.121:0/1592928009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 msgr2=0x7ff88c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 --2- 172.21.15.121:0/1592928009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c13f060 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff880009720 tx=0x7ff88002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 -- 172.21.15.121:0/1592928009 shutdown_connections 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 --2- 172.21.15.121:0/1592928009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c13f060 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 -- 172.21.15.121:0/1592928009 >> 172.21.15.121:0/1592928009 conn(0x7ff88c0ac3e0 msgr2=0x7ff88c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 -- 172.21.15.121:0/1592928009 shutdown_connections 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.220+0000 7ff892853640 1 -- 172.21.15.121:0/1592928009 wait complete. 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff892853640 1 Processor -- start 2024-09-15T23:55:20.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff892853640 1 -- start start 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff892853640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff892853640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0a7ec0 con 0x7ff88c0a4c20 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff88bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55834/0 (socket says 172.21.15.121:55834) 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.221+0000 7ff88bfff640 1 -- 172.21.15.121:0/1472878634 learned_addr learned my addr 172.21.15.121:0/1472878634 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff88bfff640 1 -- 172.21.15.121:0/1472878634 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c124f10 con 0x7ff88c0a4c20 2024-09-15T23:55:20.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff88bfff640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00c420 tx=0x7ff87c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c018070 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c0074d0 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c124690 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c004950 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.222+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1238a0 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff87c01b070 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff888ff9640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 0x7ff87803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c122b30 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7ff87c04a640 con 0x7ff88c0a4c20 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff88b7fe640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 0x7ff87803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.223+0000 7ff88b7fe640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 0x7ff87803a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff880034000 tx=0x7ff88002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.228+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff87c011980 con 0x7ff88c0a4c20 2024-09-15T23:55:20.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.425+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff88c0a2f00 con 0x7ff88c0a4c20 2024-09-15T23:55:20.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.425+0000 7ff888ff9640 1 -- 172.21.15.121:0/1472878634 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7ff87c011be0 con 0x7ff88c0a4c20 2024-09-15T23:55:20.426 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:20.427 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:20.427 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:20.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 msgr2=0x7ff87803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 0x7ff87803a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff880034000 tx=0x7ff88002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:20.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 msgr2=0x7ff88c0a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00c420 tx=0x7ff87c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 shutdown_connections 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff8780382a0 0x7ff87803a760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 --2- 172.21.15.121:0/1472878634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff88c0a4c20 0x7ff88c0a1080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 >> 172.21.15.121:0/1472878634 conn(0x7ff88c0ac3e0 msgr2=0x7ff88c139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 shutdown_connections 2024-09-15T23:55:20.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.427+0000 7ff892853640 1 -- 172.21.15.121:0/1472878634 wait complete. 2024-09-15T23:55:20.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.538+0000 7f01ef077640 1 Processor -- start 2024-09-15T23:55:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.538+0000 7f01ef077640 1 -- start start 2024-09-15T23:55:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ef077640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f01e80a39c0 0x7f01e80a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ef077640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e80a2280 con 0x7f01e809ee30 2024-09-15T23:55:20.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ef077640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f01e809e6e0 con 0x7f01e80a39c0 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ece13640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f01e80a39c0 0x7f01e80a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ece13640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f01e80a39c0 0x7f01e80a3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55840/0 (socket says 172.21.15.121:55840) 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ece13640 1 -- 172.21.15.121:0/3377969459 learned_addr learned my addr 172.21.15.121:0/3377969459 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01dffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f01e809ee30 0x7f01e8134760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45528/0 (socket says 172.21.15.121:45528) 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ece13640 1 -- 172.21.15.121:0/3377969459 >> v1:172.21.15.121:6789/0 conn(0x7f01e809ee30 legacy=0x7f01e8134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01df7fe640 1 -- 172.21.15.121:0/3377969459 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637848181 0 0) 0x7f01e80a2280 con 0x7f01e809ee30 2024-09-15T23:55:20.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.539+0000 7f01ece13640 1 -- 172.21.15.121:0/3377969459 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e809e3d0 con 0x7f01e80a39c0 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ece13640 1 --2- 172.21.15.121:0/3377969459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e80a39c0 0x7f01e80a3da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097f0 tx=0x7f01e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ad98c04f5b0d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01df7fe640 1 -- 172.21.15.121:0/3377969459 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4037070 con 0x7f01e80a39c0 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01df7fe640 1 -- 172.21.15.121:0/3377969459 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e4032440 con 0x7f01e80a39c0 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01df7fe640 1 -- 172.21.15.121:0/3377969459 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e402ae60 con 0x7f01e80a39c0 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 -- 172.21.15.121:0/3377969459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e80a39c0 msgr2=0x7f01e80a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 --2- 172.21.15.121:0/3377969459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e80a39c0 0x7f01e80a3da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097f0 tx=0x7f01e402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 -- 172.21.15.121:0/3377969459 shutdown_connections 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 --2- 172.21.15.121:0/3377969459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e80a39c0 0x7f01e80a3da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 -- 172.21.15.121:0/3377969459 >> 172.21.15.121:0/3377969459 conn(0x7f01e80a85e0 msgr2=0x7f01e80a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 -- 172.21.15.121:0/3377969459 shutdown_connections 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.540+0000 7f01ef077640 1 -- 172.21.15.121:0/3377969459 wait complete. 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.541+0000 7f01ef077640 1 Processor -- start 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.541+0000 7f01ef077640 1 -- start start 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ef077640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ef077640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01e80a1ed0 con 0x7f01e809ee30 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ece13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ece13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55854/0 (socket says 172.21.15.121:55854) 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ece13640 1 -- 172.21.15.121:0/2407368983 learned_addr learned my addr 172.21.15.121:0/2407368983 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:20.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ece13640 1 -- 172.21.15.121:0/2407368983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e8071640 con 0x7f01e809ee30 2024-09-15T23:55:20.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01ece13640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01e402a220 tx=0x7f01e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.542+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4037040 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.543+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e4004160 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.543+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e806f990 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.543+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e4004440 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.543+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e806f6c0 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01e403a070 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e80008d0 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01dd7fa640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 0x7f01d403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f01e406bba0 con 0x7f01e809ee30 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01dffff640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 0x7f01d403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.544+0000 7f01dffff640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 0x7f01d403a760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d8007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.548+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01e4041020 con 0x7f01e809ee30 2024-09-15T23:55:20.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.721+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01e8071360 con 0x7f01e809ee30 2024-09-15T23:55:20.723 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.722+0000 7f01dd7fa640 1 -- 172.21.15.121:0/2407368983 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f01e403c9f0 con 0x7f01e809ee30 2024-09-15T23:55:20.723 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:20.723 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:20.725 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 msgr2=0x7f01d403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 0x7f01d403a760 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d8007910 comp rx=0 tx=0).stop 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 msgr2=0x7f01e811e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f01e402a220 tx=0x7f01e40046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 shutdown_connections 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f01d40382a0 0x7f01d403a760 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 --2- 172.21.15.121:0/2407368983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01e809ee30 0x7f01e811e870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 >> 172.21.15.121:0/2407368983 conn(0x7f01e80a85e0 msgr2=0x7f01e8134e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 shutdown_connections 2024-09-15T23:55:20.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.724+0000 7f01ef077640 1 -- 172.21.15.121:0/2407368983 wait complete. 2024-09-15T23:55:20.736 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:20.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.833+0000 7f98c75fd640 1 Processor -- start 2024-09-15T23:55:20.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.833+0000 7f98c75fd640 1 -- start start 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.833+0000 7f98c75fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f98c00a39c0 0x7f98c0132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.833+0000 7f98c75fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c00a16c0 con 0x7f98c0133470 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.833+0000 7f98c75fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f98c00a1490 con 0x7f98c00a39c0 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c5399640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f98c00a39c0 0x7f98c0132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c4b98640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f98c0133470 0x7f98c0135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45538/0 (socket says 172.21.15.121:45538) 2024-09-15T23:55:20.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c5399640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f98c00a39c0 0x7f98c0132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55862/0 (socket says 172.21.15.121:55862) 2024-09-15T23:55:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c4b98640 1 -- 172.21.15.121:0/4076721544 learned_addr learned my addr 172.21.15.121:0/4076721544 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c5399640 1 -- 172.21.15.121:0/4076721544 >> v1:172.21.15.121:6789/0 conn(0x7f98c0133470 legacy=0x7f98c0135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c5399640 1 -- 172.21.15.121:0/4076721544 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c00a4010 con 0x7f98c00a39c0 2024-09-15T23:55:20.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.834+0000 7f98c5399640 1 --2- 172.21.15.121:0/4076721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c0132f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009720 tx=0x7f98bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2585d6f65872eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98b7fff640 1 -- 172.21.15.121:0/4076721544 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc037070 con 0x7f98c00a39c0 2024-09-15T23:55:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98b7fff640 1 -- 172.21.15.121:0/4076721544 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc02ad90 con 0x7f98c00a39c0 2024-09-15T23:55:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98b7fff640 1 -- 172.21.15.121:0/4076721544 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc032590 con 0x7f98c00a39c0 2024-09-15T23:55:20.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 -- 172.21.15.121:0/4076721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 msgr2=0x7f98c0132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 --2- 172.21.15.121:0/4076721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c0132f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009720 tx=0x7f98bc02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 -- 172.21.15.121:0/4076721544 shutdown_connections 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 --2- 172.21.15.121:0/4076721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c0132f30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 -- 172.21.15.121:0/4076721544 >> 172.21.15.121:0/4076721544 conn(0x7f98c00a85e0 msgr2=0x7f98c00a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 -- 172.21.15.121:0/4076721544 shutdown_connections 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.835+0000 7f98c75fd640 1 -- 172.21.15.121:0/4076721544 wait complete. 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.836+0000 7f98c75fd640 1 Processor -- start 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.836+0000 7f98c75fd640 1 -- start start 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c75fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c75fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f98c01329c0 con 0x7f98c00a39c0 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c5399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c5399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55874/0 (socket says 172.21.15.121:55874) 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c5399640 1 -- 172.21.15.121:0/948961829 learned_addr learned my addr 172.21.15.121:0/948961829 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c5399640 1 -- 172.21.15.121:0/948961829 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c009e040 con 0x7f98c00a39c0 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c5399640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98bc02ad60 tx=0x7f98bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc041020 con 0x7f98c00a39c0 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc03d550 con 0x7f98c00a39c0 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c009c510 con 0x7f98c00a39c0 2024-09-15T23:55:20.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.837+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc037040 con 0x7f98c00a39c0 2024-09-15T23:55:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.838+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c006ebc0 con 0x7f98c00a39c0 2024-09-15T23:55:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.838+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f98bc044020 con 0x7f98c00a39c0 2024-09-15T23:55:20.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.838+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c012fb60 con 0x7f98c00a39c0 2024-09-15T23:55:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.838+0000 7f98b5ffb640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 0x7f98a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.839+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f98bc06b800 con 0x7f98c00a39c0 2024-09-15T23:55:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.839+0000 7f98c4b98640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 0x7f98a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:20.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.839+0000 7f98c4b98640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 0x7f98a403a760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98b0007fd0 tx=0x7f98b0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:20.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:20.843+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98bc04b030 con 0x7f98c00a39c0 2024-09-15T23:55:21.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.041+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98c00a23d0 con 0x7f98c00a39c0 2024-09-15T23:55:21.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.041+0000 7f98b5ffb640 1 -- 172.21.15.121:0/948961829 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7f98bc03dbf0 con 0x7f98c00a39c0 2024-09-15T23:55:21.043 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:21.043 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:21.043 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 msgr2=0x7f98a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 0x7f98a403a760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f98b0007fd0 tx=0x7f98b0007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 msgr2=0x7f98c01ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f98bc02ad60 tx=0x7f98bc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 shutdown_connections 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f98a40382a0 0x7f98a403a760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 --2- 172.21.15.121:0/948961829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98c00a39c0 0x7f98c01ca690 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 >> 172.21.15.121:0/948961829 conn(0x7f98c00a85e0 msgr2=0x7f98c01309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.043+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 shutdown_connections 2024-09-15T23:55:21.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.044+0000 7f98c75fd640 1 -- 172.21.15.121:0/948961829 wait complete. 2024-09-15T23:55:21.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:55:12.005122+0000', 'modified': '2024-09-15T23:55:13.997733+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4146}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4146': {'gid': 4146, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6829/2618169623', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6827', 'nonce': 2618169623}, {'type': 'v1', 'addr': '172.21.15.121:6829', 'nonce': 2618169623}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4146, 'qdb_cluster': [4146]} 2024-09-15T23:55:21.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:55:21.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:55:21.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.355+0000 7fcd8d186640 1 Processor -- start 2024-09-15T23:55:21.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.355+0000 7fcd8d186640 1 -- start start 2024-09-15T23:55:21.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd8d186640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd88135b50 0x7fcd8809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd8d186640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8809b020 con 0x7fcd88135f30 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd8d186640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8809b310 con 0x7fcd88135b50 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd86d9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd88135b50 0x7fcd8809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd8659c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcd88135f30 0x7fcd880a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45548/0 (socket says 172.21.15.121:45548) 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd86d9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd88135b50 0x7fcd8809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55876/0 (socket says 172.21.15.121:55876) 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd8659c640 1 -- 172.21.15.121:0/444033443 learned_addr learned my addr 172.21.15.121:0/444033443 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd86d9d640 1 -- 172.21.15.121:0/444033443 >> v1:172.21.15.121:6789/0 conn(0x7fcd88135f30 legacy=0x7fcd880a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd85d9b640 1 -- 172.21.15.121:0/444033443 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138374792 0 0) 0x7fcd8809b020 con 0x7fcd88135f30 2024-09-15T23:55:21.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.356+0000 7fcd86d9d640 1 -- 172.21.15.121:0/444033443 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880a08c0 con 0x7fcd88135b50 2024-09-15T23:55:21.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/444033443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd8809aae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d90 tx=0x7fcd8002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3927c415df034d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd85d9b640 1 -- 172.21.15.121:0/444033443 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80007670 con 0x7fcd88135b50 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd85d9b640 1 -- 172.21.15.121:0/444033443 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80007810 con 0x7fcd88135b50 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd85d9b640 1 -- 172.21.15.121:0/444033443 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80007b10 con 0x7fcd88135b50 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd8d186640 1 -- 172.21.15.121:0/444033443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 msgr2=0x7fcd8809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.357+0000 7fcd8d186640 1 --2- 172.21.15.121:0/444033443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd8809aae0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d90 tx=0x7fcd8002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.358+0000 7fcd8d186640 1 -- 172.21.15.121:0/444033443 shutdown_connections 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.358+0000 7fcd8d186640 1 --2- 172.21.15.121:0/444033443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd8809aae0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.358+0000 7fcd8d186640 1 -- 172.21.15.121:0/444033443 >> 172.21.15.121:0/444033443 conn(0x7fcd880a85e0 msgr2=0x7fcd880a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.358+0000 7fcd8d186640 1 -- 172.21.15.121:0/444033443 shutdown_connections 2024-09-15T23:55:21.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.358+0000 7fcd8d186640 1 -- 172.21.15.121:0/444033443 wait complete. 2024-09-15T23:55:21.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd8d186640 1 Processor -- start 2024-09-15T23:55:21.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd8d186640 1 -- start start 2024-09-15T23:55:21.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd8d186640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd8d186640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880a5430 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55880/0 (socket says 172.21.15.121:55880) 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.359+0000 7fcd86d9d640 1 -- 172.21.15.121:0/2689023789 learned_addr learned my addr 172.21.15.121:0/2689023789 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd86d9d640 1 -- 172.21.15.121:0/2689023789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd88071970 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d90 tx=0x7fcd80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd7f7fe640 1 -- 172.21.15.121:0/2689023789 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80040070 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd7f7fe640 1 -- 172.21.15.121:0/2689023789 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd80007af0 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd88072360 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd7f7fe640 1 -- 172.21.15.121:0/2689023789 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80007e30 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.360+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd88071e60 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.361+0000 7fcd7f7fe640 1 -- 172.21.15.121:0/2689023789 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcd80039040 con 0x7fcd88135b50 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.361+0000 7fcd7f7fe640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 0x7fcd6803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.361+0000 7fcd7f7fe640 1 -- 172.21.15.121:0/2689023789 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fcd8006c570 con 0x7fcd88135b50 2024-09-15T23:55:21.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.361+0000 7fcd8659c640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 0x7fcd6803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.361+0000 7fcd8659c640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 0x7fcd6803a710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd70007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.362+0000 7fcd8fff6740 1 Processor -- start 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd8fff6740 1 -- start start 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd8fff6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd8fff6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c641aef520 con 0x55c641bad4e0 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55888/0 (socket says 172.21.15.121:55888) 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd86d9d640 1 -- 172.21.15.121:0/1021436066 learned_addr learned my addr 172.21.15.121:0/1021436066 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd86d9d640 1 -- 172.21.15.121:0/1021436066 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641ab22f0 con 0x55c641bad4e0 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.363+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/1021436066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd8004cc90 tx=0x7fcd8003bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1b5e928b500602 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd7cff9640 1 -- 172.21.15.121:0/1021436066 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80063070 con 0x55c641bad4e0 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd7cff9640 1 -- 172.21.15.121:0/1021436066 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8003c420 con 0x55c641bad4e0 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd7cff9640 1 -- 172.21.15.121:0/1021436066 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80049070 con 0x55c641bad4e0 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1021436066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 msgr2=0x55c641ba7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1021436066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd8004cc90 tx=0x7fcd8003bc00 comp rx=0 tx=0).stop 2024-09-15T23:55:21.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1021436066 shutdown_connections 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1021436066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7f10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1021436066 >> 172.21.15.121:0/1021436066 conn(0x55c641b8a1d0 msgr2=0x55c641b8af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1021436066 shutdown_connections 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.364+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1021436066 wait complete. 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd8fff6740 1 -- start start 2024-09-15T23:55:21.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd8fff6740 1 Processor -- start 2024-09-15T23:55:21.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd8fff6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd8fff6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c641aeb4e0 con 0x55c641bad4e0 2024-09-15T23:55:21.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd8fff6740 10 client.0 _ll_register_callbacks cb 0x55c641801ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55890/0 (socket says 172.21.15.121:55890) 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.365+0000 7fcd86d9d640 1 -- 172.21.15.121:0/2567325298 learned_addr learned my addr 172.21.15.121:0/2567325298 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd86d9d640 1 -- 172.21.15.121:0/2567325298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6418022d0 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003bc40 tx=0x7fcd80032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74e9ad915f88688 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80063070 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fcd80053040 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd8003c420 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fcd80003990 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 10 client.4248 fetch_fsmap learned FSMap version 6 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c6418cc6b0 con 0x55c641bad4e0 2024-09-15T23:55:21.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8003c420 con 0x55c641bad4e0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 6) ==== 2292+0+0 (secure 0 0 0) 0x7fcd80003bb0 con 0x55c641bad4e0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 10 client.4248 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 10 client.4248 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 20 client.4248 populate_metadata read hostname 'smithi121' 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641bafad0 0x55c641bbc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 4 client.4248 mds_command: new command op to 4146 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 --> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c641afcc50 con 0x55c641bafad0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.366+0000 7fcd8659c640 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641bafad0 0x55c641bbc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd65ffb640 10 client.4248 ms_handle_connect on v2:172.21.15.121:6827/2618169623 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8659c640 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641bafad0 0x55c641bbc4f0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15786036ce084c93 server_cookie=943a370b2300edc4 in_seq=0 out_seq=0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd65ffb640 1 -- 172.21.15.121:0/2567325298 <== mds.0 v2:172.21.15.121:6827/2618169623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c641afcc50 con 0x55c641bafad0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd65ffb640 10 client.4248 handle_command_reply: tid=0 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 client.4248 shutdown 2024-09-15T23:55:21.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 msgr2=0x55c641bb2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003bc40 tx=0x7fcd80032f90 comp rx=0 tx=0).stop 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 shutdown_connections 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641bafad0 0x55c641bbc4f0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/2567325298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bb2e50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd65ffb640 0 client.4248 ms_handle_reset on v2:172.21.15.121:6827/2618169623 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 >> 172.21.15.121:0/2567325298 conn(0x55c641b8a1d0 msgr2=0x55c641ba7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 shutdown_connections 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.367+0000 7fcd8fff6740 1 -- 172.21.15.121:0/2567325298 wait complete. 2024-09-15T23:55:21.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.368+0000 7fcd8fff6740 20 client.4248 trim_cache size 0 max 16384 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.385+0000 7fcd8fff6740 1 Processor -- start 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.385+0000 7fcd8fff6740 1 -- start start 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.385+0000 7fcd8fff6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.385+0000 7fcd8fff6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c641bb0fe0 con 0x55c641bad4e0 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.388 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55904/0 (socket says 172.21.15.121:55904) 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd86d9d640 1 -- 172.21.15.121:0/3667759752 learned_addr learned my addr 172.21.15.121:0/3667759752 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd86d9d640 1 -- 172.21.15.121:0/3667759752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641b836c0 con 0x55c641bad4e0 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/3667759752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd8006b4b0 tx=0x7fcd80063000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5719562c246d0e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd67fff640 1 -- 172.21.15.121:0/3667759752 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd8003c550 con 0x55c641bad4e0 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd67fff640 1 -- 172.21.15.121:0/3667759752 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8005b070 con 0x55c641bad4e0 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd67fff640 1 -- 172.21.15.121:0/3667759752 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80030dd0 con 0x55c641bad4e0 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.386+0000 7fcd8fff6740 1 -- 172.21.15.121:0/3667759752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 msgr2=0x55c641ba7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/3667759752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcd8006b4b0 tx=0x7fcd80063000 comp rx=0 tx=0).stop 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- 172.21.15.121:0/3667759752 shutdown_connections 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/3667759752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641ba7de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- 172.21.15.121:0/3667759752 >> 172.21.15.121:0/3667759752 conn(0x55c641b8a1d0 msgr2=0x55c641b8aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- 172.21.15.121:0/3667759752 shutdown_connections 2024-09-15T23:55:21.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- 172.21.15.121:0/3667759752 wait complete. 2024-09-15T23:55:21.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- start start 2024-09-15T23:55:21.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 Processor -- start 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880a65e0 con 0x55c641bad4e0 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.387+0000 7fcd8fff6740 10 client.0 _ll_register_callbacks cb 0x7fcd8004cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd86d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55906/0 (socket says 172.21.15.121:55906) 2024-09-15T23:55:21.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd86d9d640 1 -- 172.21.15.121:0/1358765575 learned_addr learned my addr 172.21.15.121:0/1358765575 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd86d9d640 1 -- 172.21.15.121:0/1358765575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c641bb64e0 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd86d9d640 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003afd0 tx=0x7fcd80038400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e484a931f21d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd80063050 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fcd80053070 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd8005b070 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fcd80003b30 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 10 client.4250 fetch_fsmap learned FSMap version 6 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c641bb64e0 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8005b070 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 6) ==== 2292+0+0 (secure 0 0 0) 0x7fcd8003b3b0 con 0x55c641bad4e0 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 10 client.4250 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 10 client.4250 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:55:21.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 20 client.4250 populate_metadata read hostname 'smithi121' 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641ba6e70 0x55c641ba72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 4 client.4250 mds_command: new command op to 4146 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.388+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 --> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] -- command(tid 0: {"prefix": "status"}) -- 0x55c641af6fa0 con 0x55c641ba6e70 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8659c640 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641ba6e70 0x55c641ba72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd65ffb640 10 client.4250 ms_handle_connect on v2:172.21.15.121:6827/2618169623 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8659c640 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641ba6e70 0x55c641ba72b0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb9470472e5fd8c5 server_cookie=15aa52e76ba8c54b in_seq=0 out_seq=0 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd65ffb640 1 -- 172.21.15.121:0/1358765575 <== mds.0 v2:172.21.15.121:6827/2618169623 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55c641af6fa0 con 0x55c641ba6e70 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd65ffb640 10 client.4250 handle_command_reply: tid=0 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 client.4250 shutdown 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 msgr2=0x55c641bc6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003afd0 tx=0x7fcd80038400 comp rx=0 tx=0).stop 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 shutdown_connections 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:6827/2618169623,v1:172.21.15.121:6829/2618169623] conn(0x55c641ba6e70 0x55c641ba72b0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 --2- 172.21.15.121:0/1358765575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c641bad4e0 0x55c641bc6a90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd65ffb640 0 client.4250 ms_handle_reset on v2:172.21.15.121:6827/2618169623 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 >> 172.21.15.121:0/1358765575 conn(0x55c641b8a1d0 msgr2=0x55c641b8ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 shutdown_connections 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 1 -- 172.21.15.121:0/1358765575 wait complete. 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.389+0000 7fcd8fff6740 20 client.4250 trim_cache size 0 max 16384 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "822f5905-71ec-4c9e-8017-14fcc3976ad1", 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4146, 2024-09-15T23:55:21.396 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 8.7127820269999994, 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 6, 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 17, 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 17, 2024-09-15T23:55:21.397 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 14.743483349 2024-09-15T23:55:21.398 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:21.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 msgr2=0x7fcd6803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 0x7fcd6803a710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd70000c00 tx=0x7fcd70007910 comp rx=0 tx=0).stop 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 msgr2=0x7fcd881ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009d90 tx=0x7fcd80004a40 comp rx=0 tx=0).stop 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 shutdown_connections 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcd68038250 0x7fcd6803a710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 --2- 172.21.15.121:0/2689023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd88135b50 0x7fcd881ce5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 >> 172.21.15.121:0/2689023789 conn(0x7fcd880a85e0 msgr2=0x7fcd880a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 shutdown_connections 2024-09-15T23:55:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:21.390+0000 7fcd8d186640 1 -- 172.21.15.121:0/2689023789 wait complete. 2024-09-15T23:55:21.401 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T23:55:22.018 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T23:55:22.018 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T23:55:22.019 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T23:55:22.019 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-15T23:55:22.492 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-15T23:55:22.492 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-15T23:55:22.492 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-15T23:55:22.492 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:55:22.492 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:22.492 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-15T23:55:22.493 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:55:22.493 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:22.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:22.493 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:55:22.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:22.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-15T23:55:22.586 INFO:teuthology.orchestra.run.smithi121.stderr:Cannot find device "ceph-brx" 2024-09-15T23:55:22.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:55:22.587 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-15T23:55:22.587 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:55:22.587 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.733+0000 7fd5762d0640 1 Processor -- start 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.733+0000 7fd5762d0640 1 -- start start 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.733+0000 7fd5762d0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd570135f30 0x7fd57013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.733+0000 7fd5762d0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5700a08c0 con 0x7fd570135b50 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.733+0000 7fd5762d0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd57009b310 con 0x7fd570135f30 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd570135f30 0x7fd57013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd570135f30 0x7fd57013bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59940/0 (socket says 172.21.15.121:59940) 2024-09-15T23:55:22.735 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd570135b50 0x7fd57009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:37978/0 (socket says 172.21.15.121:37978) 2024-09-15T23:55:22.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56f7fe640 1 -- 172.21.15.121:0/705925533 learned_addr learned my addr 172.21.15.121:0/705925533 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:22.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56f7fe640 1 -- 172.21.15.121:0/705925533 >> v1:172.21.15.121:6789/0 conn(0x7fd570135b50 legacy=0x7fd57009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56f7fe640 1 -- 172.21.15.121:0/705925533 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5700a2270 con 0x7fd570135f30 2024-09-15T23:55:22.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.734+0000 7fd56effd640 1 -- 172.21.15.121:0/705925533 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650292083 0 0) 0x7fd5700a08c0 con 0x7fd570135b50 2024-09-15T23:55:22.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd56f7fe640 1 --2- 172.21.15.121:0/705925533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135f30 0x7fd57013bb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5640097f0 tx=0x7fd56402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff2d12a1d3aaf37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd56effd640 1 -- 172.21.15.121:0/705925533 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd564037070 con 0x7fd570135f30 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd56effd640 1 -- 172.21.15.121:0/705925533 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd564032440 con 0x7fd570135f30 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd56effd640 1 -- 172.21.15.121:0/705925533 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd564032740 con 0x7fd570135f30 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 -- 172.21.15.121:0/705925533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135f30 msgr2=0x7fd57013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 --2- 172.21.15.121:0/705925533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135f30 0x7fd57013bb80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd5640097f0 tx=0x7fd56402a270 comp rx=0 tx=0).stop 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 -- 172.21.15.121:0/705925533 shutdown_connections 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 --2- 172.21.15.121:0/705925533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135f30 0x7fd57013bb80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 -- 172.21.15.121:0/705925533 >> 172.21.15.121:0/705925533 conn(0x7fd5700a85e0 msgr2=0x7fd5700a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 -- 172.21.15.121:0/705925533 shutdown_connections 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.735+0000 7fd5762d0640 1 -- 172.21.15.121:0/705925533 wait complete. 2024-09-15T23:55:22.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.736+0000 7fd5762d0640 1 Processor -- start 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.736+0000 7fd5762d0640 1 -- start start 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd5762d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd5762d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd570136350 con 0x7fd570135b50 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59948/0 (socket says 172.21.15.121:59948) 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd56ffff640 1 -- 172.21.15.121:0/2260355914 learned_addr learned my addr 172.21.15.121:0/2260355914 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd56ffff640 1 -- 172.21.15.121:0/2260355914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd570124290 con 0x7fd570135b50 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.737+0000 7fd56ffff640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c420 tx=0x7fd56000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd560018070 con 0x7fd570135b50 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5600074d0 con 0x7fd570135b50 2024-09-15T23:55:22.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd560004950 con 0x7fd570135b50 2024-09-15T23:55:22.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5700a2d40 con 0x7fd570135b50 2024-09-15T23:55:22.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5700a0140 con 0x7fd570135b50 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.738+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd56001b070 con 0x7fd570135b50 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.739+0000 7fd56cff9640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 0x7fd55c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.739+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57009aae0 con 0x7fd570135b50 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.739+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fd56004a560 con 0x7fd570135b50 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.739+0000 7fd56f7fe640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 0x7fd55c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.739+0000 7fd56f7fe640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 0x7fd55c03a760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd564034000 tx=0x7fd56402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:22.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.743+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd560011980 con 0x7fd570135b50 2024-09-15T23:55:22.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.943+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd5700a1f10 con 0x7fd570135b50 2024-09-15T23:55:22.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.944+0000 7fd56cff9640 1 -- 172.21.15.121:0/2260355914 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fd560011be0 con 0x7fd570135b50 2024-09-15T23:55:22.945 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 msgr2=0x7fd55c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 0x7fd55c03a760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd564034000 tx=0x7fd56402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 msgr2=0x7fd570120c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c420 tx=0x7fd56000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 shutdown_connections 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd55c0382a0 0x7fd55c03a760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 --2- 172.21.15.121:0/2260355914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd570135b50 0x7fd570120c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 >> 172.21.15.121:0/2260355914 conn(0x7fd5700a85e0 msgr2=0x7fd57009d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 shutdown_connections 2024-09-15T23:55:22.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:22.946+0000 7fd5762d0640 1 -- 172.21.15.121:0/2260355914 wait complete. 2024-09-15T23:55:22.957 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:55:22.958 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:22.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:22.959 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:55:22.974 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:22.974 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:22.975 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42809sec preferred_lft 42809sec 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:55:22.976 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:22.977 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr flush dev ceph-brx 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set ceph-brx up 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:55:22.977 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:23.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:23.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:23.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:23.173 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:55:23.197 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:55:23.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:23.199 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:55:23.265 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:55:23.265 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:55:23.265 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:55:23.265 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:55:23.266 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:55:23.266 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:23.266 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:23.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:55:23.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:55:23.266 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:55:23.267 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:23.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:23.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:23.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:23.552 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:55:23.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:23.569 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-09-15T23:55:23.625 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:23.625 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:23.625 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:23.625 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T23:55:23.625 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:23.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:23.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:23.745 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T23:55:23.745 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T23:55:23.746 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:23.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:23.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:23.879 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:23.879 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:23.879 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-15T23:55:23.880 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:55:23.880 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:23.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:23.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:23.957 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:55:23.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:23.958 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:23.972 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:23.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:23.972 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:24.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:24.095 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:24.151 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:24.152 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:24.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:24.154 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:24.206 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:55:24.207 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:55:24.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:24.274 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:24.330 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:24.330 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:24.331 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:24.332 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:24.333 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:24.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:24.333 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:24.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-09-15T23:55:24.353+0000 7f65e37d8480 -1 init, newargv = 0x559f0f142bb0 newargc=15 2024-09-15T23:55:24.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[41565]: starting ceph client 2024-09-15T23:55:24.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[41565]: starting fuse 2024-09-15T23:55:24.370 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:24.371 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:55:24.371 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:55:24.372 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:24.373 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:24.373 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:55:24.373 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:55:24.489 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.41565.asok 2024-09-15T23:55:24.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:24.499 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41565.asok 2024-09-15T23:55:24.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:24.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41565.asok status 2024-09-15T23:55:24.633 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:24.633 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "41565", 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4256, 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:55:24.634 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4256 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 995728309 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 995728309 2024-09-15T23:55:24.635 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4256 192.168.0.1:0/995728309", 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/995728309", 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 6, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 17, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:55:24.636 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:24.642 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-15T23:55:24.642 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:55:24.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.739+0000 7fcbf4d81640 1 Processor -- start 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.739+0000 7fcbf4d81640 1 -- start start 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.739+0000 7fcbf4d81640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcbf0135f30 0x7fcbf013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.739+0000 7fcbf4d81640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf00a08c0 con 0x7fcbf0135b50 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.739+0000 7fcbf4d81640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf009b310 con 0x7fcbf0135f30 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbedd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcbf0135f30 0x7fcbf013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbee59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcbf0135b50 0x7fcbf009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:37990/0 (socket says 172.21.15.121:37990) 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbedd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcbf0135f30 0x7fcbf013bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59954/0 (socket says 172.21.15.121:59954) 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbee59c640 1 -- 172.21.15.121:0/3803709137 learned_addr learned my addr 172.21.15.121:0/3803709137 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbedd9b640 1 -- 172.21.15.121:0/3803709137 >> v1:172.21.15.121:6789/0 conn(0x7fcbf0135b50 legacy=0x7fcbf009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbed59a640 1 -- 172.21.15.121:0/3803709137 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991921453 0 0) 0x7fcbf00a08c0 con 0x7fcbf0135b50 2024-09-15T23:55:24.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.740+0000 7fcbedd9b640 1 -- 172.21.15.121:0/3803709137 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00a2270 con 0x7fcbf0135f30 2024-09-15T23:55:24.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbedd9b640 1 --2- 172.21.15.121:0/3803709137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135f30 0x7fcbf013bb80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009720 tx=0x7fcbe402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3bbfa6665d09e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbed59a640 1 -- 172.21.15.121:0/3803709137 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe4037070 con 0x7fcbf0135f30 2024-09-15T23:55:24.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbed59a640 1 -- 172.21.15.121:0/3803709137 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe402ae20 con 0x7fcbf0135f30 2024-09-15T23:55:24.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbed59a640 1 -- 172.21.15.121:0/3803709137 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe4032590 con 0x7fcbf0135f30 2024-09-15T23:55:24.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 -- 172.21.15.121:0/3803709137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135f30 msgr2=0x7fcbf013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/3803709137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135f30 0x7fcbf013bb80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009720 tx=0x7fcbe402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 -- 172.21.15.121:0/3803709137 shutdown_connections 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/3803709137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135f30 0x7fcbf013bb80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 -- 172.21.15.121:0/3803709137 >> 172.21.15.121:0/3803709137 conn(0x7fcbf00a85e0 msgr2=0x7fcbf00a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 -- 172.21.15.121:0/3803709137 shutdown_connections 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.741+0000 7fcbf4d81640 1 -- 172.21.15.121:0/3803709137 wait complete. 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.742+0000 7fcbf4d81640 1 Processor -- start 2024-09-15T23:55:24.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbf4d81640 1 -- start start 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbf4d81640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbf4d81640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0136350 con 0x7fcbf0135b50 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59958/0 (socket says 172.21.15.121:59958) 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbee59c640 1 -- 172.21.15.121:0/1952903651 learned_addr learned my addr 172.21.15.121:0/1952903651 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbee59c640 1 -- 172.21.15.121:0/1952903651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf00737b0 con 0x7fcbf0135b50 2024-09-15T23:55:24.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.743+0000 7fcbee59c640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c420 tx=0x7fcbe000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0018070 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe00074d0 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf0072120 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0004950 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf00732d0 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.744+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fcbe001b070 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.745+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf00730c0 con 0x7fcbf0135b50 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.745+0000 7fcbdeffd640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 0x7fcbd003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:24.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.745+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fcbe004a670 con 0x7fcbf0135b50 2024-09-15T23:55:24.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.745+0000 7fcbedd9b640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 0x7fcbd003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:24.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.745+0000 7fcbedd9b640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 0x7fcbd003a760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:24.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.749+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbe0011960 con 0x7fcbf0135b50 2024-09-15T23:55:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.951+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcbf009aae0 con 0x7fcbf0135b50 2024-09-15T23:55:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.951+0000 7fcbdeffd640 1 -- 172.21.15.121:0/1952903651 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fcbe0011bc0 con 0x7fcbf0135b50 2024-09-15T23:55:24.953 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 msgr2=0x7fcbd003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 0x7fcbd003a760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 msgr2=0x7fcbf0071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c420 tx=0x7fcbe000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 shutdown_connections 2024-09-15T23:55:24.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fcbd00382a0 0x7fcbd003a760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 --2- 172.21.15.121:0/1952903651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbf0135b50 0x7fcbf0071440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:24.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 >> 172.21.15.121:0/1952903651 conn(0x7fcbf00a85e0 msgr2=0x7fcbf01bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:24.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 shutdown_connections 2024-09-15T23:55:24.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:24.953+0000 7fcbf4d81640 1 -- 172.21.15.121:0/1952903651 wait complete. 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:55:24.966 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:55:24.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:24.967 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:55:24.982 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:24.983 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42807sec preferred_lft 42807sec 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:24.984 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:24.985 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link tentative 2024-09-15T23:55:24.985 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:24.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:24.985 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:55:25.046 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:55:25.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.048 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:55:25.105 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:55:25.105 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:55:25.105 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:55:25.105 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:55:25.105 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:55:25.106 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:25.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:25.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.232 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:55:25.247 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:55:25.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.247 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list-id 2024-09-15T23:55:25.301 INFO:teuthology.orchestra.run.smithi121.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T23:55:25.302 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:25.302 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:25.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:25.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 1 2024-09-15T23:55:25.302 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:25.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:25.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:25.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.417 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:55:25.441 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether b2:4a:87:a4:0b:1c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::b04a:87ff:fea4:b1c/64 scope link tentative 2024-09-15T23:55:25.442 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:25.508 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether b2:4a:87:a4:0b:1c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::b04a:87ff:fea4:b1c/64 scope link tentative 2024-09-15T23:55:25.509 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:25.514 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.2/16 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.1 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T23:55:25.515 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:25.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:25.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:25.665 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:25.666 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:25.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:55:25.666 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T23:55:25.666 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:25.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:25.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:25.743 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:55:25.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:25.743 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:25.758 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:55:25.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:25.758 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:25.814 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:25.879 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:25.936 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:25.937 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:25.938 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:25.939 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:25.941 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:25.942 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:25.942 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:25.942 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:25.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:25.943 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:25.992 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:25.992 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:55:25.993 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:55:26.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:26.060 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:26.117 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:26.118 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:26.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.119 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:26.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:55:26.114+0000 7fc7a6a24480 -1 init, newargv = 0x556c7e1caaf0 newargc=15 2024-09-15T23:55:26.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[42046]: starting ceph client 2024-09-15T23:55:26.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[42046]: starting fuse 2024-09-15T23:55:26.134 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:26.134 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:55:26.135 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:55:26.135 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:26.136 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:55:26.137 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:55:26.254 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.42046.asok 2024-09-15T23:55:26.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:26.264 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42046.asok 2024-09-15T23:55:26.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.264 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42046.asok status 2024-09-15T23:55:26.396 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "42046", 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:55:26.397 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4262, 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4262 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 426084962 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:26.398 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 426084962 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4262 192.168.0.2:0/426084962", 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/426084962", 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 6, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 17, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:55:26.399 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:26.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.405 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:55:26.405 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:26.420 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:55:26.421 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:26.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:26.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.487 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:55:26.487 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:26.542 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:55:26.543 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:26.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:26.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:26.610 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T23:55:26.645 INFO:tasks.cephfs_test_runner:Starting test: test_dump (tasks.cephfs.test_fstop.TestFSTop) Tests 'cephfs-top --dump' output is valid 2024-09-15T23:55:26.646 INFO:tasks.cephfs_test_runner:test_dump (tasks.cephfs.test_fstop.TestFSTop) 2024-09-15T23:55:26.646 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:26.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.746+0000 7f95cb92a640 1 Processor -- start 2024-09-15T23:55:26.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.746+0000 7f95cb92a640 1 -- start start 2024-09-15T23:55:26.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.746+0000 7f95cb92a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95c4135b50 0x7f95c409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.746+0000 7f95cb92a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c409b020 con 0x7f95c4135f30 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.746+0000 7f95cb92a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f95c409b310 con 0x7f95c4135b50 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.747+0000 7f95c96c6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95c4135b50 0x7f95c409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.747+0000 7f95c8ec5640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f95c4135f30 0x7f95c40a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:37998/0 (socket says 172.21.15.121:37998) 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.747+0000 7f95c8ec5640 1 -- 172.21.15.121:0/453633272 learned_addr learned my addr 172.21.15.121:0/453633272 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.747+0000 7f95c96c6640 1 -- 172.21.15.121:0/453633272 >> v1:172.21.15.121:6789/0 conn(0x7f95c4135f30 legacy=0x7f95c40a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.747+0000 7f95c96c6640 1 -- 172.21.15.121:0/453633272 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c40a08c0 con 0x7f95c4135b50 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95c96c6640 1 --2- 172.21.15.121:0/453633272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c409aae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009720 tx=0x7f95c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cf1b2940c7d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95bbfff640 1 -- 172.21.15.121:0/453633272 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c0037070 con 0x7f95c4135b50 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95bbfff640 1 -- 172.21.15.121:0/453633272 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c002ae20 con 0x7f95c4135b50 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95bbfff640 1 -- 172.21.15.121:0/453633272 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c0032590 con 0x7f95c4135b50 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 -- 172.21.15.121:0/453633272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 msgr2=0x7f95c409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 --2- 172.21.15.121:0/453633272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c409aae0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009720 tx=0x7f95c002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 -- 172.21.15.121:0/453633272 shutdown_connections 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 --2- 172.21.15.121:0/453633272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c409aae0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 -- 172.21.15.121:0/453633272 >> 172.21.15.121:0/453633272 conn(0x7f95c40a85e0 msgr2=0x7f95c40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 -- 172.21.15.121:0/453633272 shutdown_connections 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.748+0000 7f95cb92a640 1 -- 172.21.15.121:0/453633272 wait complete. 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.749+0000 7f95cb92a640 1 Processor -- start 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.749+0000 7f95cb92a640 1 -- start start 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95cb92a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95cb92a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95c40a5430 con 0x7f95c4135b50 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95c96c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95c96c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59966/0 (socket says 172.21.15.121:59966) 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95c96c6640 1 -- 172.21.15.121:0/2296674999 learned_addr learned my addr 172.21.15.121:0/2296674999 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95c96c6640 1 -- 172.21.15.121:0/2296674999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c4123e80 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95c96c6640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95c002adf0 tx=0x7f95c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c0041070 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c003c590 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c4124100 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.750+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95c0037040 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.751+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c40a2f80 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.751+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f95c0044070 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.751+0000 7f95b9ffb640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 0x7f95a803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.751+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f95c006b9d0 con 0x7f95c4135b50 2024-09-15T23:55:26.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.752+0000 7f95c8ec5640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 0x7f95a803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:26.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.752+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c4136350 con 0x7f95c4135b50 2024-09-15T23:55:26.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.752+0000 7f95c8ec5640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 0x7f95a803a760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fd0 tx=0x7f95b4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:26.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.756+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95c002ae20 con 0x7f95c4135b50 2024-09-15T23:55:26.924 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.922+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95c406bde0 con 0x7f95c4135b50 2024-09-15T23:55:26.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.923+0000 7f95b9ffb640 1 -- 172.21.15.121:0/2296674999 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f95c4123e80 con 0x7f95c4135b50 2024-09-15T23:55:26.925 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:26.925 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 msgr2=0x7f95a803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 0x7f95a803a760 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fd0 tx=0x7f95b4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 msgr2=0x7f95c4120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95c002adf0 tx=0x7f95c00046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 shutdown_connections 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f95a80382a0 0x7f95a803a760 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 --2- 172.21.15.121:0/2296674999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95c4135b50 0x7f95c4120d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 >> 172.21.15.121:0/2296674999 conn(0x7f95c40a85e0 msgr2=0x7f95c409d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 shutdown_connections 2024-09-15T23:55:26.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:26.925+0000 7f95cb92a640 1 -- 172.21.15.121:0/2296674999 wait complete. 2024-09-15T23:55:26.938 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:55:04.051077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:55:09.813062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:55:10.987503+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:55:26.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:55:27.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.038+0000 7f6eb6ba6640 1 Processor -- start 2024-09-15T23:55:27.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.038+0000 7f6eb6ba6640 1 -- start start 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb6ba6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6eb00a37b0 0x7f6eb009f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb6ba6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb009ce40 con 0x7f6eb00a3b90 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb6ba6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb009f960 con 0x7f6eb00a37b0 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb4942640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6eb00a37b0 0x7f6eb009f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eaffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6eb00a3b90 0x7f6eb00a4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38002/0 (socket says 172.21.15.121:38002) 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eaffff640 1 -- 172.21.15.121:0/3482017869 learned_addr learned my addr 172.21.15.121:0/3482017869 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb4942640 1 -- 172.21.15.121:0/3482017869 >> v1:172.21.15.121:6789/0 conn(0x7f6eb00a3b90 legacy=0x7f6eb00a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.039+0000 7f6eb4942640 1 -- 172.21.15.121:0/3482017869 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb009d7a0 con 0x7f6eb00a37b0 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb4942640 1 --2- 172.21.15.121:0/3482017869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb009f230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009720 tx=0x7f6ea002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520400abc1819072 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eaf7fe640 1 -- 172.21.15.121:0/3482017869 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0037070 con 0x7f6eb00a37b0 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eaf7fe640 1 -- 172.21.15.121:0/3482017869 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea002ad90 con 0x7f6eb00a37b0 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eaf7fe640 1 -- 172.21.15.121:0/3482017869 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0032590 con 0x7f6eb00a37b0 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/3482017869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 msgr2=0x7f6eb009f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/3482017869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb009f230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009720 tx=0x7f6ea002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/3482017869 shutdown_connections 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/3482017869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb009f230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.040+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/3482017869 >> 172.21.15.121:0/3482017869 conn(0x7f6eb00a8430 msgr2=0x7f6eb00a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.041+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/3482017869 shutdown_connections 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.041+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/3482017869 wait complete. 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.041+0000 7f6eb6ba6640 1 Processor -- start 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.041+0000 7f6eb6ba6640 1 -- start start 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb6ba6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb6ba6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb00a5220 con 0x7f6eb00a37b0 2024-09-15T23:55:27.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb4942640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb4942640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59990/0 (socket says 172.21.15.121:59990) 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb4942640 1 -- 172.21.15.121:0/1561959648 learned_addr learned my addr 172.21.15.121:0/1561959648 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb4942640 1 -- 172.21.15.121:0/1561959648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0070db0 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.042+0000 7f6eb4942640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009840 tx=0x7f6ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0041070 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea003c460 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb009c9d0 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0037040 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb0071070 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.043+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6ea0044070 con 0x7f6eb00a37b0 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.044+0000 7f6ead7fa640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 0x7f6e9c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.044+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f6ea006ba70 con 0x7f6eb00a37b0 2024-09-15T23:55:27.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.044+0000 7f6eaffff640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 0x7f6e9c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.044+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb009e840 con 0x7f6eb00a37b0 2024-09-15T23:55:27.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.044+0000 7f6eaffff640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 0x7f6e9c03a760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.048+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ea0044360 con 0x7f6eb00a37b0 2024-09-15T23:55:27.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.214+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6eb009f210 con 0x7f6eb00a37b0 2024-09-15T23:55:27.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.214+0000 7f6ead7fa640 1 -- 172.21.15.121:0/1561959648 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f6ea003c780 con 0x7f6eb00a37b0 2024-09-15T23:55:27.216 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-15T23:55:27.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 msgr2=0x7f6e9c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 0x7f6e9c03a760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4007fd0 tx=0x7f6ea4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 msgr2=0x7f6eb0070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009840 tx=0x7f6ea00046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 shutdown_connections 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6e9c0382a0 0x7f6e9c03a760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 --2- 172.21.15.121:0/1561959648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb00a37b0 0x7f6eb0070190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 >> 172.21.15.121:0/1561959648 conn(0x7f6eb00a8430 msgr2=0x7f6eb00a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 shutdown_connections 2024-09-15T23:55:27.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.216+0000 7f6eb6ba6640 1 -- 172.21.15.121:0/1561959648 wait complete. 2024-09-15T23:55:27.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:55:27.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.328+0000 7f0ead1c4640 1 Processor -- start 2024-09-15T23:55:27.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ead1c4640 1 -- start start 2024-09-15T23:55:27.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ead1c4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ea80a3b90 0x7f0ea80a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ead1c4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea80a4560 con 0x7f0ea80a37b0 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ead1c4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea809b4f0 con 0x7f0ea80a3b90 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ea659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ea80a3b90 0x7f0ea80a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ea6d9d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0ea80a37b0 0x7f0ea809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38014/0 (socket says 172.21.15.121:38014) 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ea6d9d640 1 -- 172.21.15.121:0/1966249010 learned_addr learned my addr 172.21.15.121:0/1966249010 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ea659c640 1 -- 172.21.15.121:0/1966249010 >> v1:172.21.15.121:6789/0 conn(0x7f0ea80a37b0 legacy=0x7f0ea809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.329+0000 7f0ea659c640 1 -- 172.21.15.121:0/1966249010 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80a1c90 con 0x7f0ea80a3b90 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.330+0000 7f0ea659c640 1 --2- 172.21.15.121:0/1966249010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a3b90 0x7f0ea80a4020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009720 tx=0x7f0e9002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70c154a5866b41c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.330+0000 7f0ea5d9b640 1 -- 172.21.15.121:0/1966249010 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90037070 con 0x7f0ea80a3b90 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.330+0000 7f0ea5d9b640 1 -- 172.21.15.121:0/1966249010 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9002ad90 con 0x7f0ea80a3b90 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.330+0000 7f0ea5d9b640 1 -- 172.21.15.121:0/1966249010 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e90032590 con 0x7f0ea80a3b90 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 -- 172.21.15.121:0/1966249010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a3b90 msgr2=0x7f0ea80a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/1966249010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a3b90 0x7f0ea80a4020 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009720 tx=0x7f0e9002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 -- 172.21.15.121:0/1966249010 shutdown_connections 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/1966249010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a3b90 0x7f0ea80a4020 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 -- 172.21.15.121:0/1966249010 >> 172.21.15.121:0/1966249010 conn(0x7f0ea80a8430 msgr2=0x7f0ea80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 -- 172.21.15.121:0/1966249010 shutdown_connections 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.331+0000 7f0ead1c4640 1 -- 172.21.15.121:0/1966249010 wait complete. 2024-09-15T23:55:27.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.332+0000 7f0ead1c4640 1 Processor -- start 2024-09-15T23:55:27.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.332+0000 7f0ead1c4640 1 -- start start 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.332+0000 7f0ead1c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.332+0000 7f0ead1c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80a5220 con 0x7f0ea80a37b0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ea6d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ea6d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60002/0 (socket says 172.21.15.121:60002) 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ea6d9d640 1 -- 172.21.15.121:0/2588801129 learned_addr learned my addr 172.21.15.121:0/2588801129 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ea6d9d640 1 -- 172.21.15.121:0/2588801129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea8123fd0 con 0x7f0ea80a37b0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ea6d9d640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c4a0 tx=0x7f0e9800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e98017070 con 0x7f0ea80a37b0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e98005c10 con 0x7f0ea80a37b0 2024-09-15T23:55:27.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea8122430 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e98007070 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.333+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea80a63d0 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.334+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0e9801a070 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.334+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea8125220 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.334+0000 7f0e9f7fe640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 0x7f0e8803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.334+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f0e9804a4c0 con 0x7f0ea80a37b0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.334+0000 7f0ea659c640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 0x7f0e8803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.335+0000 7f0ea659c640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 0x7f0e8803a760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009720 tx=0x7f0e9002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.339+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e98012400 con 0x7f0ea80a37b0 2024-09-15T23:55:27.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.502+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0ea80a4020 con 0x7f0ea80a37b0 2024-09-15T23:55:27.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.502+0000 7f0e9f7fe640 1 -- 172.21.15.121:0/2588801129 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) ==== 104+0+11 (secure 0 0 0) 0x7f0e9801ac10 con 0x7f0ea80a37b0 2024-09-15T23:55:27.504 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 32 2024-09-15T23:55:27.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 msgr2=0x7f0e8803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 0x7f0e8803a760 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009720 tx=0x7f0e9002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:27.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 msgr2=0x7f0ea8120790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800c4a0 tx=0x7f0e9800c960 comp rx=0 tx=0).stop 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 shutdown_connections 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f0e880382a0 0x7f0e8803a760 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 --2- 172.21.15.121:0/2588801129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ea80a37b0 0x7f0ea8120790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 >> 172.21.15.121:0/2588801129 conn(0x7f0ea80a8430 msgr2=0x7f0ea81363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 shutdown_connections 2024-09-15T23:55:27.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.504+0000 7f0ead1c4640 1 -- 172.21.15.121:0/2588801129 wait complete. 2024-09-15T23:55:27.517 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.615+0000 7fa64934b640 1 Processor -- start 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.615+0000 7fa64934b640 1 -- start start 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa64934b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6440a4ab0 0x7fa64413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa64934b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6440a6d10 con 0x7fa6440a7140 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa64934b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa64406e230 con 0x7fa6440a4ab0 2024-09-15T23:55:27.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa6427fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6440a4ab0 0x7fa64413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa642ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa6440a7140 0x7fa6440a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38026/0 (socket says 172.21.15.121:38026) 2024-09-15T23:55:27.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa642ffd640 1 -- 172.21.15.121:0/1032129034 learned_addr learned my addr 172.21.15.121:0/1032129034 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:27.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa6427fc640 1 -- 172.21.15.121:0/1032129034 >> v1:172.21.15.121:6789/0 conn(0x7fa6440a7140 legacy=0x7fa6440a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa6427fc640 1 -- 172.21.15.121:0/1032129034 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6440a3ae0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.616+0000 7fa641ffb640 1 -- 172.21.15.121:0/1032129034 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625588221 0 0) 0x7fa6440a6d10 con 0x7fa6440a7140 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.617+0000 7fa6427fc640 1 --2- 172.21.15.121:0/1032129034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa64413eef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa638009720 tx=0x7fa63802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d732d79c390ad5f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.617+0000 7fa641ffb640 1 -- 172.21.15.121:0/1032129034 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638037070 con 0x7fa6440a4ab0 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.617+0000 7fa641ffb640 1 -- 172.21.15.121:0/1032129034 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63802ad90 con 0x7fa6440a4ab0 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.617+0000 7fa641ffb640 1 -- 172.21.15.121:0/1032129034 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638032590 con 0x7fa6440a4ab0 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 -- 172.21.15.121:0/1032129034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 msgr2=0x7fa64413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 --2- 172.21.15.121:0/1032129034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa64413eef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa638009720 tx=0x7fa63802a110 comp rx=0 tx=0).stop 2024-09-15T23:55:27.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 -- 172.21.15.121:0/1032129034 shutdown_connections 2024-09-15T23:55:27.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 --2- 172.21.15.121:0/1032129034 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa64413eef0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 -- 172.21.15.121:0/1032129034 >> 172.21.15.121:0/1032129034 conn(0x7fa6440ac370 msgr2=0x7fa6440ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 -- 172.21.15.121:0/1032129034 shutdown_connections 2024-09-15T23:55:27.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.618+0000 7fa64934b640 1 -- 172.21.15.121:0/1032129034 wait complete. 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa64934b640 1 Processor -- start 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa64934b640 1 -- start start 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa64934b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa64934b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6440a7fc0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60022/0 (socket says 172.21.15.121:60022) 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.619+0000 7fa642ffd640 1 -- 172.21.15.121:0/3182507432 learned_addr learned my addr 172.21.15.121:0/3182507432 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa642ffd640 1 -- 172.21.15.121:0/3182507432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6440a1190 con 0x7fa6440a4ab0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa642ffd640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c420 tx=0x7fa63400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634018070 con 0x7fa6440a4ab0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6340074d0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6440a0300 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa634004950 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.620+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6441369b0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.621+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa63401b070 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.621+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64409fff0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.621+0000 7fa62b7fe640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 0x7fa63003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.621+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fa63404a600 con 0x7fa6440a4ab0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.621+0000 7fa6427fc640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 0x7fa63003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.622+0000 7fa6427fc640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 0x7fa63003a710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa638034000 tx=0x7fa63802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.626+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa63401ae10 con 0x7fa6440a4ab0 2024-09-15T23:55:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.796+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa64409e520 con 0x7fa6440a4ab0 2024-09-15T23:55:27.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.796+0000 7fa62b7fe640 1 -- 172.21.15.121:0/3182507432 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) ==== 100+0+11 (secure 0 0 0) 0x7fa63401c9a0 con 0x7fa6440a4ab0 2024-09-15T23:55:27.798 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 64 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 msgr2=0x7fa63003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 0x7fa63003a710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa638034000 tx=0x7fa63802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 msgr2=0x7fa644135c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa63400c420 tx=0x7fa63400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 shutdown_connections 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa630038250 0x7fa63003a710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 --2- 172.21.15.121:0/3182507432 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6440a4ab0 0x7fa644135c60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 >> 172.21.15.121:0/3182507432 conn(0x7fa6440ac370 msgr2=0x7fa644137110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 shutdown_connections 2024-09-15T23:55:27.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.798+0000 7fa64934b640 1 -- 172.21.15.121:0/3182507432 wait complete. 2024-09-15T23:55:27.810 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump' 2024-09-15T23:55:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.906+0000 7f0819d8d640 1 Processor -- start 2024-09-15T23:55:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.906+0000 7f0819d8d640 1 -- start start 2024-09-15T23:55:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0819d8d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0814135f30 0x7f081413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0819d8d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08140a08c0 con 0x7f0814135b50 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0819d8d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f081409b310 con 0x7f0814135f30 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0812ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0814135f30 0x7f081413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0812ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0814135f30 0x7f081413bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60026/0 (socket says 172.21.15.121:60026) 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0812ffd640 1 -- 172.21.15.121:0/2250306862 learned_addr learned my addr 172.21.15.121:0/2250306862 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f08137fe640 1 --1- 172.21.15.121:0/2250306862 >> v1:172.21.15.121:6789/0 conn(0x7f0814135b50 0x7f081409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38036/0 (socket says 172.21.15.121:38036) 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0812ffd640 1 -- 172.21.15.121:0/2250306862 >> v1:172.21.15.121:6789/0 conn(0x7f0814135b50 legacy=0x7f081409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.907+0000 7f0812ffd640 1 -- 172.21.15.121:0/2250306862 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08140a2270 con 0x7f0814135f30 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f0812ffd640 1 --2- 172.21.15.121:0/2250306862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135f30 0x7f081413bb80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08080097f0 tx=0x7f080802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260289d1c942b558 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f08127fc640 1 -- 172.21.15.121:0/2250306862 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0808037070 con 0x7f0814135f30 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f08127fc640 1 -- 172.21.15.121:0/2250306862 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808032440 con 0x7f0814135f30 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f08127fc640 1 -- 172.21.15.121:0/2250306862 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0808032740 con 0x7f0814135f30 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f0819d8d640 1 -- 172.21.15.121:0/2250306862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135f30 msgr2=0x7f081413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.908+0000 7f0819d8d640 1 --2- 172.21.15.121:0/2250306862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135f30 0x7f081413bb80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08080097f0 tx=0x7f080802a270 comp rx=0 tx=0).stop 2024-09-15T23:55:27.913 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 -- 172.21.15.121:0/2250306862 shutdown_connections 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 --2- 172.21.15.121:0/2250306862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135f30 0x7f081413bb80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 -- 172.21.15.121:0/2250306862 >> 172.21.15.121:0/2250306862 conn(0x7f08140a85e0 msgr2=0x7f08140a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 -- 172.21.15.121:0/2250306862 shutdown_connections 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 -- 172.21.15.121:0/2250306862 wait complete. 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.909+0000 7f0819d8d640 1 Processor -- start 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f0819d8d640 1 -- start start 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f0819d8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f0819d8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0814136350 con 0x7f0814135b50 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f08137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f08137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60036/0 (socket says 172.21.15.121:60036) 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f08137fe640 1 -- 172.21.15.121:0/4015182703 learned_addr learned my addr 172.21.15.121:0/4015182703 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.910+0000 7f08137fe640 1 -- 172.21.15.121:0/4015182703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0814122ee0 con 0x7f0814135b50 2024-09-15T23:55:27.914 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f08137fe640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f080400e890 tx=0x7f080400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f080400ca80 con 0x7f0814135b50 2024-09-15T23:55:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080400cc20 con 0x7f0814135b50 2024-09-15T23:55:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0804007070 con 0x7f0814135b50 2024-09-15T23:55:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08141225f0 con 0x7f0814135b50 2024-09-15T23:55:27.915 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.911+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0814121300 con 0x7f0814135b50 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0804007210 con 0x7f0814135b50 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f07fbfff640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 0x7f080003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0814120a20 con 0x7f0814135b50 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f080404d6f0 con 0x7f0814135b50 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f0812ffd640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 0x7f080003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:27.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.912+0000 7f0812ffd640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 0x7f080003a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:27.918 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:27.917+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0804015020 con 0x7f0814135b50 2024-09-15T23:55:28.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.146+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump"]} v 0) -- 0x7f08140a1f10 con 0x7f0814135b50 2024-09-15T23:55:28.692 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.691+0000 7f07fbfff640 1 -- 172.21.15.121:0/4015182703 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dump"]}]=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f0804004d00 con 0x7f0814135b50 2024-09-15T23:55:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 msgr2=0x7f080003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 0x7f080003a760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 msgr2=0x7f081411ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f080400e890 tx=0x7f080400ed50 comp rx=0 tx=0).stop 2024-09-15T23:55:28.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 shutdown_connections 2024-09-15T23:55:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f08000382a0 0x7f080003a760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 --2- 172.21.15.121:0/4015182703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0814135b50 0x7f081411ebd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 >> 172.21.15.121:0/4015182703 conn(0x7f08140a85e0 msgr2=0x7f08140a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 shutdown_connections 2024-09-15T23:55:28.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.693+0000 7f0819d8d640 1 -- 172.21.15.121:0/4015182703 wait complete. 2024-09-15T23:55:28.707 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:55:28.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.807+0000 7f10db4b7640 1 Processor -- start 2024-09-15T23:55:28.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.807+0000 7f10db4b7640 1 -- start start 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10db4b7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10d40a3b90 0x7f10d40a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10db4b7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d40a4560 con 0x7f10d40a37b0 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10db4b7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f10d409b4f0 con 0x7f10d40a3b90 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10d8a52640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f10d40a3b90 0x7f10d40a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10d9253640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f10d40a37b0 0x7f10d409acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38042/0 (socket says 172.21.15.121:38042) 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10d9253640 1 -- 172.21.15.121:0/596714129 learned_addr learned my addr 172.21.15.121:0/596714129 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10d8a52640 1 -- 172.21.15.121:0/596714129 >> v1:172.21.15.121:6789/0 conn(0x7f10d40a37b0 legacy=0x7f10d409acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10d8a52640 1 -- 172.21.15.121:0/596714129 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d40a1c90 con 0x7f10d40a3b90 2024-09-15T23:55:28.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.808+0000 7f10cbfff640 1 -- 172.21.15.121:0/596714129 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21748862 0 0) 0x7f10d40a4560 con 0x7f10d40a37b0 2024-09-15T23:55:28.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10d8a52640 1 --2- 172.21.15.121:0/596714129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a3b90 0x7f10d40a4020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009720 tx=0x7f10d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbd042591c574cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10cbfff640 1 -- 172.21.15.121:0/596714129 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0037070 con 0x7f10d40a3b90 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10cbfff640 1 -- 172.21.15.121:0/596714129 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d002ad90 con 0x7f10d40a3b90 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10cbfff640 1 -- 172.21.15.121:0/596714129 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10d0032590 con 0x7f10d40a3b90 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10db4b7640 1 -- 172.21.15.121:0/596714129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a3b90 msgr2=0x7f10d40a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10db4b7640 1 --2- 172.21.15.121:0/596714129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a3b90 0x7f10d40a4020 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009720 tx=0x7f10d002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10db4b7640 1 -- 172.21.15.121:0/596714129 shutdown_connections 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10db4b7640 1 --2- 172.21.15.121:0/596714129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a3b90 0x7f10d40a4020 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.809+0000 7f10db4b7640 1 -- 172.21.15.121:0/596714129 >> 172.21.15.121:0/596714129 conn(0x7f10d40a8430 msgr2=0x7f10d40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.810+0000 7f10db4b7640 1 -- 172.21.15.121:0/596714129 shutdown_connections 2024-09-15T23:55:28.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.810+0000 7f10db4b7640 1 -- 172.21.15.121:0/596714129 wait complete. 2024-09-15T23:55:28.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.810+0000 7f10db4b7640 1 Processor -- start 2024-09-15T23:55:28.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.810+0000 7f10db4b7640 1 -- start start 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10db4b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10db4b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10d40a5220 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10d9253640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10d9253640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60064/0 (socket says 172.21.15.121:60064) 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10d9253640 1 -- 172.21.15.121:0/1946261571 learned_addr learned my addr 172.21.15.121:0/1946261571 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10d9253640 1 -- 172.21.15.121:0/1946261571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d40735a0 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10d9253640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c420 tx=0x7f10c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10c4018070 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.811+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c40074d0 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.812+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41366c0 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.812+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10c4004950 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.812+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d4071830 con 0x7f10d40a37b0 2024-09-15T23:55:28.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.812+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f10c401b070 con 0x7f10d40a37b0 2024-09-15T23:55:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.813+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d41363e0 con 0x7f10d40a37b0 2024-09-15T23:55:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.813+0000 7f10c9ffb640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 0x7f10b803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.813+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f10c404a560 con 0x7f10d40a37b0 2024-09-15T23:55:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.813+0000 7f10d8a52640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 0x7f10b803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:28.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.813+0000 7f10d8a52640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 0x7f10b803a760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009720 tx=0x7f10d002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:28.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.817+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10c4011960 con 0x7f10d40a37b0 2024-09-15T23:55:28.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.980+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f10d40a4020 con 0x7f10d40a37b0 2024-09-15T23:55:28.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.985+0000 7f10c9ffb640 1 -- 172.21.15.121:0/1946261571 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v5)=0 v5) ==== 122+0+0 (secure 0 0 0) 0x7f10c4011bc0 con 0x7f10d40a37b0 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 msgr2=0x7f10b803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 0x7f10b803a760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009720 tx=0x7f10d002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 msgr2=0x7f10d4072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c420 tx=0x7f10c400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 shutdown_connections 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f10b80382a0 0x7f10b803a760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 --2- 172.21.15.121:0/1946261571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10d40a37b0 0x7f10d4072290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 >> 172.21.15.121:0/1946261571 conn(0x7f10d40a8430 msgr2=0x7f10d41bed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:28.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 shutdown_connections 2024-09-15T23:55:28.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:28.987+0000 7f10db4b7640 1 -- 172.21.15.121:0/1946261571 wait complete. 2024-09-15T23:55:28.999 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:55:28.999 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:55:29.036 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:55:29.037 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:29.037 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:29.093 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:29.093 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:29.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:29.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.286+0000 7fe86273b640 1 Processor -- start 2024-09-15T23:55:29.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.286+0000 7fe86273b640 1 -- start start 2024-09-15T23:55:29.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe86273b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe85c135f30 0x7fe85c13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe86273b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe85c0a08c0 con 0x7fe85c135b50 2024-09-15T23:55:29.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe86273b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c09b310 con 0x7fe85c135f30 2024-09-15T23:55:29.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe85bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe85c135b50 0x7fe85c09aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38050/0 (socket says 172.21.15.121:38050) 2024-09-15T23:55:29.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe85b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe85c135f30 0x7fe85c13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe85bfff640 1 -- 172.21.15.121:0/2789983559 learned_addr learned my addr 172.21.15.121:0/2789983559 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:29.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe85b7fe640 1 -- 172.21.15.121:0/2789983559 >> v1:172.21.15.121:6789/0 conn(0x7fe85c135b50 legacy=0x7fe85c09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.287+0000 7fe85b7fe640 1 -- 172.21.15.121:0/2789983559 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c0a2270 con 0x7fe85c135f30 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.288+0000 7fe85b7fe640 1 --2- 172.21.15.121:0/2789983559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135f30 0x7fe85c13bb80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe850009720 tx=0x7fe85002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f50c71003376e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.288+0000 7fe85affd640 1 -- 172.21.15.121:0/2789983559 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe850037070 con 0x7fe85c135f30 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.288+0000 7fe85affd640 1 -- 172.21.15.121:0/2789983559 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85002ae20 con 0x7fe85c135f30 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.288+0000 7fe85affd640 1 -- 172.21.15.121:0/2789983559 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe850032590 con 0x7fe85c135f30 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 -- 172.21.15.121:0/2789983559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135f30 msgr2=0x7fe85c13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 --2- 172.21.15.121:0/2789983559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135f30 0x7fe85c13bb80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe850009720 tx=0x7fe85002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 -- 172.21.15.121:0/2789983559 shutdown_connections 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 --2- 172.21.15.121:0/2789983559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135f30 0x7fe85c13bb80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 -- 172.21.15.121:0/2789983559 >> 172.21.15.121:0/2789983559 conn(0x7fe85c0a85e0 msgr2=0x7fe85c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 -- 172.21.15.121:0/2789983559 shutdown_connections 2024-09-15T23:55:29.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 -- 172.21.15.121:0/2789983559 wait complete. 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.289+0000 7fe86273b640 1 Processor -- start 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe86273b640 1 -- start start 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe86273b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe86273b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c136350 con 0x7fe85c135b50 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe85bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe85bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60086/0 (socket says 172.21.15.121:60086) 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe85bfff640 1 -- 172.21.15.121:0/3089296930 learned_addr learned my addr 172.21.15.121:0/3089296930 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.290+0000 7fe85bfff640 1 -- 172.21.15.121:0/3089296930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c11fe50 con 0x7fe85c135b50 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe85bfff640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c380 tx=0x7fe84c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe84c005c10 con 0x7fe85c135b50 2024-09-15T23:55:29.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe84c005db0 con 0x7fe85c135b50 2024-09-15T23:55:29.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe84c004930 con 0x7fe85c135b50 2024-09-15T23:55:29.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c0a0270 con 0x7fe85c135b50 2024-09-15T23:55:29.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.291+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c135580 con 0x7fe85c135b50 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe84c01a020 con 0x7fe85c135b50 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe858ff9640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 0x7fe84803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c09aae0 con 0x7fe85c135b50 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fe84c04aaa0 con 0x7fe85c135b50 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe85b7fe640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 0x7fe84803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.292+0000 7fe85b7fe640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 0x7fe84803a760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe850034000 tx=0x7fe85002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.297+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe84c0127f0 con 0x7fe85c135b50 2024-09-15T23:55:29.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.471+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe85c0a1f10 con 0x7fe85c135b50 2024-09-15T23:55:29.473 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.471+0000 7fe858ff9640 1 -- 172.21.15.121:0/3089296930 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) ==== 80+0+0 (secure 0 0 0) 0x7fe84c012a50 con 0x7fe85c135b50 2024-09-15T23:55:29.473 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:55:29.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 msgr2=0x7fe84803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 0x7fe84803a760 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe850034000 tx=0x7fe85002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 msgr2=0x7fe85c11ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00c380 tx=0x7fe84c00c840 comp rx=0 tx=0).stop 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 shutdown_connections 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe8480382a0 0x7fe84803a760 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 --2- 172.21.15.121:0/3089296930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe85c135b50 0x7fe85c11ebc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.473+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 >> 172.21.15.121:0/3089296930 conn(0x7fe85c0a85e0 msgr2=0x7fe85c09d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.474+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 shutdown_connections 2024-09-15T23:55:29.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.474+0000 7fe86273b640 1 -- 172.21.15.121:0/3089296930 wait complete. 2024-09-15T23:55:29.486 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:29.486 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:29.502 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:29.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.639+0000 7ff75a103640 1 Processor -- start 2024-09-15T23:55:29.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.639+0000 7ff75a103640 1 -- start start 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff75a103640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff75413a280 0x7ff75413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff75a103640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff75413a080 con 0x7ff7540a4c20 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff75a103640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff7540a3d50 con 0x7ff75413a280 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff7537fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff75413a280 0x7ff75413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff752ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff7540a4c20 0x7ff7540a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38058/0 (socket says 172.21.15.121:38058) 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff752ffd640 1 -- 172.21.15.121:0/2181803193 learned_addr learned my addr 172.21.15.121:0/2181803193 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff7537fe640 1 -- 172.21.15.121:0/2181803193 >> v1:172.21.15.121:6789/0 conn(0x7ff7540a4c20 legacy=0x7ff7540a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.640+0000 7ff7537fe640 1 -- 172.21.15.121:0/2181803193 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7540a3f80 con 0x7ff75413a280 2024-09-15T23:55:29.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.641+0000 7ff7537fe640 1 --2- 172.21.15.121:0/2181803193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff75413a280 0x7ff75413a660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff744009d90 tx=0x7ff74402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e18fb0e7bb785d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.641+0000 7ff7527fc640 1 -- 172.21.15.121:0/2181803193 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744007670 con 0x7ff75413a280 2024-09-15T23:55:29.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.641+0000 7ff7527fc640 1 -- 172.21.15.121:0/2181803193 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff744007810 con 0x7ff75413a280 2024-09-15T23:55:29.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.641+0000 7ff7527fc640 1 -- 172.21.15.121:0/2181803193 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744007b10 con 0x7ff75413a280 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 -- 172.21.15.121:0/2181803193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff75413a280 msgr2=0x7ff75413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 --2- 172.21.15.121:0/2181803193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff75413a280 0x7ff75413a660 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff744009d90 tx=0x7ff74402a660 comp rx=0 tx=0).stop 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 -- 172.21.15.121:0/2181803193 shutdown_connections 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 --2- 172.21.15.121:0/2181803193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff75413a280 0x7ff75413a660 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 -- 172.21.15.121:0/2181803193 >> 172.21.15.121:0/2181803193 conn(0x7ff7540ac3e0 msgr2=0x7ff7540ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 -- 172.21.15.121:0/2181803193 shutdown_connections 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.642+0000 7ff75a103640 1 -- 172.21.15.121:0/2181803193 wait complete. 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff75a103640 1 Processor -- start 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff75a103640 1 -- start start 2024-09-15T23:55:29.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff75a103640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff75a103640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff754139d40 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff7537fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff7537fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60094/0 (socket says 172.21.15.121:60094) 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.643+0000 7ff7537fe640 1 -- 172.21.15.121:0/2109450009 learned_addr learned my addr 172.21.15.121:0/2109450009 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff7537fe640 1 -- 172.21.15.121:0/2109450009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff754125050 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff7537fe640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff744009eb0 tx=0x7ff744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744040070 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7440079c0 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff754124760 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74403c420 con 0x7ff7540a4c20 2024-09-15T23:55:29.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.644+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff754124450 con 0x7ff7540a4c20 2024-09-15T23:55:29.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.645+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff744039040 con 0x7ff7540a4c20 2024-09-15T23:55:29.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.645+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75406dab0 con 0x7ff7540a4c20 2024-09-15T23:55:29.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.645+0000 7ff73bfff640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 0x7ff74003a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:29.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.645+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7ff74402ae00 con 0x7ff7540a4c20 2024-09-15T23:55:29.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.645+0000 7ff752ffd640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 0x7ff74003a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:29.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.646+0000 7ff752ffd640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 0x7ff74003a740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff748007fd0 tx=0x7ff748007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:29.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.650+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff744038350 con 0x7ff7540a4c20 2024-09-15T23:55:29.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.827+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7540a2f50 con 0x7ff7540a4c20 2024-09-15T23:55:29.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.827+0000 7ff73bfff640 1 -- 172.21.15.121:0/2109450009 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) ==== 80+0+0 (secure 0 0 0) 0x7ff74403cdc0 con 0x7ff7540a4c20 2024-09-15T23:55:29.829 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:55:29.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 msgr2=0x7ff74003a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 0x7ff74003a740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff748007fd0 tx=0x7ff748007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 msgr2=0x7ff7540a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff744009eb0 tx=0x7ff744004a40 comp rx=0 tx=0).stop 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 shutdown_connections 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff740038280 0x7ff74003a740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 --2- 172.21.15.121:0/2109450009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7540a4c20 0x7ff7540a1120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.829+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 >> 172.21.15.121:0/2109450009 conn(0x7ff7540ac3e0 msgr2=0x7ff7540ab080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.830+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 shutdown_connections 2024-09-15T23:55:29.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:29.830+0000 7ff75a103640 1 -- 172.21.15.121:0/2109450009 wait complete. 2024-09-15T23:55:29.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:55:29.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:29.842 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:29.868 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:29.868 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:55:29.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:29.868 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:55:29.938 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:29.938 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:29.994 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:29.994 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:30.050 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:30.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.187+0000 7fa1605bd640 1 Processor -- start 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.187+0000 7fa1605bd640 1 -- start start 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.187+0000 7fa1605bd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa158135b50 0x7fa15809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.187+0000 7fa1605bd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15809b020 con 0x7fa158135f30 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.187+0000 7fa1605bd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa15809b310 con 0x7fa158135b50 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa158135b50 0x7fa15809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa158135b50 0x7fa15809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60110/0 (socket says 172.21.15.121:60110) 2024-09-15T23:55:30.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15db58640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa158135f30 0x7fa1580a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38070/0 (socket says 172.21.15.121:38070) 2024-09-15T23:55:30.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 -- 172.21.15.121:0/51635614 learned_addr learned my addr 172.21.15.121:0/51635614 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 -- 172.21.15.121:0/51635614 >> v1:172.21.15.121:6789/0 conn(0x7fa158135f30 legacy=0x7fa1580a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 -- 172.21.15.121:0/51635614 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1580a08c0 con 0x7fa158135b50 2024-09-15T23:55:30.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.188+0000 7fa15e359640 1 --2- 172.21.15.121:0/51635614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa15809aae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1540097f0 tx=0x7fa15402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b434a30909553a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa15d357640 1 -- 172.21.15.121:0/51635614 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154037070 con 0x7fa158135b50 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa15d357640 1 -- 172.21.15.121:0/51635614 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa154032440 con 0x7fa158135b50 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa15d357640 1 -- 172.21.15.121:0/51635614 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154032740 con 0x7fa158135b50 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 -- 172.21.15.121:0/51635614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 msgr2=0x7fa15809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 --2- 172.21.15.121:0/51635614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa15809aae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1540097f0 tx=0x7fa15402a270 comp rx=0 tx=0).stop 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 -- 172.21.15.121:0/51635614 shutdown_connections 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 --2- 172.21.15.121:0/51635614 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa15809aae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 -- 172.21.15.121:0/51635614 >> 172.21.15.121:0/51635614 conn(0x7fa1580a85e0 msgr2=0x7fa1580a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 -- 172.21.15.121:0/51635614 shutdown_connections 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.189+0000 7fa1605bd640 1 -- 172.21.15.121:0/51635614 wait complete. 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.190+0000 7fa1605bd640 1 Processor -- start 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.190+0000 7fa1605bd640 1 -- start start 2024-09-15T23:55:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa1605bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa1605bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1580a5430 con 0x7fa158135b50 2024-09-15T23:55:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa15e359640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa15e359640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60122/0 (socket says 172.21.15.121:60122) 2024-09-15T23:55:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa15e359640 1 -- 172.21.15.121:0/2046037528 learned_addr learned my addr 172.21.15.121:0/2046037528 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa15e359640 1 -- 172.21.15.121:0/2046037528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa158123e80 con 0x7fa158135b50 2024-09-15T23:55:30.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa15e359640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa154035040 tx=0x7fa1540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154041020 con 0x7fa158135b50 2024-09-15T23:55:30.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1540306c0 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa158124100 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa154037040 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.191+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1580a2f80 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.192+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa154044020 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.192+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa158136350 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.192+0000 7fa14effd640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 0x7fa13c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.193+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fa15406bb50 con 0x7fa158135b50 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.193+0000 7fa15db58640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 0x7fa13c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.193+0000 7fa15db58640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 0x7fa13c03a760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1480015f0 tx=0x7fa148007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.197+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa15404b030 con 0x7fa158135b50 2024-09-15T23:55:30.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.374+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa158123a50 con 0x7fa158135b50 2024-09-15T23:55:30.377 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.375+0000 7fa14effd640 1 -- 172.21.15.121:0/2046037528 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) ==== 80+0+0 (secure 0 0 0) 0x7fa158123e80 con 0x7fa158135b50 2024-09-15T23:55:30.377 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 msgr2=0x7fa13c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 0x7fa13c03a760 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1480015f0 tx=0x7fa148007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 msgr2=0x7fa158120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa154035040 tx=0x7fa1540046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 shutdown_connections 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa13c0382a0 0x7fa13c03a760 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 --2- 172.21.15.121:0/2046037528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa158135b50 0x7fa158120d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 >> 172.21.15.121:0/2046037528 conn(0x7fa1580a85e0 msgr2=0x7fa15809d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 shutdown_connections 2024-09-15T23:55:30.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.377+0000 7fa1605bd640 1 -- 172.21.15.121:0/2046037528 wait complete. 2024-09-15T23:55:30.390 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:55:30.390 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:55:30.406 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:55:30.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.542+0000 7f808e19f640 1 Processor -- start 2024-09-15T23:55:30.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.542+0000 7f808e19f640 1 -- start start 2024-09-15T23:55:30.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f808e19f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8088135b50 0x7f808809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f808e19f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f808809b020 con 0x7f8088135f30 2024-09-15T23:55:30.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f808e19f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f808809b310 con 0x7f8088135b50 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f80877fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8088135b50 0x7f808809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f80877fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8088135b50 0x7f808809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60132/0 (socket says 172.21.15.121:60132) 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f8086ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8088135f30 0x7f80880a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38084/0 (socket says 172.21.15.121:38084) 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f80877fe640 1 -- 172.21.15.121:0/4031567833 learned_addr learned my addr 172.21.15.121:0/4031567833 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f80877fe640 1 -- 172.21.15.121:0/4031567833 >> v1:172.21.15.121:6789/0 conn(0x7f8088135f30 legacy=0x7f80880a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.543+0000 7f80877fe640 1 -- 172.21.15.121:0/4031567833 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80880a08c0 con 0x7f8088135b50 2024-09-15T23:55:30.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f80877fe640 1 --2- 172.21.15.121:0/4031567833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f808809aae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f807800ba90 tx=0x7f807802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a87ca66a7d49a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f80867fc640 1 -- 172.21.15.121:0/4031567833 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8078036020 con 0x7f8088135b50 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f80867fc640 1 -- 172.21.15.121:0/4031567833 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078032770 con 0x7f8088135b50 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f80867fc640 1 -- 172.21.15.121:0/4031567833 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8078032a70 con 0x7f8088135b50 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f808e19f640 1 -- 172.21.15.121:0/4031567833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 msgr2=0x7f808809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.544+0000 7f808e19f640 1 --2- 172.21.15.121:0/4031567833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f808809aae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f807800ba90 tx=0x7f807802c940 comp rx=0 tx=0).stop 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 -- 172.21.15.121:0/4031567833 shutdown_connections 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 --2- 172.21.15.121:0/4031567833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f808809aae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 -- 172.21.15.121:0/4031567833 >> 172.21.15.121:0/4031567833 conn(0x7f80880a85e0 msgr2=0x7f80880a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 -- 172.21.15.121:0/4031567833 shutdown_connections 2024-09-15T23:55:30.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 -- 172.21.15.121:0/4031567833 wait complete. 2024-09-15T23:55:30.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.545+0000 7f808e19f640 1 Processor -- start 2024-09-15T23:55:30.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f808e19f640 1 -- start start 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f808e19f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f808e19f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80880a5430 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f80877fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f80877fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60138/0 (socket says 172.21.15.121:60138) 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f80877fe640 1 -- 172.21.15.121:0/210034503 learned_addr learned my addr 172.21.15.121:0/210034503 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f80877fe640 1 -- 172.21.15.121:0/210034503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80881263a0 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.546+0000 7f80877fe640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f807800b2c0 tx=0x7f80780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8078036040 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078032a50 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8088125960 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807803b550 con 0x7f8088135b50 2024-09-15T23:55:30.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80880a7470 con 0x7f8088135b50 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.547+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8078043020 con 0x7f8088135b50 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.548+0000 7f806ffff640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 0x7f807403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.548+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f807802f070 con 0x7f8088135b50 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.548+0000 7f8086ffd640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 0x7f807403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.548+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8088123d90 con 0x7f8088135b50 2024-09-15T23:55:30.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.548+0000 7f8086ffd640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 0x7f807403a760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f807c000f60 tx=0x7f807c007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.552+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8078053020 con 0x7f8088135b50 2024-09-15T23:55:30.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.729+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8088136350 con 0x7f8088135b50 2024-09-15T23:55:30.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.729+0000 7f806ffff640 1 -- 172.21.15.121:0/210034503 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v17) ==== 80+0+0 (secure 0 0 0) 0x7f8078045410 con 0x7f8088135b50 2024-09-15T23:55:30.731 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 msgr2=0x7f807403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 0x7f807403a760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f807c000f60 tx=0x7f807c007a80 comp rx=0 tx=0).stop 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 msgr2=0x7f8088122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f807800b2c0 tx=0x7f80780046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 shutdown_connections 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f80740382a0 0x7f807403a760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 --2- 172.21.15.121:0/210034503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8088135b50 0x7f8088122a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 >> 172.21.15.121:0/210034503 conn(0x7f80880a85e0 msgr2=0x7f80880a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 shutdown_connections 2024-09-15T23:55:30.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.731+0000 7f808e19f640 1 -- 172.21.15.121:0/210034503 wait complete. 2024-09-15T23:55:30.743 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:55:30.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:30.744 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:30.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:30.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:55:30.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:30.768 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:55:30.824 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-15T23:55:30.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.962+0000 7f602ef4b640 1 Processor -- start 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.962+0000 7f602ef4b640 1 -- start start 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.962+0000 7f602ef4b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6028135f30 0x7f602813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.962+0000 7f602ef4b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60280a08c0 con 0x7f6028135b50 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.962+0000 7f602ef4b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f602809b310 con 0x7f6028135f30 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f601ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6028135f30 0x7f602813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f601ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6028135f30 0x7f602813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60148/0 (socket says 172.21.15.121:60148) 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f602cce7640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6028135b50 0x7f602809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38092/0 (socket says 172.21.15.121:38092) 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f601ffff640 1 -- 172.21.15.121:0/3779311431 learned_addr learned my addr 172.21.15.121:0/3779311431 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f601ffff640 1 -- 172.21.15.121:0/3779311431 >> v1:172.21.15.121:6789/0 conn(0x7f6028135b50 legacy=0x7f602809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.963+0000 7f601ffff640 1 -- 172.21.15.121:0/3779311431 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60280a2270 con 0x7f6028135f30 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f601ffff640 1 --2- 172.21.15.121:0/3779311431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135f30 0x7f602813bb80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f601800ba90 tx=0x7f601802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d5739433d97409 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f601f7fe640 1 -- 172.21.15.121:0/3779311431 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6018036020 con 0x7f6028135f30 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f601f7fe640 1 -- 172.21.15.121:0/3779311431 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018032770 con 0x7f6028135f30 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f601f7fe640 1 -- 172.21.15.121:0/3779311431 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6018032a70 con 0x7f6028135f30 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 -- 172.21.15.121:0/3779311431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135f30 msgr2=0x7f602813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 --2- 172.21.15.121:0/3779311431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135f30 0x7f602813bb80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f601800ba90 tx=0x7f601802c940 comp rx=0 tx=0).stop 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 -- 172.21.15.121:0/3779311431 shutdown_connections 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 --2- 172.21.15.121:0/3779311431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135f30 0x7f602813bb80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 -- 172.21.15.121:0/3779311431 >> 172.21.15.121:0/3779311431 conn(0x7f60280a85e0 msgr2=0x7f60280a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 -- 172.21.15.121:0/3779311431 shutdown_connections 2024-09-15T23:55:30.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.964+0000 7f602ef4b640 1 -- 172.21.15.121:0/3779311431 wait complete. 2024-09-15T23:55:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.965+0000 7f602ef4b640 1 Processor -- start 2024-09-15T23:55:30.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.965+0000 7f602ef4b640 1 -- start start 2024-09-15T23:55:30.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602ef4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602ef4b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6028136350 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602cce7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602cce7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60158/0 (socket says 172.21.15.121:60158) 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602cce7640 1 -- 172.21.15.121:0/2591776187 learned_addr learned my addr 172.21.15.121:0/2591776187 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602cce7640 1 -- 172.21.15.121:0/2591776187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6028121900 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602cce7640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f602400c450 tx=0x7f602400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024007410 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60240075b0 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024004910 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.966+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60280a7900 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.967+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60281202e0 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.967+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f602401a020 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.967+0000 7f601d7fa640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 0x7f601403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.967+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f602404aa20 con 0x7f6028135b50 2024-09-15T23:55:30.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.968+0000 7f601ffff640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 0x7f601403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:30.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.968+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602809aae0 con 0x7f6028135b50 2024-09-15T23:55:30.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.968+0000 7f601ffff640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 0x7f601403a760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6018037000 tx=0x7f6018032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:30.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:30.972+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f602401b9c0 con 0x7f6028135b50 2024-09-15T23:55:31.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.173+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60280a1f10 con 0x7f6028135b50 2024-09-15T23:55:31.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.173+0000 7f601d7fa640 1 -- 172.21.15.121:0/2591776187 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7f602401bc20 con 0x7f6028135b50 2024-09-15T23:55:31.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:31.176 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:31.176 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 msgr2=0x7f601403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 0x7f601403a760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6018037000 tx=0x7f6018032000 comp rx=0 tx=0).stop 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 msgr2=0x7f602811e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f602400c450 tx=0x7f602400c910 comp rx=0 tx=0).stop 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 shutdown_connections 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f60140382a0 0x7f601403a760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 --2- 172.21.15.121:0/2591776187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6028135b50 0x7f602811e600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 >> 172.21.15.121:0/2591776187 conn(0x7f60280a85e0 msgr2=0x7f602809de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 shutdown_connections 2024-09-15T23:55:31.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.176+0000 7f602ef4b640 1 -- 172.21.15.121:0/2591776187 wait complete. 2024-09-15T23:55:31.189 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:31.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3980c1e640 1 Processor -- start 2024-09-15T23:55:31.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3980c1e640 1 -- start start 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3980c1e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f397c0a39c0 0x7f397c132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3980c1e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397c0a16c0 con 0x7f397c133470 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3980c1e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f397c0a1490 con 0x7f397c0a39c0 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f397a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f397c0a39c0 0x7f397c132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3979d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f397c133470 0x7f397c135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38094/0 (socket says 172.21.15.121:38094) 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f397a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f397c0a39c0 0x7f397c132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60174/0 (socket says 172.21.15.121:60174) 2024-09-15T23:55:31.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.285+0000 7f3979d9b640 1 -- 172.21.15.121:0/43455385 learned_addr learned my addr 172.21.15.121:0/43455385 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.286+0000 7f397a59c640 1 -- 172.21.15.121:0/43455385 >> v1:172.21.15.121:6789/0 conn(0x7f397c133470 legacy=0x7f397c135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.286+0000 7f397a59c640 1 -- 172.21.15.121:0/43455385 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0a4010 con 0x7f397c0a39c0 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.286+0000 7f397959a640 1 -- 172.21.15.121:0/43455385 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789958368 0 0) 0x7f397c0a16c0 con 0x7f397c133470 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.286+0000 7f397a59c640 1 --2- 172.21.15.121:0/43455385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c132f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f396c009720 tx=0x7f396c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510f1953a8546661 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f397959a640 1 -- 172.21.15.121:0/43455385 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c037070 con 0x7f397c0a39c0 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f397959a640 1 -- 172.21.15.121:0/43455385 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c02ad90 con 0x7f397c0a39c0 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f397959a640 1 -- 172.21.15.121:0/43455385 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c032590 con 0x7f397c0a39c0 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 -- 172.21.15.121:0/43455385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 msgr2=0x7f397c132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 --2- 172.21.15.121:0/43455385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c132f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f396c009720 tx=0x7f396c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 -- 172.21.15.121:0/43455385 shutdown_connections 2024-09-15T23:55:31.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 --2- 172.21.15.121:0/43455385 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c132f30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 -- 172.21.15.121:0/43455385 >> 172.21.15.121:0/43455385 conn(0x7f397c0a85e0 msgr2=0x7f397c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 -- 172.21.15.121:0/43455385 shutdown_connections 2024-09-15T23:55:31.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.287+0000 7f3980c1e640 1 -- 172.21.15.121:0/43455385 wait complete. 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.288+0000 7f3980c1e640 1 Processor -- start 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.288+0000 7f3980c1e640 1 -- start start 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f3980c1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f3980c1e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f397c1329c0 con 0x7f397c0a39c0 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f397a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f397a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60180/0 (socket says 172.21.15.121:60180) 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f397a59c640 1 -- 172.21.15.121:0/943457383 learned_addr learned my addr 172.21.15.121:0/943457383 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f397a59c640 1 -- 172.21.15.121:0/943457383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397c0a6f60 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f397a59c640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f396c009720 tx=0x7f396c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c042020 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396c03d5a0 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397c121060 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c037040 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.289+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397c1ce840 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.290+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f396c045020 con 0x7f397c0a39c0 2024-09-15T23:55:31.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.290+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397c0a23d0 con 0x7f397c0a39c0 2024-09-15T23:55:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.290+0000 7f396affd640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 0x7f395c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.290+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f396c06bb20 con 0x7f397c0a39c0 2024-09-15T23:55:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.290+0000 7f3979d9b640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 0x7f395c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.291+0000 7f3979d9b640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 0x7f395c03a760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39700015a0 tx=0x7f39700079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.295+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f396c04c030 con 0x7f397c0a39c0 2024-09-15T23:55:31.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.493+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f397c0a2620 con 0x7f397c0a39c0 2024-09-15T23:55:31.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.494+0000 7f396affd640 1 -- 172.21.15.121:0/943457383 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7f396c046570 con 0x7f397c0a39c0 2024-09-15T23:55:31.496 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:31.496 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:31.496 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 msgr2=0x7f395c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 0x7f395c03a760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f39700015a0 tx=0x7f39700079e0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 msgr2=0x7f397c1cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f396c009720 tx=0x7f396c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 shutdown_connections 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f395c0382a0 0x7f395c03a760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 --2- 172.21.15.121:0/943457383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f397c0a39c0 0x7f397c1cec60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 >> 172.21.15.121:0/943457383 conn(0x7f397c0a85e0 msgr2=0x7f397c072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 shutdown_connections 2024-09-15T23:55:31.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.496+0000 7f3980c1e640 1 -- 172.21.15.121:0/943457383 wait complete. 2024-09-15T23:55:31.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:31.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65bcbd8640 1 Processor -- start 2024-09-15T23:55:31.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65bcbd8640 1 -- start start 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65bcbd8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f65b8133640 0x7f65b813b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65bcbd8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b80a16c0 con 0x7f65b80a39c0 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65bcbd8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f65b80a1490 con 0x7f65b8133640 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65b659c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f65b80a39c0 0x7f65b8132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38102/0 (socket says 172.21.15.121:38102) 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65b659c640 1 -- 172.21.15.121:0/2110836582 learned_addr learned my addr 172.21.15.121:0/2110836582 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.604+0000 7f65b5d9b640 1 --2- 172.21.15.121:0/2110836582 >> v2:172.21.15.121:3300/0 conn(0x7f65b8133640 0x7f65b813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b559a640 1 -- 172.21.15.121:0/2110836582 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983447281 0 0) 0x7f65b80a16c0 con 0x7f65b80a39c0 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b559a640 1 -- 172.21.15.121:0/2110836582 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a4003520 con 0x7f65b80a39c0 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b5d9b640 1 -- 172.21.15.121:0/2110836582 >> v1:172.21.15.121:6789/0 conn(0x7f65b80a39c0 legacy=0x7f65b8132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b5d9b640 1 -- 172.21.15.121:0/2110836582 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b80a4010 con 0x7f65b8133640 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b5d9b640 1 --2- 172.21.15.121:0/2110836582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b8133640 0x7f65b813b270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9951419ee613bdc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b559a640 1 -- 172.21.15.121:0/2110836582 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a0037070 con 0x7f65b8133640 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b559a640 1 -- 172.21.15.121:0/2110836582 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a002ad90 con 0x7f65b8133640 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.605+0000 7f65b559a640 1 -- 172.21.15.121:0/2110836582 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a0032590 con 0x7f65b8133640 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 -- 172.21.15.121:0/2110836582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b8133640 msgr2=0x7f65b813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/2110836582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b8133640 0x7f65b813b270 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009720 tx=0x7f65a002a110 comp rx=0 tx=0).stop 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 -- 172.21.15.121:0/2110836582 shutdown_connections 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/2110836582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b8133640 0x7f65b813b270 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 -- 172.21.15.121:0/2110836582 >> 172.21.15.121:0/2110836582 conn(0x7f65b80a85e0 msgr2=0x7f65b80a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 -- 172.21.15.121:0/2110836582 shutdown_connections 2024-09-15T23:55:31.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.606+0000 7f65bcbd8640 1 -- 172.21.15.121:0/2110836582 wait complete. 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.607+0000 7f65bcbd8640 1 Processor -- start 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.607+0000 7f65bcbd8640 1 -- start start 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65bcbd8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65bcbd8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65b81329c0 con 0x7f65b80a39c0 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60204/0 (socket says 172.21.15.121:60204) 2024-09-15T23:55:31.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65b659c640 1 -- 172.21.15.121:0/235236953 learned_addr learned my addr 172.21.15.121:0/235236953 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65b659c640 1 -- 172.21.15.121:0/235236953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b80735e0 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65b659c640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c390 tx=0x7f65b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b0017070 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b0005c10 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b8135c00 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b00070d0 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.608+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b8134980 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.609+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f65b001a070 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.609+0000 7f65aeffd640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 0x7f659803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.609+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f65b004a600 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.609+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b81340a0 con 0x7f65b80a39c0 2024-09-15T23:55:31.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.609+0000 7f65b5d9b640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 0x7f659803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.610+0000 7f65b5d9b640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 0x7f659803a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65a0034000 tx=0x7f65a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.614+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65b80735e0 con 0x7f65b80a39c0 2024-09-15T23:55:31.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.781+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65b80a2340 con 0x7f65b80a39c0 2024-09-15T23:55:31.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.782+0000 7f65aeffd640 1 -- 172.21.15.121:0/235236953 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f65b0019e10 con 0x7f65b80a39c0 2024-09-15T23:55:31.784 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:31.784 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 msgr2=0x7f659803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 0x7f659803a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65a0034000 tx=0x7f65a002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 msgr2=0x7f65b8070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c390 tx=0x7f65b000c850 comp rx=0 tx=0).stop 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 shutdown_connections 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f65980382a0 0x7f659803a760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 --2- 172.21.15.121:0/235236953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65b80a39c0 0x7f65b8070a30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 >> 172.21.15.121:0/235236953 conn(0x7f65b80a85e0 msgr2=0x7f65b809f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 shutdown_connections 2024-09-15T23:55:31.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.784+0000 7f65bcbd8640 1 -- 172.21.15.121:0/235236953 wait complete. 2024-09-15T23:55:31.797 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:55:31.797 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:31.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.893+0000 7fec8b4ba640 1 Processor -- start 2024-09-15T23:55:31.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.893+0000 7fec8b4ba640 1 -- start start 2024-09-15T23:55:31.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec8b4ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec84135b50 0x7fec8409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec8b4ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec8409b020 con 0x7fec84135f30 2024-09-15T23:55:31.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec8b4ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fec8409b310 con 0x7fec84135b50 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec89256640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec84135b50 0x7fec8409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec89256640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec84135b50 0x7fec8409aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60206/0 (socket says 172.21.15.121:60206) 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec89256640 1 -- 172.21.15.121:0/1053810521 learned_addr learned my addr 172.21.15.121:0/1053810521 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec88a55640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fec84135f30 0x7fec840a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38104/0 (socket says 172.21.15.121:38104) 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec89256640 1 -- 172.21.15.121:0/1053810521 >> v1:172.21.15.121:6789/0 conn(0x7fec84135f30 legacy=0x7fec840a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec89256640 1 -- 172.21.15.121:0/1053810521 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec840a08c0 con 0x7fec84135b50 2024-09-15T23:55:31.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.894+0000 7fec7bfff640 1 -- 172.21.15.121:0/1053810521 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2210854916 0 0) 0x7fec8409b020 con 0x7fec84135f30 2024-09-15T23:55:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.895+0000 7fec89256640 1 --2- 172.21.15.121:0/1053810521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409aae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec800097f0 tx=0x7fec8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3517165a291d3dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.895+0000 7fec7bfff640 1 -- 172.21.15.121:0/1053810521 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80037070 con 0x7fec84135b50 2024-09-15T23:55:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.895+0000 7fec7bfff640 1 -- 172.21.15.121:0/1053810521 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec80032440 con 0x7fec84135b50 2024-09-15T23:55:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.895+0000 7fec7bfff640 1 -- 172.21.15.121:0/1053810521 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80032740 con 0x7fec84135b50 2024-09-15T23:55:31.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 -- 172.21.15.121:0/1053810521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 msgr2=0x7fec8409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/1053810521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409aae0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec800097f0 tx=0x7fec8002a270 comp rx=0 tx=0).stop 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 -- 172.21.15.121:0/1053810521 shutdown_connections 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/1053810521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409aae0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 -- 172.21.15.121:0/1053810521 >> 172.21.15.121:0/1053810521 conn(0x7fec840a85e0 msgr2=0x7fec840a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 -- 172.21.15.121:0/1053810521 shutdown_connections 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.896+0000 7fec8b4ba640 1 -- 172.21.15.121:0/1053810521 wait complete. 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec8b4ba640 1 Processor -- start 2024-09-15T23:55:31.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec8b4ba640 1 -- start start 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec8b4ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec8b4ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec840a5430 con 0x7fec84135b50 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec89256640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec89256640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60214/0 (socket says 172.21.15.121:60214) 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec89256640 1 -- 172.21.15.121:0/3166881732 learned_addr learned my addr 172.21.15.121:0/3166881732 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:31.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.897+0000 7fec89256640 1 -- 172.21.15.121:0/3166881732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec84120ed0 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec89256640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec80035040 tx=0x7fec800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80041070 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8003c7a0 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec840a32c0 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec80037040 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.898+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec84073650 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.899+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fec80044070 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.899+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec84120ce0 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.899+0000 7fec79ffb640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 0x7fec6803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.899+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7fec8006bc30 con 0x7fec84135b50 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.899+0000 7fec88a55640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 0x7fec6803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:31.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.900+0000 7fec88a55640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 0x7fec6803a760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec74000c00 tx=0x7fec74007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:31.905 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:31.904+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec80072080 con 0x7fec84135b50 2024-09-15T23:55:32.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.105+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec84136350 con 0x7fec84135b50 2024-09-15T23:55:32.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.106+0000 7fec79ffb640 1 -- 172.21.15.121:0/3166881732 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7fec8003d3f0 con 0x7fec84135b50 2024-09-15T23:55:32.108 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:32.108 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:32.108 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 msgr2=0x7fec6803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 0x7fec6803a760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec74000c00 tx=0x7fec74007910 comp rx=0 tx=0).stop 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 msgr2=0x7fec8409f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fec80035040 tx=0x7fec800046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 shutdown_connections 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fec680382a0 0x7fec6803a760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 --2- 172.21.15.121:0/3166881732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec84135b50 0x7fec8409f440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 >> 172.21.15.121:0/3166881732 conn(0x7fec840a85e0 msgr2=0x7fec840a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 shutdown_connections 2024-09-15T23:55:32.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.108+0000 7fec8b4ba640 1 -- 172.21.15.121:0/3166881732 wait complete. 2024-09-15T23:55:32.121 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f855a69b640 1 Processor -- start 2024-09-15T23:55:32.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f855a69b640 1 -- start start 2024-09-15T23:55:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f855a69b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85540a4c20 0x7f855413f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f855a69b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855413a080 con 0x7f855413a280 2024-09-15T23:55:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f855a69b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f85540a3d50 con 0x7f85540a4c20 2024-09-15T23:55:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f85537fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85540a4c20 0x7f855413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f85537fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f85540a4c20 0x7f855413f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36192/0 (socket says 172.21.15.121:36192) 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f8553fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f855413a280 0x7f855413a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45432/0 (socket says 172.21.15.121:45432) 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.218+0000 7f85537fe640 1 -- 172.21.15.121:0/2217816235 learned_addr learned my addr 172.21.15.121:0/2217816235 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.219+0000 7f85537fe640 1 -- 172.21.15.121:0/2217816235 >> v1:172.21.15.121:6789/0 conn(0x7f855413a280 legacy=0x7f855413a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.219+0000 7f85537fe640 1 -- 172.21.15.121:0/2217816235 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540a3f80 con 0x7f85540a4c20 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.219+0000 7f8552ffd640 1 -- 172.21.15.121:0/2217816235 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452634067 0 0) 0x7f855413a080 con 0x7f855413a280 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.219+0000 7f85537fe640 1 --2- 172.21.15.121:0/2217816235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f855413f060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f85480097f0 tx=0x7f854802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9fb0d91da8dacc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f8552ffd640 1 -- 172.21.15.121:0/2217816235 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8548037070 con 0x7f85540a4c20 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f8552ffd640 1 -- 172.21.15.121:0/2217816235 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548032440 con 0x7f85540a4c20 2024-09-15T23:55:32.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f8552ffd640 1 -- 172.21.15.121:0/2217816235 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f854802ae60 con 0x7f85540a4c20 2024-09-15T23:55:32.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 -- 172.21.15.121:0/2217816235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 msgr2=0x7f855413f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 --2- 172.21.15.121:0/2217816235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f855413f060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f85480097f0 tx=0x7f854802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 -- 172.21.15.121:0/2217816235 shutdown_connections 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 --2- 172.21.15.121:0/2217816235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f855413f060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 -- 172.21.15.121:0/2217816235 >> 172.21.15.121:0/2217816235 conn(0x7f85540ac3e0 msgr2=0x7f85540ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 -- 172.21.15.121:0/2217816235 shutdown_connections 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.220+0000 7f855a69b640 1 -- 172.21.15.121:0/2217816235 wait complete. 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.221+0000 7f855a69b640 1 Processor -- start 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.221+0000 7f855a69b640 1 -- start start 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f855a69b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f855a69b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85540a7ec0 con 0x7f85540a4c20 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8553fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8553fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36198/0 (socket says 172.21.15.121:36198) 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8553fff640 1 -- 172.21.15.121:0/559413710 learned_addr learned my addr 172.21.15.121:0/559413710 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8553fff640 1 -- 172.21.15.121:0/559413710 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85540a2a70 con 0x7f85540a4c20 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8553fff640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f854400c420 tx=0x7f854400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544018070 con 0x7f85540a4c20 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85440074d0 con 0x7f85540a4c20 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855409f760 con 0x7f85540a4c20 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544004950 con 0x7f85540a4c20 2024-09-15T23:55:32.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.222+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855409f480 con 0x7f85540a4c20 2024-09-15T23:55:32.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.223+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f854401b070 con 0x7f85540a4c20 2024-09-15T23:55:32.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.223+0000 7f8550ff9640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 0x7f854003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.223+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f854404a560 con 0x7f85540a4c20 2024-09-15T23:55:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.223+0000 7f85537fe640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 0x7f854003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.223+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85540a2f50 con 0x7f85540a4c20 2024-09-15T23:55:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.224+0000 7f85537fe640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 0x7f854003a760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8548034000 tx=0x7f854802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.228+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8544011980 con 0x7f85540a4c20 2024-09-15T23:55:32.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.427+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85540732e0 con 0x7f85540a4c20 2024-09-15T23:55:32.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.427+0000 7f8550ff9640 1 -- 172.21.15.121:0/559413710 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3572 (secure 0 0 0) 0x7f8544011be0 con 0x7f85540a4c20 2024-09-15T23:55:32.429 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:32.430 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":6,"btime":"2024-09-15T23:55:14:678331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/913541844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":913541844},{"type":"v1","addr":"172.21.15.121:6828","nonce":913541844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:12.005122+0000","modified":"2024-09-15T23:55:13.997733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4146},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4146":{"gid":4146,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/2618169623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":2618169623},{"type":"v1","addr":"172.21.15.121:6829","nonce":2618169623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4146,"qdb_cluster":[4146]},"id":1}]} 2024-09-15T23:55:32.430 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 6 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 msgr2=0x7f854003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 0x7f854003a760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8548034000 tx=0x7f854802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 msgr2=0x7f85540a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f854400c420 tx=0x7f854400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 shutdown_connections 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f85400382a0 0x7f854003a760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 --2- 172.21.15.121:0/559413710 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85540a4c20 0x7f85540a1d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 >> 172.21.15.121:0/559413710 conn(0x7f85540ac3e0 msgr2=0x7f85540a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 shutdown_connections 2024-09-15T23:55:32.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.429+0000 7f855a69b640 1 -- 172.21.15.121:0/559413710 wait complete. 2024-09-15T23:55:32.442 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.538+0000 7f22bc88d640 1 Processor -- start 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.538+0000 7f22bc88d640 1 -- start start 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22bc88d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22b8133640 0x7f22b813b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22bc88d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b80a16c0 con 0x7f22b80a39c0 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22bc88d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f22b80a1490 con 0x7f22b8133640 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22add9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22b8133640 0x7f22b813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22b659c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f22b80a39c0 0x7f22b8132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45434/0 (socket says 172.21.15.121:45434) 2024-09-15T23:55:32.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22b659c640 1 -- 172.21.15.121:0/3618222603 learned_addr learned my addr 172.21.15.121:0/3618222603 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:32.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22add9b640 1 -- 172.21.15.121:0/3618222603 >> v1:172.21.15.121:6789/0 conn(0x7f22b80a39c0 legacy=0x7f22b8132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.539+0000 7f22add9b640 1 -- 172.21.15.121:0/3618222603 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b80a4010 con 0x7f22b8133640 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22add9b640 1 --2- 172.21.15.121:0/3618222603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b8133640 0x7f22b813b270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009720 tx=0x7f22a002b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22b8d1c69cef28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22b5d9b640 1 -- 172.21.15.121:0/3618222603 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a0038070 con 0x7f22b8133640 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22b5d9b640 1 -- 172.21.15.121:0/3618222603 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a0033440 con 0x7f22b8133640 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22b5d9b640 1 -- 172.21.15.121:0/3618222603 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a0033740 con 0x7f22b8133640 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 -- 172.21.15.121:0/3618222603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b8133640 msgr2=0x7f22b813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 --2- 172.21.15.121:0/3618222603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b8133640 0x7f22b813b270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009720 tx=0x7f22a002b220 comp rx=0 tx=0).stop 2024-09-15T23:55:32.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 -- 172.21.15.121:0/3618222603 shutdown_connections 2024-09-15T23:55:32.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 --2- 172.21.15.121:0/3618222603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b8133640 0x7f22b813b270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 -- 172.21.15.121:0/3618222603 >> 172.21.15.121:0/3618222603 conn(0x7f22b80a85e0 msgr2=0x7f22b80a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 -- 172.21.15.121:0/3618222603 shutdown_connections 2024-09-15T23:55:32.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.540+0000 7f22bc88d640 1 -- 172.21.15.121:0/3618222603 wait complete. 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22bc88d640 1 Processor -- start 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22bc88d640 1 -- start start 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22bc88d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22bc88d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22b81329c0 con 0x7f22b80a39c0 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22b659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36222/0 (socket says 172.21.15.121:36222) 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22b659c640 1 -- 172.21.15.121:0/39303471 learned_addr learned my addr 172.21.15.121:0/39303471 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.542+0000 7f22b659c640 1 -- 172.21.15.121:0/39303471 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b806f110 con 0x7f22b80a39c0 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22b659c640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c480 tx=0x7f22a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8017070 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a8005c10 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b806fd00 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a80070d0 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.543+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b80736a0 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22a801a070 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b80a2340 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22af7fe640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 0x7f229803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f22a804a510 con 0x7f22b80a39c0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22add9b640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 0x7f229803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.544+0000 7f22add9b640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 0x7f229803a710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22a0035000 tx=0x7f22a002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.549+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22a801a730 con 0x7f22b80a39c0 2024-09-15T23:55:32.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.715+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22b8070fa0 con 0x7f22b80a39c0 2024-09-15T23:55:32.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.716+0000 7f22af7fe640 1 -- 172.21.15.121:0/39303471 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+10675 (secure 0 0 0) 0x7f22a801a990 con 0x7f22b80a39c0 2024-09-15T23:55:32.718 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:32.718 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":17,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:13.672972+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:09.813062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:10.987503+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 msgr2=0x7f229803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 0x7f229803a710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22a0035000 tx=0x7f22a002f000 comp rx=0 tx=0).stop 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 msgr2=0x7f22b8070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c480 tx=0x7f22a800c940 comp rx=0 tx=0).stop 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 shutdown_connections 2024-09-15T23:55:32.720 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2298038250 0x7f229803a710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 --2- 172.21.15.121:0/39303471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b80a39c0 0x7f22b8070a60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 >> 172.21.15.121:0/39303471 conn(0x7f22b80a85e0 msgr2=0x7f22b80a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 shutdown_connections 2024-09-15T23:55:32.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.718+0000 7f22bc88d640 1 -- 172.21.15.121:0/39303471 wait complete. 2024-09-15T23:55:32.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:55:32.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.828+0000 7f707fd66640 1 Processor -- start 2024-09-15T23:55:32.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.828+0000 7f707fd66640 1 -- start start 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707fd66640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70780a1c80 0x7f707813a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707fd66640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707809f2f0 con 0x7f707813a220 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707fd66640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f70780a07d0 con 0x7f70780a1c80 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707d301640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70780a1c80 0x7f707813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707db02640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f707813a220 0x7f7078136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45440/0 (socket says 172.21.15.121:45440) 2024-09-15T23:55:32.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707db02640 1 -- 172.21.15.121:0/1486410228 learned_addr learned my addr 172.21.15.121:0/1486410228 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707d301640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70780a1c80 0x7f707813a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36224/0 (socket says 172.21.15.121:36224) 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707d301640 1 -- 172.21.15.121:0/1486410228 >> v1:172.21.15.121:6789/0 conn(0x7f707813a220 legacy=0x7f7078136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.829+0000 7f707d301640 1 -- 172.21.15.121:0/1486410228 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7078139dd0 con 0x7f70780a1c80 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.830+0000 7f707d301640 1 --2- 172.21.15.121:0/1486410228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f707813a600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7074009720 tx=0x7f707402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8298df5dfaaa4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.830+0000 7f707cb00640 1 -- 172.21.15.121:0/1486410228 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7074037070 con 0x7f70780a1c80 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.830+0000 7f707cb00640 1 -- 172.21.15.121:0/1486410228 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707402ad90 con 0x7f70780a1c80 2024-09-15T23:55:32.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.830+0000 7f707cb00640 1 -- 172.21.15.121:0/1486410228 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7074032590 con 0x7f70780a1c80 2024-09-15T23:55:32.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 -- 172.21.15.121:0/1486410228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 msgr2=0x7f707813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:32.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 --2- 172.21.15.121:0/1486410228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f707813a600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7074009720 tx=0x7f707402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:32.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 -- 172.21.15.121:0/1486410228 shutdown_connections 2024-09-15T23:55:32.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 --2- 172.21.15.121:0/1486410228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f707813a600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:32.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 -- 172.21.15.121:0/1486410228 >> 172.21.15.121:0/1486410228 conn(0x7f707806d820 msgr2=0x7f707806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 -- 172.21.15.121:0/1486410228 shutdown_connections 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.831+0000 7f707fd66640 1 -- 172.21.15.121:0/1486410228 wait complete. 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707fd66640 1 Processor -- start 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707fd66640 1 -- start start 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707fd66640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707fd66640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7078139a20 con 0x7f70780a1c80 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707db02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707db02640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36232/0 (socket says 172.21.15.121:36232) 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.832+0000 7f707db02640 1 -- 172.21.15.121:0/4241531108 learned_addr learned my addr 172.21.15.121:0/4241531108 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f707db02640 1 -- 172.21.15.121:0/4241531108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70780aa2f0 con 0x7f70780a1c80 2024-09-15T23:55:32.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f707db02640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c380 tx=0x7f706c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f706c005c10 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c005db0 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f706c004930 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70780a9760 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.833+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70780acf40 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f706c01a020 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70780a7c00 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f706a7fc640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 0x7f705c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3439+0+0 (secure 0 0 0) 0x7f706c04a9e0 con 0x7f70780a1c80 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f707d301640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 0x7f705c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:32.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.834+0000 7f707d301640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 0x7f705c03a760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70780a20c0 tx=0x7f707402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:32.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:32.839+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f707809f2f0 con 0x7f70780a1c80 2024-09-15T23:55:33.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.041+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f70780a0100 con 0x7f70780a1c80 2024-09-15T23:55:33.043 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:55:33.041+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:55:33.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.042+0000 7f706a7fc640 1 -- 172.21.15.121:0/4241531108 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f706c0127f0 con 0x7f70780a1c80 2024-09-15T23:55:33.044 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:55:33.045 INFO:tasks.ceph.mds.a.smithi121.stderr: -2253> 2024-09-15T23:55:06.645+0000 7f2b14778640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6826/0: (98) Address already in use 2024-09-15T23:55:33.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 msgr2=0x7f705c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 0x7f705c03a760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70780a20c0 tx=0x7f707402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:33.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 msgr2=0x7f70780a5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c380 tx=0x7f706c00c840 comp rx=0 tx=0).stop 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 shutdown_connections 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f705c0382a0 0x7f705c03a760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 --2- 172.21.15.121:0/4241531108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70780a1c80 0x7f70780a5c80 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c380 tx=0x7f706c00c840 comp rx=0 tx=0).stop 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 >> 172.21.15.121:0/4241531108 conn(0x7f707806d820 msgr2=0x7f7078136380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 shutdown_connections 2024-09-15T23:55:33.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.045+0000 7f707fd66640 1 -- 172.21.15.121:0/4241531108 wait complete. 2024-09-15T23:55:33.048 INFO:tasks.ceph.mds.a.smithi121.stderr: -1122> 2024-09-15T23:55:16.653+0000 7f2b0e76c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:55:33.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:55:33.073 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:55:33.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.157+0000 7efdc0333640 1 Processor -- start 2024-09-15T23:55:33.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.157+0000 7efdc0333640 1 -- start start 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdc0333640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efdb80a4ab0 0x7efdb813eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdc0333640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80a6d10 con 0x7efdb80a7140 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdc0333640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efdb806e230 con 0x7efdb80a4ab0 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbe0cf640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efdb80a7140 0x7efdb80a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45454/0 (socket says 172.21.15.121:45454) 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbe0cf640 1 -- 172.21.15.121:0/1362429361 learned_addr learned my addr 172.21.15.121:0/1362429361 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbd8ce640 1 --2- 172.21.15.121:0/1362429361 >> v2:172.21.15.121:3300/0 conn(0x7efdb80a4ab0 0x7efdb813eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbd8ce640 1 -- 172.21.15.121:0/1362429361 >> v1:172.21.15.121:6789/0 conn(0x7efdb80a7140 legacy=0x7efdb80a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbd8ce640 1 -- 172.21.15.121:0/1362429361 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80a3ae0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.158+0000 7efdbd0cd640 1 -- 172.21.15.121:0/1362429361 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795364697 0 0) 0x7efdb80a6d10 con 0x7efdb80a7140 2024-09-15T23:55:33.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.159+0000 7efdbd8ce640 1 --2- 172.21.15.121:0/1362429361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb813eef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdac009720 tx=0x7efdac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c661a2ed4e9ecf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.159+0000 7efdbd0cd640 1 -- 172.21.15.121:0/1362429361 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac037070 con 0x7efdb80a4ab0 2024-09-15T23:55:33.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.159+0000 7efdbd0cd640 1 -- 172.21.15.121:0/1362429361 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdac02ad90 con 0x7efdb80a4ab0 2024-09-15T23:55:33.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.159+0000 7efdbd0cd640 1 -- 172.21.15.121:0/1362429361 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdac032590 con 0x7efdb80a4ab0 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 -- 172.21.15.121:0/1362429361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 msgr2=0x7efdb813eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 --2- 172.21.15.121:0/1362429361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb813eef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdac009720 tx=0x7efdac02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 -- 172.21.15.121:0/1362429361 shutdown_connections 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 --2- 172.21.15.121:0/1362429361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb813eef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 -- 172.21.15.121:0/1362429361 >> 172.21.15.121:0/1362429361 conn(0x7efdb80ac370 msgr2=0x7efdb80ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:33.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 -- 172.21.15.121:0/1362429361 shutdown_connections 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.160+0000 7efdc0333640 1 -- 172.21.15.121:0/1362429361 wait complete. 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdc0333640 1 Processor -- start 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdc0333640 1 -- start start 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdc0333640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdc0333640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80a7fc0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdbe0cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdbe0cf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36272/0 (socket says 172.21.15.121:36272) 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.161+0000 7efdbe0cf640 1 -- 172.21.15.121:0/995378116 learned_addr learned my addr 172.21.15.121:0/995378116 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdbe0cf640 1 -- 172.21.15.121:0/995378116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80a1140 con 0x7efdb80a4ab0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdbe0cf640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c420 tx=0x7efdb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb4018070 con 0x7efdb80a4ab0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb40074d0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb809e7c0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb4004950 con 0x7efdb80a4ab0 2024-09-15T23:55:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.162+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80a0010 con 0x7efdb80a4ab0 2024-09-15T23:55:33.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.163+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efdb401b070 con 0x7efdb80a4ab0 2024-09-15T23:55:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.163+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb80008d0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.163+0000 7efdaaffd640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 0x7efd9c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.163+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3525+0+0 (secure 0 0 0) 0x7efdb404a5c0 con 0x7efdb80a4ab0 2024-09-15T23:55:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.163+0000 7efdbd8ce640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 0x7efd9c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:33.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.164+0000 7efdbd8ce640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 0x7efd9c03a760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:33.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.168+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb4011980 con 0x7efdb80a4ab0 2024-09-15T23:55:33.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:33.370+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7efdb80a2930 con 0x7efdb80a4ab0 2024-09-15T23:55:34.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.042+0000 7efdaaffd640 1 -- 172.21.15.121:0/995378116 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7efdb4011be0 con 0x7efdb80a4ab0 2024-09-15T23:55:34.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 msgr2=0x7efd9c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 0x7efd9c03a760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdac034000 tx=0x7efdac02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 msgr2=0x7efdb8135c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efdb400c420 tx=0x7efdb400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 shutdown_connections 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd9c0382a0 0x7efd9c03a760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 --2- 172.21.15.121:0/995378116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efdb80a4ab0 0x7efdb8135c60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 >> 172.21.15.121:0/995378116 conn(0x7efdb80ac370 msgr2=0x7efdb81370f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 shutdown_connections 2024-09-15T23:55:34.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.045+0000 7efdc0333640 1 -- 172.21.15.121:0/995378116 wait complete. 2024-09-15T23:55:34.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.200+0000 7fbb7ecaf640 1 Processor -- start 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.200+0000 7fbb7ecaf640 1 -- start start 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ecaf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb780a7140 0x7fbb780a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ecaf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb780a6d10 con 0x7fbb780a4ab0 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ecaf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbb7806e230 con 0x7fbb780a7140 2024-09-15T23:55:34.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ca4b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb780a7140 0x7fbb780a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb77fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbb780a4ab0 0x7fbb78139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45462/0 (socket says 172.21.15.121:45462) 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ca4b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbb780a7140 0x7fbb780a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36278/0 (socket says 172.21.15.121:36278) 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb77fff640 1 -- 172.21.15.121:0/1598872876 learned_addr learned my addr 172.21.15.121:0/1598872876 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ca4b640 1 -- 172.21.15.121:0/1598872876 >> v1:172.21.15.121:6789/0 conn(0x7fbb780a4ab0 legacy=0x7fbb78139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb7ca4b640 1 -- 172.21.15.121:0/1598872876 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780a3ae0 con 0x7fbb780a7140 2024-09-15T23:55:34.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.201+0000 7fbb777fe640 1 -- 172.21.15.121:0/1598872876 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224996780 0 0) 0x7fbb780a6d10 con 0x7fbb780a4ab0 2024-09-15T23:55:34.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.202+0000 7fbb7ca4b640 1 --2- 172.21.15.121:0/1598872876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a7140 0x7fbb780a7520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009720 tx=0x7fbb6802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c6cb919ba399b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.202+0000 7fbb777fe640 1 -- 172.21.15.121:0/1598872876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb68037070 con 0x7fbb780a7140 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.202+0000 7fbb777fe640 1 -- 172.21.15.121:0/1598872876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6802ad90 con 0x7fbb780a7140 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.202+0000 7fbb777fe640 1 -- 172.21.15.121:0/1598872876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb68032590 con 0x7fbb780a7140 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/1598872876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a7140 msgr2=0x7fbb780a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/1598872876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a7140 0x7fbb780a7520 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009720 tx=0x7fbb6802a110 comp rx=0 tx=0).stop 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/1598872876 shutdown_connections 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/1598872876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a7140 0x7fbb780a7520 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/1598872876 >> 172.21.15.121:0/1598872876 conn(0x7fbb780ac370 msgr2=0x7fbb780ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/1598872876 shutdown_connections 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.203+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/1598872876 wait complete. 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ecaf640 1 Processor -- start 2024-09-15T23:55:34.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ecaf640 1 -- start start 2024-09-15T23:55:34.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ecaf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ecaf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb780a7fc0 con 0x7fbb780a4ab0 2024-09-15T23:55:34.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ca4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ca4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36294/0 (socket says 172.21.15.121:36294) 2024-09-15T23:55:34.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.204+0000 7fbb7ca4b640 1 -- 172.21.15.121:0/659751797 learned_addr learned my addr 172.21.15.121:0/659751797 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb7ca4b640 1 -- 172.21.15.121:0/659751797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb780a29b0 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb7ca4b640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009840 tx=0x7fbb680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb68041020 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6803d550 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb780a01f0 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb68037040 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.205+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb780a04b0 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbb68044020 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb757fa640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 0x7fbb6403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb780a1180 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3525+0+0 (secure 0 0 0) 0x7fbb6806b910 con 0x7fbb780a4ab0 2024-09-15T23:55:34.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb77fff640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 0x7fbb6403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:34.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.206+0000 7fbb77fff640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 0x7fbb6403a760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0011e0 tx=0x7fbb6c007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:34.212 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.211+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb6804b030 con 0x7fbb780a4ab0 2024-09-15T23:55:34.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:34.381+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbb780732e0 con 0x7fbb780a4ab0 2024-09-15T23:55:34.531 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:55:35.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.043+0000 7fbb757fa640 1 -- 172.21.15.121:0/659751797 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v19) ==== 181+0+0 (secure 0 0 0) 0x7fbb6803d870 con 0x7fbb780a4ab0 2024-09-15T23:55:35.045 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:55:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.046+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 msgr2=0x7fbb6403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.046+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 0x7fbb6403a760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0011e0 tx=0x7fbb6c007930 comp rx=0 tx=0).stop 2024-09-15T23:55:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.046+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 msgr2=0x7fbb780a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.046+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009840 tx=0x7fbb680046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:35.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.047+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 shutdown_connections 2024-09-15T23:55:35.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.047+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbb640382a0 0x7fbb6403a760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.047+0000 7fbb7ecaf640 1 --2- 172.21.15.121:0/659751797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb780a4ab0 0x7fbb780a0c40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.047+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 >> 172.21.15.121:0/659751797 conn(0x7fbb780ac370 msgr2=0x7fbb781371a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.047+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 shutdown_connections 2024-09-15T23:55:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.048+0000 7fbb7ecaf640 1 -- 172.21.15.121:0/659751797 wait complete. 2024-09-15T23:55:35.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:55:35.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84ad4f1640 1 Processor -- start 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84ad4f1640 1 -- start start 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84ad4f1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84a80a3b90 0x7f84a80a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84ad4f1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a80a4560 con 0x7f84a80a37b0 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84ad4f1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84a809b4f0 con 0x7f84a80a3b90 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84a67fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84a80a3b90 0x7f84a80a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84a6ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84a80a37b0 0x7f84a809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45476/0 (socket says 172.21.15.121:45476) 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84a6ffd640 1 -- 172.21.15.121:0/266053497 learned_addr learned my addr 172.21.15.121:0/266053497 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84a67fc640 1 -- 172.21.15.121:0/266053497 >> v1:172.21.15.121:6789/0 conn(0x7f84a80a37b0 legacy=0x7f84a809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:35.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.163+0000 7f84a67fc640 1 -- 172.21.15.121:0/266053497 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a80a1c90 con 0x7f84a80a3b90 2024-09-15T23:55:35.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.164+0000 7f84a67fc640 1 --2- 172.21.15.121:0/266053497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a3b90 0x7f84a80a4020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d727fc47e08a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.164+0000 7f84a5ffb640 1 -- 172.21.15.121:0/266053497 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8490007670 con 0x7f84a80a3b90 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.164+0000 7f84a5ffb640 1 -- 172.21.15.121:0/266053497 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8490007810 con 0x7f84a80a3b90 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.164+0000 7f84a5ffb640 1 -- 172.21.15.121:0/266053497 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8490007b10 con 0x7f84a80a3b90 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 -- 172.21.15.121:0/266053497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a3b90 msgr2=0x7f84a80a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/266053497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a3b90 0x7f84a80a4020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849002a660 comp rx=0 tx=0).stop 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 -- 172.21.15.121:0/266053497 shutdown_connections 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/266053497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a3b90 0x7f84a80a4020 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 -- 172.21.15.121:0/266053497 >> 172.21.15.121:0/266053497 conn(0x7f84a80a8430 msgr2=0x7f84a80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 -- 172.21.15.121:0/266053497 shutdown_connections 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.165+0000 7f84ad4f1640 1 -- 172.21.15.121:0/266053497 wait complete. 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.166+0000 7f84ad4f1640 1 Processor -- start 2024-09-15T23:55:35.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.166+0000 7f84ad4f1640 1 -- start start 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.166+0000 7f84ad4f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.166+0000 7f84ad4f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84a80a5220 con 0x7f84a80a37b0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.166+0000 7f84a6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84a6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36318/0 (socket says 172.21.15.121:36318) 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84a6ffd640 1 -- 172.21.15.121:0/3363378127 learned_addr learned my addr 172.21.15.121:0/3363378127 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84a6ffd640 1 -- 172.21.15.121:0/3363378127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a8071790 con 0x7f84a80a37b0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84a6ffd640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c4a0 tx=0x7f84a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a0017070 con 0x7f84a80a37b0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a0005c10 con 0x7f84a80a37b0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a8072070 con 0x7f84a80a37b0 2024-09-15T23:55:35.172 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a0007070 con 0x7f84a80a37b0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.167+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a80714b0 con 0x7f84a80a37b0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.168+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f84a001a070 con 0x7f84a80a37b0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.168+0000 7f849f7fe640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 0x7f848803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.168+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8072f40 con 0x7f84a80a37b0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.168+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3087+0+0 (secure 0 0 0) 0x7f84a004a360 con 0x7f84a80a37b0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.168+0000 7f84a67fc640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 0x7f848803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:35.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.169+0000 7f84a67fc640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 0x7f848803a760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:35.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.173+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84a001b3b0 con 0x7f84a80a37b0 2024-09-15T23:55:35.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:35.338+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84a80a4020 con 0x7f84a80a37b0 2024-09-15T23:55:36.046 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.044+0000 7f849f7fe640 1 -- 172.21.15.121:0/3363378127 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v20) ==== 169+0+0 (secure 0 0 0) 0x7f84a0034450 con 0x7f84a80a37b0 2024-09-15T23:55:36.046 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.047+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 msgr2=0x7f848803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.047+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 0x7f848803a760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8490009d90 tx=0x7f849002f000 comp rx=0 tx=0).stop 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.047+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 msgr2=0x7f84a811e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.047+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c4a0 tx=0x7f84a000c960 comp rx=0 tx=0).stop 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 shutdown_connections 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f84880382a0 0x7f848803a760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 --2- 172.21.15.121:0/3363378127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84a80a37b0 0x7f84a811e510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 >> 172.21.15.121:0/3363378127 conn(0x7f84a80a8430 msgr2=0x7f84a81371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 shutdown_connections 2024-09-15T23:55:36.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.048+0000 7f84ad4f1640 1 -- 172.21.15.121:0/3363378127 wait complete. 2024-09-15T23:55:36.065 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:55:36.065 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:55:36.065 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:55:36.065 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:36.066 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:55:36.066 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:55:36.066 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:55:36.066 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:55:36.075 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:55:36.075 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:55:36.076 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:55:36.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:55:36.118 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:55:36.119 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:36.119 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:55:36.119 DEBUG:teuthology.parallel:result is None 2024-09-15T23:55:36.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:55:36.195 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:55:36.195 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:55:36.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.220+0000 7efd54a82640 1 Processor -- start 2024-09-15T23:55:36.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.220+0000 7efd54a82640 1 -- start start 2024-09-15T23:55:36.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd54a82640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd500a1c80 0x7efd5013a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:36.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd54a82640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5009f2f0 con 0x7efd5013a220 2024-09-15T23:55:36.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd54a82640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efd500a07d0 con 0x7efd500a1c80 2024-09-15T23:55:36.223 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd500a1c80 0x7efd5013a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:36.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efd5013a220 0x7efd50136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45508/0 (socket says 172.21.15.121:45508) 2024-09-15T23:55:36.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efd500a1c80 0x7efd5013a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36362/0 (socket says 172.21.15.121:36362) 2024-09-15T23:55:36.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4e59c640 1 -- 172.21.15.121:0/2689668914 learned_addr learned my addr 172.21.15.121:0/2689668914 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:36.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4dd9b640 1 -- 172.21.15.121:0/2689668914 >> v1:172.21.15.121:6789/0 conn(0x7efd5013a220 legacy=0x7efd50136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:36.224 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.221+0000 7efd4dd9b640 1 -- 172.21.15.121:0/2689668914 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd50139dd0 con 0x7efd500a1c80 2024-09-15T23:55:36.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.222+0000 7efd4dd9b640 1 --2- 172.21.15.121:0/2689668914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd5013a600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd44009720 tx=0x7efd4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33c4de84b4f95d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:36.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.222+0000 7efd4d59a640 1 -- 172.21.15.121:0/2689668914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd44037070 con 0x7efd500a1c80 2024-09-15T23:55:36.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.222+0000 7efd4d59a640 1 -- 172.21.15.121:0/2689668914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4402ad90 con 0x7efd500a1c80 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.222+0000 7efd4d59a640 1 -- 172.21.15.121:0/2689668914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd44032590 con 0x7efd500a1c80 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 -- 172.21.15.121:0/2689668914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 msgr2=0x7efd5013a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 --2- 172.21.15.121:0/2689668914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd5013a600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd44009720 tx=0x7efd4402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 -- 172.21.15.121:0/2689668914 shutdown_connections 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 --2- 172.21.15.121:0/2689668914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd5013a600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 -- 172.21.15.121:0/2689668914 >> 172.21.15.121:0/2689668914 conn(0x7efd5006d820 msgr2=0x7efd5006dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 -- 172.21.15.121:0/2689668914 shutdown_connections 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.223+0000 7efd54a82640 1 -- 172.21.15.121:0/2689668914 wait complete. 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd54a82640 1 Processor -- start 2024-09-15T23:55:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd54a82640 1 -- start start 2024-09-15T23:55:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd54a82640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd54a82640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efd50139a20 con 0x7efd500a1c80 2024-09-15T23:55:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd4e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd4e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36374/0 (socket says 172.21.15.121:36374) 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.224+0000 7efd4e59c640 1 -- 172.21.15.121:0/2826287219 learned_addr learned my addr 172.21.15.121:0/2826287219 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd4e59c640 1 -- 172.21.15.121:0/2826287219 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd500aa2f0 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd4e59c640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c380 tx=0x7efd4000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40005c10 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40005db0 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd500a9760 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd40004930 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.225+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd500acf40 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.226+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7efd4001a020 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.226+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd500a7c00 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.226+0000 7efd3effd640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 0x7efd3003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.226+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 2673+0+0 (secure 0 0 0) 0x7efd4004a6e0 con 0x7efd500a1c80 2024-09-15T23:55:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.226+0000 7efd4dd9b640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 0x7efd3003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.227+0000 7efd4dd9b640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 0x7efd3003a760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd500a20c0 tx=0x7efd4402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.231+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd5009f2f0 con 0x7efd500a1c80 2024-09-15T23:55:36.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:36.407+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efd500a0100 con 0x7efd500a1c80 2024-09-15T23:55:37.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.711+0000 7efd3effd640 1 -- 172.21.15.121:0/2826287219 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v23) ==== 97+0+0 (secure 0 0 0) 0x7efd400127f0 con 0x7efd500a1c80 2024-09-15T23:55:37.713 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 msgr2=0x7efd3003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 0x7efd3003a760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd500a20c0 tx=0x7efd4402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 msgr2=0x7efd500a5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c380 tx=0x7efd4000c840 comp rx=0 tx=0).stop 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 shutdown_connections 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7efd300382a0 0x7efd3003a760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 --2- 172.21.15.121:0/2826287219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd500a1c80 0x7efd500a5c80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 >> 172.21.15.121:0/2826287219 conn(0x7efd5006d820 msgr2=0x7efd50136380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 shutdown_connections 2024-09-15T23:55:37.716 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.714+0000 7efd54a82640 1 -- 172.21.15.121:0/2826287219 wait complete. 2024-09-15T23:55:37.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:55:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.832+0000 7f2b1c35b640 1 Processor -- start 2024-09-15T23:55:37.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.832+0000 7f2b1c35b640 1 -- start start 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b1c35b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b140a1b60 0x7f2b14143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b1c35b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b1413ee30 con 0x7f2b1413e340 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b1c35b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2b140a0c00 con 0x7f2b140a1b60 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b198f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b140a1b60 0x7f2b14143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b198f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b140a1b60 0x7f2b14143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36386/0 (socket says 172.21.15.121:36386) 2024-09-15T23:55:37.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b198f6640 1 -- 172.21.15.121:0/3928482263 learned_addr learned my addr 172.21.15.121:0/3928482263 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b1a0f7640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2b1413e340 0x7f2b1413e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45524/0 (socket says 172.21.15.121:45524) 2024-09-15T23:55:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b198f6640 1 -- 172.21.15.121:0/3928482263 >> v1:172.21.15.121:6789/0 conn(0x7f2b1413e340 legacy=0x7f2b1413e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.833+0000 7f2b198f6640 1 -- 172.21.15.121:0/3928482263 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b140a0ea0 con 0x7f2b140a1b60 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b198f6640 1 --2- 172.21.15.121:0/3928482263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14143230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b100097f0 tx=0x7f2b1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebb6c044a73e7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b190f5640 1 -- 172.21.15.121:0/3928482263 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b10037070 con 0x7f2b140a1b60 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b190f5640 1 -- 172.21.15.121:0/3928482263 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b10032440 con 0x7f2b140a1b60 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b190f5640 1 -- 172.21.15.121:0/3928482263 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b1002ae60 con 0x7f2b140a1b60 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3928482263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 msgr2=0x7f2b14143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:37.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.834+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3928482263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14143230 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b100097f0 tx=0x7f2b1002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3928482263 shutdown_connections 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3928482263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14143230 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3928482263 >> 172.21.15.121:0/3928482263 conn(0x7f2b140a85e0 msgr2=0x7f2b140a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3928482263 shutdown_connections 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3928482263 wait complete. 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.835+0000 7f2b1c35b640 1 Processor -- start 2024-09-15T23:55:37.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1c35b640 1 -- start start 2024-09-15T23:55:37.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1c35b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1c35b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b140a5490 con 0x7f2b140a1b60 2024-09-15T23:55:37.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1a0f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1a0f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36390/0 (socket says 172.21.15.121:36390) 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1a0f7640 1 -- 172.21.15.121:0/3731270948 learned_addr learned my addr 172.21.15.121:0/3731270948 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.836+0000 7f2b1a0f7640 1 -- 172.21.15.121:0/3731270948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b14073270 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b1a0f7640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c450 tx=0x7f2b0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b04007410 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b040075b0 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b141274a0 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b04004910 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.837+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b14127070 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2b0401a020 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b14128740 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b0affd640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 0x7f2af803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7f2b0404a6d0 con 0x7f2b140a1b60 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b198f6640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 0x7f2af803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:37.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.838+0000 7f2b198f6640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 0x7f2af803a760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b10034000 tx=0x7f2b1002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:37.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:37.843+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b0401b9c0 con 0x7f2b140a1b60 2024-09-15T23:55:38.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.073+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2b1406bde0 con 0x7f2b140a1b60 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.074+0000 7f2b0affd640 1 -- 172.21.15.121:0/3731270948 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+3875 (secure 0 0 0) 0x7f2b0401bc20 con 0x7f2b140a1b60 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmrl0yDhAAmges61AkNVATl3fkDcJtCA==", 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.076 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dm1c5EFRAAQjii6dloQtB9r6b+oDUlfA==", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.077 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC+c+dmWS98OBAABYXXLJEiQ32Ch8sOdjmGMQ==", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDCc+dmae/mKxAAb1MVakHG7AWyXTfjXcC5Ww==", 2024-09-15T23:55:38.078 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDGc+dm0fWaLRAAVx8jT36dFL/hVkUBD+L4uA==", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg==", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmOA9CIRAA3IDTN3uPbSBxbM2AFlMv4w==", 2024-09-15T23:55:38.080 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC7c+dm1qMxNRAAha+qdHw6Albq/4FeBkKFmw==", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:55:38.081 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mds", 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dm+mq1LxAA+/aLrWtLMK7bxIzl+3HO8A==", 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dmxnK1LxAAVi0mn/CTY9RENA1n1B1Rkw==", 2024-09-15T23:55:38.082 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-osd", 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dmGXm1LxAAUjUxCgDdvxM0s79rv3oNnw==", 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dmrH+1LxAARqLNgRCLChNEQs/2YpxCKQ==", 2024-09-15T23:55:38.083 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dmZ4a1LxAAE7PxJAK4+fpfW/IiAtMkWA==", 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T23:55:38.084 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDLc+dm0421LxAAVVaik69Wqrm6zt55QOlv0A==", 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmGfgJCxAAO99Xwfzdn6pwAplxw70kOQ==", 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:38.085 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:55:38.086 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:38.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 msgr2=0x7f2af803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 0x7f2af803a760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b10034000 tx=0x7f2b1002e000 comp rx=0 tx=0).stop 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 msgr2=0x7f2b14128200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c450 tx=0x7f2b0400c910 comp rx=0 tx=0).stop 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 shutdown_connections 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f2af80382a0 0x7f2af803a760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 --2- 172.21.15.121:0/3731270948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b140a1b60 0x7f2b14128200 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 >> 172.21.15.121:0/3731270948 conn(0x7f2b140a85e0 msgr2=0x7f2b140a38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 shutdown_connections 2024-09-15T23:55:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.076+0000 7f2b1c35b640 1 -- 172.21.15.121:0/3731270948 wait complete. 2024-09-15T23:55:38.089 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T23:55:38.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.186+0000 7f21ce52c640 1 Processor -- start 2024-09-15T23:55:38.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.186+0000 7f21ce52c640 1 -- start start 2024-09-15T23:55:38.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.186+0000 7f21ce52c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f21c80a4c20 0x7f21c813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21ce52c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c813a080 con 0x7f21c813a280 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21ce52c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f21c80a3d50 con 0x7f21c80a4c20 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f21c80a4c20 0x7f21c813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f21c80a4c20 0x7f21c813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36392/0 (socket says 172.21.15.121:36392) 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c77fe640 1 -- 172.21.15.121:0/3728877721 learned_addr learned my addr 172.21.15.121:0/3728877721 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c7fff640 1 --1- 172.21.15.121:0/3728877721 >> v1:172.21.15.121:6789/0 conn(0x7f21c813a280 0x7f21c813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45536/0 (socket says 172.21.15.121:45536) 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c77fe640 1 -- 172.21.15.121:0/3728877721 >> v1:172.21.15.121:6789/0 conn(0x7f21c813a280 legacy=0x7f21c813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.187+0000 7f21c77fe640 1 -- 172.21.15.121:0/3728877721 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c80a3f80 con 0x7f21c80a4c20 2024-09-15T23:55:38.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21c77fe640 1 --2- 172.21.15.121:0/3728877721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c813f060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0097f0 tx=0x7f21bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6744be6d8752c653 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21c6ffd640 1 -- 172.21.15.121:0/3728877721 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21bc037070 con 0x7f21c80a4c20 2024-09-15T23:55:38.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21c6ffd640 1 -- 172.21.15.121:0/3728877721 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc032440 con 0x7f21c80a4c20 2024-09-15T23:55:38.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21c6ffd640 1 -- 172.21.15.121:0/3728877721 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21bc02ae60 con 0x7f21c80a4c20 2024-09-15T23:55:38.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 -- 172.21.15.121:0/3728877721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 msgr2=0x7f21c813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 --2- 172.21.15.121:0/3728877721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c813f060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0097f0 tx=0x7f21bc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 -- 172.21.15.121:0/3728877721 shutdown_connections 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 --2- 172.21.15.121:0/3728877721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c813f060 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 -- 172.21.15.121:0/3728877721 >> 172.21.15.121:0/3728877721 conn(0x7f21c80ac3e0 msgr2=0x7f21c80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 -- 172.21.15.121:0/3728877721 shutdown_connections 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.188+0000 7f21ce52c640 1 -- 172.21.15.121:0/3728877721 wait complete. 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.189+0000 7f21ce52c640 1 Processor -- start 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.189+0000 7f21ce52c640 1 -- start start 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21ce52c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21ce52c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f21c80a7ec0 con 0x7f21c80a4c20 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36398/0 (socket says 172.21.15.121:36398) 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c7fff640 1 -- 172.21.15.121:0/1053185411 learned_addr learned my addr 172.21.15.121:0/1053185411 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c7fff640 1 -- 172.21.15.121:0/1053185411 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c8125070 con 0x7f21c80a4c20 2024-09-15T23:55:38.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c7fff640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c450 tx=0x7f21b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21b8007410 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b80075b0 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c8124780 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.190+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21b8004910 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.191+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c8124470 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.191+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f21b801a020 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.191+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c8122c20 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.192+0000 7f21c4ff9640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 0x7f21b403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.192+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7f21b804a6b0 con 0x7f21c80a4c20 2024-09-15T23:55:38.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.192+0000 7f21c77fe640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 0x7f21b403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.192+0000 7f21c77fe640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 0x7f21b403a760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21bc034000 tx=0x7f21bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.196+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21b801b9f0 con 0x7f21c80a4c20 2024-09-15T23:55:38.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.423+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f21c8124950 con 0x7f21c80a4c20 2024-09-15T23:55:38.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.425+0000 7f21c4ff9640 1 -- 172.21.15.121:0/1053185411 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f21b801bc50 con 0x7f21c80a4c20 2024-09-15T23:55:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 msgr2=0x7f21b403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 0x7f21b403a760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21bc034000 tx=0x7f21bc02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 msgr2=0x7f21c80a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21b800c450 tx=0x7f21b800c910 comp rx=0 tx=0).stop 2024-09-15T23:55:38.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 shutdown_connections 2024-09-15T23:55:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f21b40382a0 0x7f21b403a760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 --2- 172.21.15.121:0/1053185411 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f21c80a4c20 0x7f21c80a0ff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 >> 172.21.15.121:0/1053185411 conn(0x7f21c80ac3e0 msgr2=0x7f21c80aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 shutdown_connections 2024-09-15T23:55:38.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.427+0000 7f21ce52c640 1 -- 172.21.15.121:0/1053185411 wait complete. 2024-09-15T23:55:38.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T23:55:38.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.536+0000 7f7bb37d8640 1 Processor -- start 2024-09-15T23:55:38.538 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.536+0000 7f7bb37d8640 1 -- start start 2024-09-15T23:55:38.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb37d8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bac0a4c20 0x7f7bac13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb37d8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bac13a080 con 0x7f7bac13a280 2024-09-15T23:55:38.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb37d8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7bac0a3d50 con 0x7f7bac0a4c20 2024-09-15T23:55:38.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb0d73640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bac0a4c20 0x7f7bac13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb0d73640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bac0a4c20 0x7f7bac13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36412/0 (socket says 172.21.15.121:36412) 2024-09-15T23:55:38.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb0d73640 1 -- 172.21.15.121:0/1736569388 learned_addr learned my addr 172.21.15.121:0/1736569388 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb1574640 1 --1- 172.21.15.121:0/1736569388 >> v1:172.21.15.121:6789/0 conn(0x7f7bac13a280 0x7f7bac13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45540/0 (socket says 172.21.15.121:45540) 2024-09-15T23:55:38.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb0d73640 1 -- 172.21.15.121:0/1736569388 >> v1:172.21.15.121:6789/0 conn(0x7f7bac13a280 legacy=0x7f7bac13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.537+0000 7f7bb0d73640 1 -- 172.21.15.121:0/1736569388 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac0a3f80 con 0x7f7bac0a4c20 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.538+0000 7f7bb0d73640 1 --2- 172.21.15.121:0/1736569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac13f060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097f0 tx=0x7f7b9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc5bbae8034f84b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.538+0000 7f7ba3fff640 1 -- 172.21.15.121:0/1736569388 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c037070 con 0x7f7bac0a4c20 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.538+0000 7f7ba3fff640 1 -- 172.21.15.121:0/1736569388 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9c032440 con 0x7f7bac0a4c20 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.538+0000 7f7ba3fff640 1 -- 172.21.15.121:0/1736569388 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b9c02ae60 con 0x7f7bac0a4c20 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 -- 172.21.15.121:0/1736569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 msgr2=0x7f7bac13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/1736569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac13f060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0097f0 tx=0x7f7b9c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 -- 172.21.15.121:0/1736569388 shutdown_connections 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/1736569388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac13f060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 -- 172.21.15.121:0/1736569388 >> 172.21.15.121:0/1736569388 conn(0x7f7bac0ac3e0 msgr2=0x7f7bac0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 -- 172.21.15.121:0/1736569388 shutdown_connections 2024-09-15T23:55:38.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.539+0000 7f7bb37d8640 1 -- 172.21.15.121:0/1736569388 wait complete. 2024-09-15T23:55:38.543 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb37d8640 1 Processor -- start 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb37d8640 1 -- start start 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb37d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb37d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0a7ec0 con 0x7f7bac0a4c20 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb1574640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb1574640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36414/0 (socket says 172.21.15.121:36414) 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb1574640 1 -- 172.21.15.121:0/2958627847 learned_addr learned my addr 172.21.15.121:0/2958627847 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.540+0000 7f7bb1574640 1 -- 172.21.15.121:0/2958627847 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac125070 con 0x7f7bac0a4c20 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7bb1574640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c450 tx=0x7f7ba800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8007410 con 0x7f7bac0a4c20 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba80075b0 con 0x7f7bac0a4c20 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac124780 con 0x7f7bac0a4c20 2024-09-15T23:55:38.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8004910 con 0x7f7bac0a4c20 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.541+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac124470 con 0x7f7bac0a4c20 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7ba801a020 con 0x7f7bac0a4c20 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7ba1ffb640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 0x7f7b9003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7f7ba804a6d0 con 0x7f7bac0a4c20 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac122c20 con 0x7f7bac0a4c20 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7bb0d73640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 0x7f7b9003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.545 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.542+0000 7f7bb0d73640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 0x7f7b9003a760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c034000 tx=0x7f7b9c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.546+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ba801b9c0 con 0x7f7bac0a4c20 2024-09-15T23:55:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.775+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f7bac124950 con 0x7f7bac0a4c20 2024-09-15T23:55:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.779+0000 7f7ba1ffb640 1 -- 172.21.15.121:0/2958627847 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f7ba801bc20 con 0x7f7bac0a4c20 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 msgr2=0x7f7b9003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 0x7f7b9003a760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c034000 tx=0x7f7b9c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 msgr2=0x7f7bac0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c450 tx=0x7f7ba800c910 comp rx=0 tx=0).stop 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 shutdown_connections 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7b900382a0 0x7f7b9003a760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 --2- 172.21.15.121:0/2958627847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bac0a4c20 0x7f7bac0a0ff0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 >> 172.21.15.121:0/2958627847 conn(0x7f7bac0ac3e0 msgr2=0x7f7bac0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 shutdown_connections 2024-09-15T23:55:38.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.781+0000 7f7bb37d8640 1 -- 172.21.15.121:0/2958627847 wait complete. 2024-09-15T23:55:38.793 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T23:55:38.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.890+0000 7fb420bcf640 1 Processor -- start 2024-09-15T23:55:38.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.890+0000 7fb420bcf640 1 -- start start 2024-09-15T23:55:38.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb420bcf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb41c13a280 0x7fb41c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb420bcf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41c13a080 con 0x7fb41c0a4c20 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb420bcf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb41c0a3d50 con 0x7fb41c13a280 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb41a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb41c13a280 0x7fb41c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb41a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb41c13a280 0x7fb41c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36430/0 (socket says 172.21.15.121:36430) 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb419d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb41c0a4c20 0x7fb41c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45542/0 (socket says 172.21.15.121:45542) 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb41a59c640 1 -- 172.21.15.121:0/729491663 learned_addr learned my addr 172.21.15.121:0/729491663 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb41a59c640 1 -- 172.21.15.121:0/729491663 >> v1:172.21.15.121:6789/0 conn(0x7fb41c0a4c20 legacy=0x7fb41c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.891+0000 7fb41a59c640 1 -- 172.21.15.121:0/729491663 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c0a3f80 con 0x7fb41c13a280 2024-09-15T23:55:38.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.892+0000 7fb41a59c640 1 --2- 172.21.15.121:0/729491663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c13a280 0x7fb41c13a660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e4903407dfa996 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.892+0000 7fb41959a640 1 -- 172.21.15.121:0/729491663 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40c036070 con 0x7fb41c13a280 2024-09-15T23:55:38.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.892+0000 7fb41959a640 1 -- 172.21.15.121:0/729491663 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c031400 con 0x7fb41c13a280 2024-09-15T23:55:38.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.892+0000 7fb41959a640 1 -- 172.21.15.121:0/729491663 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40c0315d0 con 0x7fb41c13a280 2024-09-15T23:55:38.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 -- 172.21.15.121:0/729491663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c13a280 msgr2=0x7fb41c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 --2- 172.21.15.121:0/729491663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c13a280 0x7fb41c13a660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c02a730 comp rx=0 tx=0).stop 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 -- 172.21.15.121:0/729491663 shutdown_connections 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 --2- 172.21.15.121:0/729491663 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c13a280 0x7fb41c13a660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 -- 172.21.15.121:0/729491663 >> 172.21.15.121:0/729491663 conn(0x7fb41c0ac3e0 msgr2=0x7fb41c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 -- 172.21.15.121:0/729491663 shutdown_connections 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.893+0000 7fb420bcf640 1 -- 172.21.15.121:0/729491663 wait complete. 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb420bcf640 1 Processor -- start 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb420bcf640 1 -- start start 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb420bcf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb420bcf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c139d40 con 0x7fb41c0a4c20 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb41a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb41a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36440/0 (socket says 172.21.15.121:36440) 2024-09-15T23:55:38.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.894+0000 7fb41a59c640 1 -- 172.21.15.121:0/1033435894 learned_addr learned my addr 172.21.15.121:0/1033435894 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb41a59c640 1 -- 172.21.15.121:0/1033435894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c124ff0 con 0x7fb41c0a4c20 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb41a59c640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40c036050 con 0x7fb41c0a4c20 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c042070 con 0x7fb41c0a4c20 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb40c03b780 con 0x7fb41c0a4c20 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c125270 con 0x7fb41c0a4c20 2024-09-15T23:55:38.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.895+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c138290 con 0x7fb41c0a4c20 2024-09-15T23:55:38.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.896+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb40c03b920 con 0x7fb41c0a4c20 2024-09-15T23:55:38.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.896+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c06dab0 con 0x7fb41c0a4c20 2024-09-15T23:55:38.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.896+0000 7fb412ffd640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:38.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.896+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7fb40c06be20 con 0x7fb41c0a4c20 2024-09-15T23:55:38.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.896+0000 7fb419d9b640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:38.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.897+0000 7fb419d9b640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 0x7fb3fc03a760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:38.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:38.901+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb41c124ff0 con 0x7fb41c0a4c20 2024-09-15T23:55:39.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.129+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fb41c0a2f50 con 0x7fb41c0a4c20 2024-09-15T23:55:39.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.133+0000 7fb412ffd640 1 -- 172.21.15.121:0/1033435894 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fb40c047980 con 0x7fb41c0a4c20 2024-09-15T23:55:39.136 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 msgr2=0x7fb3fc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 0x7fb3fc03a760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb404001550 tx=0x7fb404007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 msgr2=0x7fb41c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb40c009e50 tx=0x7fb40c004a40 comp rx=0 tx=0).stop 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 shutdown_connections 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb3fc0382a0 0x7fb3fc03a760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 --2- 172.21.15.121:0/1033435894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb41c0a4c20 0x7fb41c0a1150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 >> 172.21.15.121:0/1033435894 conn(0x7fb41c0ac3e0 msgr2=0x7fb41c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 shutdown_connections 2024-09-15T23:55:39.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.134+0000 7fb420bcf640 1 -- 172.21.15.121:0/1033435894 wait complete. 2024-09-15T23:55:39.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.244+0000 7ff57e3b7640 1 Processor -- start 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.244+0000 7ff57e3b7640 1 -- start start 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.244+0000 7ff57e3b7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff57809ee30 0x7ff57813ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.244+0000 7ff57e3b7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5780a2280 con 0x7ff5780a39c0 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.244+0000 7ff57e3b7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff57809e6e0 con 0x7ff57809ee30 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff5777fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff57809ee30 0x7ff57813ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff577fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff5780a39c0 0x7ff5780a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45554/0 (socket says 172.21.15.121:45554) 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff577fff640 1 -- 172.21.15.121:0/2600563061 learned_addr learned my addr 172.21.15.121:0/2600563061 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:39.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff5777fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff57809ee30 0x7ff57813ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36456/0 (socket says 172.21.15.121:36456) 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff5777fe640 1 -- 172.21.15.121:0/2600563061 >> v1:172.21.15.121:6789/0 conn(0x7ff5780a39c0 legacy=0x7ff5780a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff5777fe640 1 -- 172.21.15.121:0/2600563061 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57809e3d0 con 0x7ff57809ee30 2024-09-15T23:55:39.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff576ffd640 1 -- 172.21.15.121:0/2600563061 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828236235 0 0) 0x7ff5780a2280 con 0x7ff5780a39c0 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.245+0000 7ff5777fe640 1 --2- 172.21.15.121:0/2600563061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57813ced0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009720 tx=0x7ff56c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd35f6bbcede559e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff576ffd640 1 -- 172.21.15.121:0/2600563061 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c037070 con 0x7ff57809ee30 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff576ffd640 1 -- 172.21.15.121:0/2600563061 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c02ad90 con 0x7ff57809ee30 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff576ffd640 1 -- 172.21.15.121:0/2600563061 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c032590 con 0x7ff57809ee30 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 -- 172.21.15.121:0/2600563061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 msgr2=0x7ff57813ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.250 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/2600563061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57813ced0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009720 tx=0x7ff56c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 -- 172.21.15.121:0/2600563061 shutdown_connections 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/2600563061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57813ced0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 -- 172.21.15.121:0/2600563061 >> 172.21.15.121:0/2600563061 conn(0x7ff5780a85e0 msgr2=0x7ff5780a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 -- 172.21.15.121:0/2600563061 shutdown_connections 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.246+0000 7ff57e3b7640 1 -- 172.21.15.121:0/2600563061 wait complete. 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.247+0000 7ff57e3b7640 1 Processor -- start 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.247+0000 7ff57e3b7640 1 -- start start 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff57e3b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff57e3b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5780a1ed0 con 0x7ff57809ee30 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff577fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff577fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36466/0 (socket says 172.21.15.121:36466) 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff577fff640 1 -- 172.21.15.121:0/84511274 learned_addr learned my addr 172.21.15.121:0/84511274 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:39.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff577fff640 1 -- 172.21.15.121:0/84511274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5780716f0 con 0x7ff57809ee30 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff577fff640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c420 tx=0x7ff56800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff568018070 con 0x7ff57809ee30 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5680074d0 con 0x7ff57809ee30 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff568004950 con 0x7ff57809ee30 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57806fa40 con 0x7ff57809ee30 2024-09-15T23:55:39.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.248+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57806f770 con 0x7ff57809ee30 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.249+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff56801b070 con 0x7ff57809ee30 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.249+0000 7ff574ff9640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 0x7ff56403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.249+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7ff56804a240 con 0x7ff57809ee30 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.249+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5780008d0 con 0x7ff57809ee30 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.249+0000 7ff5777fe640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 0x7ff56403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.250+0000 7ff5777fe640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 0x7ff56403a760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff56c034000 tx=0x7ff56c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.254+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff56801ca00 con 0x7ff57809ee30 2024-09-15T23:55:39.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.481+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff578071410 con 0x7ff57809ee30 2024-09-15T23:55:39.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.486+0000 7ff574ff9640 1 -- 172.21.15.121:0/84511274 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff56801cc60 con 0x7ff57809ee30 2024-09-15T23:55:39.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.487+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 msgr2=0x7ff56403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 0x7ff56403a760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff56c034000 tx=0x7ff56c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 msgr2=0x7ff57811e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c420 tx=0x7ff56800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 shutdown_connections 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7ff5640382a0 0x7ff56403a760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 --2- 172.21.15.121:0/84511274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff57809ee30 0x7ff57811e870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 >> 172.21.15.121:0/84511274 conn(0x7ff5780a85e0 msgr2=0x7ff5780a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 shutdown_connections 2024-09-15T23:55:39.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.488+0000 7ff57e3b7640 1 -- 172.21.15.121:0/84511274 wait complete. 2024-09-15T23:55:39.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.597+0000 7fba629b9640 1 Processor -- start 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.597+0000 7fba629b9640 1 -- start start 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.597+0000 7fba629b9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fba5c135b50 0x7fba5c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba629b9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c09b020 con 0x7fba5c135f30 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba629b9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c09b310 con 0x7fba5c135b50 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fba5c135b50 0x7fba5c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fba5c135b50 0x7fba5c09aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36472/0 (socket says 172.21.15.121:36472) 2024-09-15T23:55:39.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5b7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fba5c135f30 0x7fba5c0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45562/0 (socket says 172.21.15.121:45562) 2024-09-15T23:55:39.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5bfff640 1 -- 172.21.15.121:0/1243967263 learned_addr learned my addr 172.21.15.121:0/1243967263 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:39.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5bfff640 1 -- 172.21.15.121:0/1243967263 >> v1:172.21.15.121:6789/0 conn(0x7fba5c135f30 legacy=0x7fba5c0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5affd640 1 -- 172.21.15.121:0/1243967263 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666670636 0 0) 0x7fba5c09b020 con 0x7fba5c135f30 2024-09-15T23:55:39.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.598+0000 7fba5bfff640 1 -- 172.21.15.121:0/1243967263 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0a08c0 con 0x7fba5c135b50 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba5bfff640 1 --2- 172.21.15.121:0/1243967263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c09aae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097f0 tx=0x7fba4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfd3b5ec0973410 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba5affd640 1 -- 172.21.15.121:0/1243967263 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c037070 con 0x7fba5c135b50 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba5affd640 1 -- 172.21.15.121:0/1243967263 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c032440 con 0x7fba5c135b50 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba5affd640 1 -- 172.21.15.121:0/1243967263 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c032740 con 0x7fba5c135b50 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 -- 172.21.15.121:0/1243967263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 msgr2=0x7fba5c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 --2- 172.21.15.121:0/1243967263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c09aae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097f0 tx=0x7fba4c02a270 comp rx=0 tx=0).stop 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 -- 172.21.15.121:0/1243967263 shutdown_connections 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 --2- 172.21.15.121:0/1243967263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c09aae0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 -- 172.21.15.121:0/1243967263 >> 172.21.15.121:0/1243967263 conn(0x7fba5c0a85e0 msgr2=0x7fba5c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 -- 172.21.15.121:0/1243967263 shutdown_connections 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.599+0000 7fba629b9640 1 -- 172.21.15.121:0/1243967263 wait complete. 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.600+0000 7fba629b9640 1 Processor -- start 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.600+0000 7fba629b9640 1 -- start start 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba629b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba629b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0a5430 con 0x7fba5c135b50 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba5bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36476/0 (socket says 172.21.15.121:36476) 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba5bfff640 1 -- 172.21.15.121:0/6733260 learned_addr learned my addr 172.21.15.121:0/6733260 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba5bfff640 1 -- 172.21.15.121:0/6733260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c071970 con 0x7fba5c135b50 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba5bfff640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba4c02a2b0 tx=0x7fba4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c037040 con 0x7fba5c135b50 2024-09-15T23:55:39.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c004160 con 0x7fba5c135b50 2024-09-15T23:55:39.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.601+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba4c004440 con 0x7fba5c135b50 2024-09-15T23:55:39.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.602+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c072360 con 0x7fba5c135b50 2024-09-15T23:55:39.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.602+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c071e60 con 0x7fba5c135b50 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.602+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba4c03a070 con 0x7fba5c135b50 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.602+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c136350 con 0x7fba5c135b50 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.603+0000 7fba58ff9640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 0x7fba4803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.603+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7fba4c06b7c0 con 0x7fba5c135b50 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.603+0000 7fba5b7fe640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 0x7fba4803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.603+0000 7fba5b7fe640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 0x7fba4803a760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba50000c00 tx=0x7fba50007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.607+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba4c041020 con 0x7fba5c135b50 2024-09-15T23:55:39.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.835+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fba5c0a1f10 con 0x7fba5c135b50 2024-09-15T23:55:39.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.840+0000 7fba58ff9640 1 -- 172.21.15.121:0/6733260 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fba4c03b580 con 0x7fba5c135b50 2024-09-15T23:55:39.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 msgr2=0x7fba4803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 0x7fba4803a760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba50000c00 tx=0x7fba50007910 comp rx=0 tx=0).stop 2024-09-15T23:55:39.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 msgr2=0x7fba5c1ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba4c02a2b0 tx=0x7fba4c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 shutdown_connections 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fba480382a0 0x7fba4803a760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 --2- 172.21.15.121:0/6733260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba5c135b50 0x7fba5c1ce5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 >> 172.21.15.121:0/6733260 conn(0x7fba5c0a85e0 msgr2=0x7fba5c0a5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 shutdown_connections 2024-09-15T23:55:39.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.841+0000 7fba629b9640 1 -- 172.21.15.121:0/6733260 wait complete. 2024-09-15T23:55:39.854 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab53133640 1 Processor -- start 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab53133640 1 -- start start 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab53133640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fab4c135b50 0x7fab4c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab53133640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c09b020 con 0x7fab4c135f30 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab53133640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fab4c09b310 con 0x7fab4c135b50 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.951+0000 7fab50ecf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fab4c135b50 0x7fab4c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab50ecf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fab4c135b50 0x7fab4c09aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36492/0 (socket says 172.21.15.121:36492) 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab43fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fab4c135f30 0x7fab4c0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45564/0 (socket says 172.21.15.121:45564) 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab50ecf640 1 -- 172.21.15.121:0/2351212728 learned_addr learned my addr 172.21.15.121:0/2351212728 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab50ecf640 1 -- 172.21.15.121:0/2351212728 >> v1:172.21.15.121:6789/0 conn(0x7fab4c135f30 legacy=0x7fab4c0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab50ecf640 1 -- 172.21.15.121:0/2351212728 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c0a08c0 con 0x7fab4c135b50 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.952+0000 7fab50ecf640 1 --2- 172.21.15.121:0/2351212728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c09aae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab4800ba90 tx=0x7fab4802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d23b6f6133c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab437fe640 1 -- 172.21.15.121:0/2351212728 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab48036020 con 0x7fab4c135b50 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab437fe640 1 -- 172.21.15.121:0/2351212728 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab48032770 con 0x7fab4c135b50 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab437fe640 1 -- 172.21.15.121:0/2351212728 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab48032a70 con 0x7fab4c135b50 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 -- 172.21.15.121:0/2351212728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 msgr2=0x7fab4c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 --2- 172.21.15.121:0/2351212728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c09aae0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fab4800ba90 tx=0x7fab4802c940 comp rx=0 tx=0).stop 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 -- 172.21.15.121:0/2351212728 shutdown_connections 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 --2- 172.21.15.121:0/2351212728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c09aae0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 -- 172.21.15.121:0/2351212728 >> 172.21.15.121:0/2351212728 conn(0x7fab4c0a85e0 msgr2=0x7fab4c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:39.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 -- 172.21.15.121:0/2351212728 shutdown_connections 2024-09-15T23:55:39.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.953+0000 7fab53133640 1 -- 172.21.15.121:0/2351212728 wait complete. 2024-09-15T23:55:39.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.954+0000 7fab53133640 1 Processor -- start 2024-09-15T23:55:39.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.954+0000 7fab53133640 1 -- start start 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab53133640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab53133640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0a5430 con 0x7fab4c135b50 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab50ecf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab50ecf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36502/0 (socket says 172.21.15.121:36502) 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab50ecf640 1 -- 172.21.15.121:0/716077995 learned_addr learned my addr 172.21.15.121:0/716077995 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab50ecf640 1 -- 172.21.15.121:0/716077995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c121550 con 0x7fab4c135b50 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab50ecf640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab4800b2c0 tx=0x7fab480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab48036040 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4803ccc0 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c11f980 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab480463f0 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.955+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c121ca0 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.956+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab4804d060 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.956+0000 7fab417fa640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 0x7fab3803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.956+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7fab4802f070 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.956+0000 7fab43fff640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 0x7fab3803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.956+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c136350 con 0x7fab4c135b50 2024-09-15T23:55:39.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.957+0000 7fab43fff640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 0x7fab3803a760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0015f0 tx=0x7fab3c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:39.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:39.962+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab48041070 con 0x7fab4c135b50 2024-09-15T23:55:40.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.191+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fab4c0a1f10 con 0x7fab4c135b50 2024-09-15T23:55:40.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.196+0000 7fab417fa640 1 -- 172.21.15.121:0/716077995 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fab4803a3b0 con 0x7fab4c135b50 2024-09-15T23:55:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 msgr2=0x7fab3803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 0x7fab3803a760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab3c0015f0 tx=0x7fab3c007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 msgr2=0x7fab4c11e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fab4800b2c0 tx=0x7fab480046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 shutdown_connections 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fab380382a0 0x7fab3803a760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 --2- 172.21.15.121:0/716077995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab4c135b50 0x7fab4c11e600 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 >> 172.21.15.121:0/716077995 conn(0x7fab4c0a85e0 msgr2=0x7fab4c0a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 shutdown_connections 2024-09-15T23:55:40.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.197+0000 7fab53133640 1 -- 172.21.15.121:0/716077995 wait complete. 2024-09-15T23:55:40.210 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:55:40.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.306+0000 7fee2b83c640 1 Processor -- start 2024-09-15T23:55:40.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.306+0000 7fee2b83c640 1 -- start start 2024-09-15T23:55:40.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee2b83c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee24135f30 0x7fee2413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee2b83c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee240a08c0 con 0x7fee24135b50 2024-09-15T23:55:40.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee2b83c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fee2409b310 con 0x7fee24135f30 2024-09-15T23:55:40.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee28dd7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee24135f30 0x7fee2413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee28dd7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee24135f30 0x7fee2413bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36510/0 (socket says 172.21.15.121:36510) 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee28dd7640 1 -- 172.21.15.121:0/1158064167 learned_addr learned my addr 172.21.15.121:0/1158064167 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee295d8640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fee24135b50 0x7fee2409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45566/0 (socket says 172.21.15.121:45566) 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee28dd7640 1 -- 172.21.15.121:0/1158064167 >> v1:172.21.15.121:6789/0 conn(0x7fee24135b50 legacy=0x7fee2409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee1bfff640 1 -- 172.21.15.121:0/1158064167 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673537854 0 0) 0x7fee240a08c0 con 0x7fee24135b50 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.307+0000 7fee28dd7640 1 -- 172.21.15.121:0/1158064167 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240a2270 con 0x7fee24135f30 2024-09-15T23:55:40.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee28dd7640 1 --2- 172.21.15.121:0/1158064167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135f30 0x7fee2413bb80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee140097f0 tx=0x7fee1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd3b527b4e8a578 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee1bfff640 1 -- 172.21.15.121:0/1158064167 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14037070 con 0x7fee24135f30 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee1bfff640 1 -- 172.21.15.121:0/1158064167 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14032440 con 0x7fee24135f30 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee1bfff640 1 -- 172.21.15.121:0/1158064167 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14032740 con 0x7fee24135f30 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee2b83c640 1 -- 172.21.15.121:0/1158064167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135f30 msgr2=0x7fee2413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee2b83c640 1 --2- 172.21.15.121:0/1158064167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135f30 0x7fee2413bb80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee140097f0 tx=0x7fee1402a270 comp rx=0 tx=0).stop 2024-09-15T23:55:40.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee2b83c640 1 -- 172.21.15.121:0/1158064167 shutdown_connections 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee2b83c640 1 --2- 172.21.15.121:0/1158064167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135f30 0x7fee2413bb80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.308+0000 7fee2b83c640 1 -- 172.21.15.121:0/1158064167 >> 172.21.15.121:0/1158064167 conn(0x7fee240a85e0 msgr2=0x7fee240a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.309+0000 7fee2b83c640 1 -- 172.21.15.121:0/1158064167 shutdown_connections 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.309+0000 7fee2b83c640 1 -- 172.21.15.121:0/1158064167 wait complete. 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.309+0000 7fee2b83c640 1 Processor -- start 2024-09-15T23:55:40.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.309+0000 7fee2b83c640 1 -- start start 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee2b83c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee2b83c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee24136350 con 0x7fee24135b50 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee295d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee295d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36518/0 (socket says 172.21.15.121:36518) 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee295d8640 1 -- 172.21.15.121:0/2444213006 learned_addr learned my addr 172.21.15.121:0/2444213006 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee295d8640 1 -- 172.21.15.121:0/2444213006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee240a0290 con 0x7fee24135b50 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee295d8640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c840 tx=0x7fee1c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1c018070 con 0x7fee24135b50 2024-09-15T23:55:40.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c00a660 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.310+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee241238c0 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.311+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee1c00a980 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.311+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee241222a0 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fee1c01b070 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2409aae0 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee19ffb640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 0x7fee0803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7fee1c04a5a0 con 0x7fee24135b50 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee28dd7640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 0x7fee0803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.312+0000 7fee28dd7640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 0x7fee0803a760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.317+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee1c011360 con 0x7fee24135b50 2024-09-15T23:55:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.484+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fee241244b0 con 0x7fee24135b50 2024-09-15T23:55:40.486 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.484+0000 7fee19ffb640 1 -- 172.21.15.121:0/2444213006 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v23) ==== 84+0+65 (secure 0 0 0) 0x7fee1c00adb0 con 0x7fee24135b50 2024-09-15T23:55:40.486 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:40.487 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 msgr2=0x7fee0803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 0x7fee0803a760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 msgr2=0x7fee24120c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c840 tx=0x7fee1c00cd00 comp rx=0 tx=0).stop 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 shutdown_connections 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fee080382a0 0x7fee0803a760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 --2- 172.21.15.121:0/2444213006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee24135b50 0x7fee24120c40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 >> 172.21.15.121:0/2444213006 conn(0x7fee240a85e0 msgr2=0x7fee2409d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:40.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 shutdown_connections 2024-09-15T23:55:40.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.486+0000 7fee2b83c640 1 -- 172.21.15.121:0/2444213006 wait complete. 2024-09-15T23:55:40.498 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:55:40.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:55:40.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.598+0000 7f51c80a4640 1 Processor -- start 2024-09-15T23:55:40.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.598+0000 7f51c80a4640 1 -- start start 2024-09-15T23:55:40.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c80a4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51c00a7140 0x7f51c00a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c80a4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c00a6d10 con 0x7f51c00a4ab0 2024-09-15T23:55:40.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c80a4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f51c006e230 con 0x7f51c00a7140 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c5e40640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51c00a7140 0x7f51c00a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c5e40640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f51c00a7140 0x7f51c00a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36522/0 (socket says 172.21.15.121:36522) 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c5e40640 1 -- 172.21.15.121:0/2376389894 learned_addr learned my addr 172.21.15.121:0/2376389894 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c563f640 1 --1- 172.21.15.121:0/2376389894 >> v1:172.21.15.121:6789/0 conn(0x7f51c00a4ab0 0x7f51c0139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45580/0 (socket says 172.21.15.121:45580) 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c5e40640 1 -- 172.21.15.121:0/2376389894 >> v1:172.21.15.121:6789/0 conn(0x7f51c00a4ab0 legacy=0x7f51c0139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c5e40640 1 -- 172.21.15.121:0/2376389894 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c00a3ae0 con 0x7f51c00a7140 2024-09-15T23:55:40.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.599+0000 7f51c4e3e640 1 -- 172.21.15.121:0/2376389894 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564520055 0 0) 0x7f51c00a6d10 con 0x7f51c00a4ab0 2024-09-15T23:55:40.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.600+0000 7f51c5e40640 1 --2- 172.21.15.121:0/2376389894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a7140 0x7f51c00a7520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0097f0 tx=0x7f51bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54645573bcf4d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.600+0000 7f51c4e3e640 1 -- 172.21.15.121:0/2376389894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51bc037070 con 0x7f51c00a7140 2024-09-15T23:55:40.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.600+0000 7f51c4e3e640 1 -- 172.21.15.121:0/2376389894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc032440 con 0x7f51c00a7140 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.600+0000 7f51c4e3e640 1 -- 172.21.15.121:0/2376389894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51bc02ae60 con 0x7f51c00a7140 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 -- 172.21.15.121:0/2376389894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a7140 msgr2=0x7f51c00a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 --2- 172.21.15.121:0/2376389894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a7140 0x7f51c00a7520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0097f0 tx=0x7f51bc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 -- 172.21.15.121:0/2376389894 shutdown_connections 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 --2- 172.21.15.121:0/2376389894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a7140 0x7f51c00a7520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 -- 172.21.15.121:0/2376389894 >> 172.21.15.121:0/2376389894 conn(0x7f51c00ac370 msgr2=0x7f51c00ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 -- 172.21.15.121:0/2376389894 shutdown_connections 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.601+0000 7f51c80a4640 1 -- 172.21.15.121:0/2376389894 wait complete. 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c80a4640 1 Processor -- start 2024-09-15T23:55:40.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c80a4640 1 -- start start 2024-09-15T23:55:40.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c80a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c80a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00a7fc0 con 0x7f51c00a4ab0 2024-09-15T23:55:40.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c5e40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c5e40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36524/0 (socket says 172.21.15.121:36524) 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c5e40640 1 -- 172.21.15.121:0/3832977752 learned_addr learned my addr 172.21.15.121:0/3832977752 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.602+0000 7f51c5e40640 1 -- 172.21.15.121:0/3832977752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c00a29b0 con 0x7f51c00a4ab0 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51c5e40640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f51bc035040 tx=0x7f51bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51bc041020 con 0x7f51c00a4ab0 2024-09-15T23:55:40.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc0307f0 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c00a01f0 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51bc037040 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.603+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c00a04b0 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f51bc044020 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c00a1180 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51b67fc640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 0x7f51a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 2587+0+0 (secure 0 0 0) 0x7f51bc06b870 con 0x7f51c00a4ab0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51c563f640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 0x7f51a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:40.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.604+0000 7f51c563f640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 0x7f51a403a760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51b00011e0 tx=0x7f51b0007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:40.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.608+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51bc04b030 con 0x7f51c00a4ab0 2024-09-15T23:55:40.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:40.774+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f51c00732e0 con 0x7f51c00a4ab0 2024-09-15T23:55:41.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.200+0000 7f51b67fc640 1 -- 172.21.15.121:0/3832977752 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v24) ==== 138+0+0 (secure 0 0 0) 0x7f51bc031e80 con 0x7f51c00a4ab0 2024-09-15T23:55:41.202 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-15T23:55:41.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 msgr2=0x7f51a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 0x7f51a403a760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51b00011e0 tx=0x7f51b0007930 comp rx=0 tx=0).stop 2024-09-15T23:55:41.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 msgr2=0x7f51c00a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f51bc035040 tx=0x7f51bc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 shutdown_connections 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f51a40382a0 0x7f51a403a760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 --2- 172.21.15.121:0/3832977752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c00a4ab0 0x7f51c00a0c40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 >> 172.21.15.121:0/3832977752 conn(0x7f51c00ac370 msgr2=0x7f51c01371a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 shutdown_connections 2024-09-15T23:55:41.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.203+0000 7f51c80a4640 1 -- 172.21.15.121:0/3832977752 wait complete. 2024-09-15T23:55:41.219 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:55:41.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.323+0000 7fe3d8b28640 1 Processor -- start 2024-09-15T23:55:41.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.323+0000 7fe3d8b28640 1 -- start start 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d8b28640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3d40a4ab0 0x7fe3d413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d8b28640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d40a6d10 con 0x7fe3d40a7140 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d8b28640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d406e230 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d1d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3d40a4ab0 0x7fe3d413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d1d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3d40a4ab0 0x7fe3d413eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36540/0 (socket says 172.21.15.121:36540) 2024-09-15T23:55:41.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d1d9b640 1 -- 172.21.15.121:0/1658851790 learned_addr learned my addr 172.21.15.121:0/1658851790 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:41.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe3d40a7140 0x7fe3d40a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45588/0 (socket says 172.21.15.121:45588) 2024-09-15T23:55:41.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d1d9b640 1 -- 172.21.15.121:0/1658851790 >> v1:172.21.15.121:6789/0 conn(0x7fe3d40a7140 legacy=0x7fe3d40a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.324+0000 7fe3d1d9b640 1 -- 172.21.15.121:0/1658851790 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d40a3ae0 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.325+0000 7fe3d1d9b640 1 --2- 172.21.15.121:0/1658851790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d413eef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80097f0 tx=0x7fe3c802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dfa80707a5e1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.325+0000 7fe3d159a640 1 -- 172.21.15.121:0/1658851790 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8037070 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.325+0000 7fe3d159a640 1 -- 172.21.15.121:0/1658851790 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8032440 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.325+0000 7fe3d159a640 1 -- 172.21.15.121:0/1658851790 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c8032740 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 -- 172.21.15.121:0/1658851790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 msgr2=0x7fe3d413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/1658851790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d413eef0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80097f0 tx=0x7fe3c802a200 comp rx=0 tx=0).stop 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 -- 172.21.15.121:0/1658851790 shutdown_connections 2024-09-15T23:55:41.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/1658851790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d413eef0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:41.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 -- 172.21.15.121:0/1658851790 >> 172.21.15.121:0/1658851790 conn(0x7fe3d40ac370 msgr2=0x7fe3d40ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:41.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 -- 172.21.15.121:0/1658851790 shutdown_connections 2024-09-15T23:55:41.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.326+0000 7fe3d8b28640 1 -- 172.21.15.121:0/1658851790 wait complete. 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d8b28640 1 Processor -- start 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d8b28640 1 -- start start 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d8b28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d8b28640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d40a7fc0 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36544/0 (socket says 172.21.15.121:36544) 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.327+0000 7fe3d259c640 1 -- 172.21.15.121:0/3748533541 learned_addr learned my addr 172.21.15.121:0/3748533541 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3d259c640 1 -- 172.21.15.121:0/3748533541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d4125000 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3d259c640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c450 tx=0x7fe3c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c4007410 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c40075b0 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d4124710 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3c4004910 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.328+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d4123490 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe3c401a020 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3c2ffd640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 0x7fe3b403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 2957+0+0 (secure 0 0 0) 0x7fe3c404a840 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d4122bb0 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3d1d9b640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 0x7fe3b403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:41.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.329+0000 7fe3d1d9b640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 0x7fe3b403a760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:41.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.334+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3c401b9c0 con 0x7fe3d40a4ab0 2024-09-15T23:55:41.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:41.498+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe3d40732e0 con 0x7fe3d40a4ab0 2024-09-15T23:55:42.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.203+0000 7fe3c2ffd640 1 -- 172.21.15.121:0/3748533541 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v25) ==== 170+0+0 (secure 0 0 0) 0x7fe3c401bc20 con 0x7fe3d40a4ab0 2024-09-15T23:55:42.204 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-15T23:55:42.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.208+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 msgr2=0x7fe3b403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.210 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.208+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 0x7fe3b403a760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8034000 tx=0x7fe3c802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:42.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.209+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 msgr2=0x7fe3d40a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.209+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c450 tx=0x7fe3c400c910 comp rx=0 tx=0).stop 2024-09-15T23:55:42.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.213+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 shutdown_connections 2024-09-15T23:55:42.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.213+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe3b40382a0 0x7fe3b403a760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.213+0000 7fe3d8b28640 1 --2- 172.21.15.121:0/3748533541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3d40a4ab0 0x7fe3d40a1040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.213+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 >> 172.21.15.121:0/3748533541 conn(0x7fe3d40ac370 msgr2=0x7fe3d40aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:42.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.215+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 shutdown_connections 2024-09-15T23:55:42.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.215+0000 7fe3d8b28640 1 -- 172.21.15.121:0/3748533541 wait complete. 2024-09-15T23:55:42.237 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:55:42.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.340+0000 7f3390da1640 1 Processor -- start 2024-09-15T23:55:42.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.340+0000 7f3390da1640 1 -- start start 2024-09-15T23:55:42.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f3390da1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f338c0a37b0 0x7f338c09acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:42.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f3390da1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338c09b200 con 0x7f338c0a3b90 2024-09-15T23:55:42.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f3390da1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f338c09b4f0 con 0x7f338c0a37b0 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f338a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f338c0a37b0 0x7f338c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f3389d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f338c0a3b90 0x7f338c0a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35482/0 (socket says 172.21.15.121:35482) 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f338a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f338c0a37b0 0x7f338c09acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36376/0 (socket says 172.21.15.121:36376) 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f3389d9b640 1 -- 172.21.15.121:0/3072527334 learned_addr learned my addr 172.21.15.121:0/3072527334 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f338a59c640 1 -- 172.21.15.121:0/3072527334 >> v1:172.21.15.121:6789/0 conn(0x7f338c0a3b90 legacy=0x7f338c0a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f338a59c640 1 -- 172.21.15.121:0/3072527334 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c0a1c90 con 0x7f338c0a37b0 2024-09-15T23:55:42.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.341+0000 7f338959a640 1 -- 172.21.15.121:0/3072527334 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 785241110 0 0) 0x7f338c09b200 con 0x7f338c0a3b90 2024-09-15T23:55:42.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.342+0000 7f338a59c640 1 --2- 172.21.15.121:0/3072527334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c09acc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f337c009720 tx=0x7f337c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d376d430f1dc93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:42.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.342+0000 7f338959a640 1 -- 172.21.15.121:0/3072527334 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c037070 con 0x7f338c0a37b0 2024-09-15T23:55:42.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.342+0000 7f338959a640 1 -- 172.21.15.121:0/3072527334 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c02ad90 con 0x7f338c0a37b0 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.342+0000 7f338959a640 1 -- 172.21.15.121:0/3072527334 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c032590 con 0x7f338c0a37b0 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 -- 172.21.15.121:0/3072527334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 msgr2=0x7f338c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 --2- 172.21.15.121:0/3072527334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c09acc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f337c009720 tx=0x7f337c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 -- 172.21.15.121:0/3072527334 shutdown_connections 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 --2- 172.21.15.121:0/3072527334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c09acc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 -- 172.21.15.121:0/3072527334 >> 172.21.15.121:0/3072527334 conn(0x7f338c0a8430 msgr2=0x7f338c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 -- 172.21.15.121:0/3072527334 shutdown_connections 2024-09-15T23:55:42.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.343+0000 7f3390da1640 1 -- 172.21.15.121:0/3072527334 wait complete. 2024-09-15T23:55:42.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.344+0000 7f3390da1640 1 Processor -- start 2024-09-15T23:55:42.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.344+0000 7f3390da1640 1 -- start start 2024-09-15T23:55:42.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f3390da1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f3390da1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f338c0a5220 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f338a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f338a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36380/0 (socket says 172.21.15.121:36380) 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f338a59c640 1 -- 172.21.15.121:0/1325102202 learned_addr learned my addr 172.21.15.121:0/1325102202 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f338a59c640 1 -- 172.21.15.121:0/1325102202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338c072330 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f338a59c640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f337c035040 tx=0x7f337c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c037040 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c004030 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338c071be0 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f337c004310 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.345+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338c0718d0 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.346+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f337c03a040 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.346+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f338c09acc0 con 0x7f338c0a37b0 2024-09-15T23:55:42.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.346+0000 7f337affd640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 0x7f336c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:42.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.346+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3339+0+0 (secure 0 0 0) 0x7f337c06bb90 con 0x7f338c0a37b0 2024-09-15T23:55:42.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.346+0000 7f3389d9b640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 0x7f336c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:42.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.347+0000 7f3389d9b640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 0x7f336c03a760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3380000c00 tx=0x7f3380007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:42.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.351+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f338c072330 con 0x7f338c0a37b0 2024-09-15T23:55:42.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:42.552+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f338c0a1f00 con 0x7f338c0a37b0 2024-09-15T23:55:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.203+0000 7f337affd640 1 -- 172.21.15.121:0/1325102202 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) ==== 172+0+0 (secure 0 0 0) 0x7f337c042020 con 0x7f338c0a37b0 2024-09-15T23:55:43.204 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 4 and data pool 5 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.215+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 msgr2=0x7f336c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.215+0000 7f3390da1640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 0x7f336c03a760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3380000c00 tx=0x7f3380007970 comp rx=0 tx=0).stop 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 msgr2=0x7f338c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f337c035040 tx=0x7f337c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 shutdown_connections 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f336c0382a0 0x7f336c03a760 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3380000c00 tx=0x7f3380007970 comp rx=0 tx=0).stop 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 --2- 172.21.15.121:0/1325102202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f338c0a37b0 0x7f338c071170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 >> 172.21.15.121:0/1325102202 conn(0x7f338c0a8430 msgr2=0x7f338c136b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.218 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 shutdown_connections 2024-09-15T23:55:43.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.216+0000 7f3390da1640 1 -- 172.21.15.121:0/1325102202 wait complete. 2024-09-15T23:55:43.244 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:43.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.371+0000 7f08761e8640 1 Processor -- start 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.371+0000 7f08761e8640 1 -- start start 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f08761e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f08700a4c20 0x7f087013f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f08761e8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087013a080 con 0x7f087013a280 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f08761e8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f08700a3d50 con 0x7f08700a4c20 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f08700a4c20 0x7f087013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f087013a280 0x7f087013a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35490/0 (socket says 172.21.15.121:35490) 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f08700a4c20 0x7f087013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36384/0 (socket says 172.21.15.121:36384) 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086f7fe640 1 -- 172.21.15.121:0/635791151 learned_addr learned my addr 172.21.15.121:0/635791151 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086effd640 1 -- 172.21.15.121:0/635791151 >> v1:172.21.15.121:6789/0 conn(0x7f087013a280 legacy=0x7f087013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086effd640 1 -- 172.21.15.121:0/635791151 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08700a3f80 con 0x7f08700a4c20 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.372+0000 7f086e7fc640 1 -- 172.21.15.121:0/635791151 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226283307 0 0) 0x7f087013a080 con 0x7f087013a280 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.373+0000 7f086effd640 1 --2- 172.21.15.121:0/635791151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f087013f060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0864009720 tx=0x7f086402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c79a054d84b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.373+0000 7f086e7fc640 1 -- 172.21.15.121:0/635791151 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0864037070 con 0x7f08700a4c20 2024-09-15T23:55:43.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.373+0000 7f086e7fc640 1 -- 172.21.15.121:0/635791151 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086402ad90 con 0x7f08700a4c20 2024-09-15T23:55:43.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.373+0000 7f086e7fc640 1 -- 172.21.15.121:0/635791151 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0864032590 con 0x7f08700a4c20 2024-09-15T23:55:43.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 -- 172.21.15.121:0/635791151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 msgr2=0x7f087013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 --2- 172.21.15.121:0/635791151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f087013f060 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0864009720 tx=0x7f086402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:43.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 -- 172.21.15.121:0/635791151 shutdown_connections 2024-09-15T23:55:43.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 --2- 172.21.15.121:0/635791151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f087013f060 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 -- 172.21.15.121:0/635791151 >> 172.21.15.121:0/635791151 conn(0x7f08700ac3e0 msgr2=0x7f08700ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 -- 172.21.15.121:0/635791151 shutdown_connections 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.374+0000 7f08761e8640 1 -- 172.21.15.121:0/635791151 wait complete. 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f08761e8640 1 Processor -- start 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f08761e8640 1 -- start start 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f08761e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f08761e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08700a7ec0 con 0x7f08700a4c20 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36388/0 (socket says 172.21.15.121:36388) 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.375+0000 7f086f7fe640 1 -- 172.21.15.121:0/4126672250 learned_addr learned my addr 172.21.15.121:0/4126672250 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f086f7fe640 1 -- 172.21.15.121:0/4126672250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08700a2a70 con 0x7f08700a4c20 2024-09-15T23:55:43.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f086f7fe640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f086000c840 tx=0x7f086000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0860018070 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086000a660 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087009f760 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f086000a980 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.376+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087009f480 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.377+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f086001b070 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.377+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08700a2f50 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.377+0000 7f0857fff640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 0x7f085c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.377+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3439+0+0 (secure 0 0 0) 0x7f086004a910 con 0x7f08700a4c20 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.377+0000 7f086effd640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 0x7f085c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.378+0000 7f086effd640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 0x7f085c03a760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0864034000 tx=0x7f086402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.382+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0860011360 con 0x7f08700a4c20 2024-09-15T23:55:43.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.548+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08700732e0 con 0x7f08700a4c20 2024-09-15T23:55:43.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.549+0000 7f0857fff640 1 -- 172.21.15.121:0/4126672250 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+10688 (secure 0 0 0) 0x7f086000adb0 con 0x7f08700a4c20 2024-09-15T23:55:43.550 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:43.551 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:42.553326+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:40.793323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:41.516392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:43.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 msgr2=0x7f085c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 0x7f085c03a760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0864034000 tx=0x7f086402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 msgr2=0x7f08700a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f086000c840 tx=0x7f086000cd00 comp rx=0 tx=0).stop 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 shutdown_connections 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f085c0382a0 0x7f085c03a760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 --2- 172.21.15.121:0/4126672250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08700a4c20 0x7f08700a1d10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 >> 172.21.15.121:0/4126672250 conn(0x7f08700ac3e0 msgr2=0x7f08700a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 shutdown_connections 2024-09-15T23:55:43.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.551+0000 7f08761e8640 1 -- 172.21.15.121:0/4126672250 wait complete. 2024-09-15T23:55:43.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:43.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.662+0000 7fbe90ae6640 1 Processor -- start 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.662+0000 7fbe90ae6640 1 -- start start 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe90ae6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe8c13a280 0x7fbe8c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe90ae6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8c13a080 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe90ae6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbe8c0a3d50 con 0x7fbe8c13a280 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe8a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe8c13a280 0x7fbe8c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe8a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe8c13a280 0x7fbe8c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36396/0 (socket says 172.21.15.121:36396) 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe89d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe8c0a4c20 0x7fbe8c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35494/0 (socket says 172.21.15.121:35494) 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe8a59c640 1 -- 172.21.15.121:0/4111515738 learned_addr learned my addr 172.21.15.121:0/4111515738 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe8a59c640 1 -- 172.21.15.121:0/4111515738 >> v1:172.21.15.121:6789/0 conn(0x7fbe8c0a4c20 legacy=0x7fbe8c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.663+0000 7fbe8a59c640 1 -- 172.21.15.121:0/4111515738 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c0a3f80 con 0x7fbe8c13a280 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.664+0000 7fbe8a59c640 1 --2- 172.21.15.121:0/4111515738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c13a280 0x7fbe8c13a660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0097f0 tx=0x7fbe7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c93719ad5dab8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.664+0000 7fbe8959a640 1 -- 172.21.15.121:0/4111515738 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7c037070 con 0x7fbe8c13a280 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.664+0000 7fbe8959a640 1 -- 172.21.15.121:0/4111515738 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c032440 con 0x7fbe8c13a280 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.664+0000 7fbe8959a640 1 -- 172.21.15.121:0/4111515738 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7c02ae60 con 0x7fbe8c13a280 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 -- 172.21.15.121:0/4111515738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c13a280 msgr2=0x7fbe8c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/4111515738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c13a280 0x7fbe8c13a660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0097f0 tx=0x7fbe7c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 -- 172.21.15.121:0/4111515738 shutdown_connections 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/4111515738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c13a280 0x7fbe8c13a660 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 -- 172.21.15.121:0/4111515738 >> 172.21.15.121:0/4111515738 conn(0x7fbe8c0ac3e0 msgr2=0x7fbe8c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 -- 172.21.15.121:0/4111515738 shutdown_connections 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.665+0000 7fbe90ae6640 1 -- 172.21.15.121:0/4111515738 wait complete. 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.666+0000 7fbe90ae6640 1 Processor -- start 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.666+0000 7fbe90ae6640 1 -- start start 2024-09-15T23:55:43.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.666+0000 7fbe90ae6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.666+0000 7fbe90ae6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c139d40 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe8a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36404/0 (socket says 172.21.15.121:36404) 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe8a59c640 1 -- 172.21.15.121:0/3933663198 learned_addr learned my addr 172.21.15.121:0/3933663198 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe8a59c640 1 -- 172.21.15.121:0/3933663198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c124ff0 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe8a59c640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c035040 tx=0x7fbe7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7c041020 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0307f0 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c125270 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7c037040 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.667+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c138290 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.668+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbe7c044020 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.668+0000 7fbe82ffd640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 0x7fbe6c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.668+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3439+0+0 (secure 0 0 0) 0x7fbe7c06bc10 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.668+0000 7fbe89d9b640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 0x7fbe6c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.668+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c06dab0 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.669+0000 7fbe89d9b640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 0x7fbe6c03a760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe74001550 tx=0x7fbe74007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.673+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe7c04b030 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.839+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe8c0a2f50 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.840+0000 7fbe82ffd640 1 -- 172.21.15.121:0/3933663198 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+10688 (secure 0 0 0) 0x7fbe8c124ff0 con 0x7fbe8c0a4c20 2024-09-15T23:55:43.841 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:43.841 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:42.553326+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:40.793323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:41.516392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 msgr2=0x7fbe6c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 0x7fbe6c03a760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe74001550 tx=0x7fbe74007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 msgr2=0x7fbe8c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c035040 tx=0x7fbe7c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 shutdown_connections 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fbe6c0382a0 0x7fbe6c03a760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 --2- 172.21.15.121:0/3933663198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe8c0a4c20 0x7fbe8c0a1150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 >> 172.21.15.121:0/3933663198 conn(0x7fbe8c0ac3e0 msgr2=0x7fbe8c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 shutdown_connections 2024-09-15T23:55:43.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.842+0000 7fbe90ae6640 1 -- 172.21.15.121:0/3933663198 wait complete. 2024-09-15T23:55:43.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:55:43.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.954+0000 7f98018ba640 1 Processor -- start 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.954+0000 7f98018ba640 1 -- start start 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.954+0000 7f98018ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f97fc06dab0 0x7f97fc0a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.954+0000 7f98018ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc06e410 con 0x7f97fc0a7140 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.954+0000 7f98018ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc06de90 con 0x7f97fc06dab0 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.955+0000 7f97faffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f97fc06dab0 0x7f97fc0a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.955+0000 7f97f3fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f97fc0a7140 0x7f97fc136990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35500/0 (socket says 172.21.15.121:35500) 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.955+0000 7f97f3fff640 1 -- 172.21.15.121:0/3020956751 learned_addr learned my addr 172.21.15.121:0/3020956751 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.955+0000 7f97faffd640 1 -- 172.21.15.121:0/3020956751 >> v1:172.21.15.121:6789/0 conn(0x7f97fc0a7140 legacy=0x7f97fc136990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.955+0000 7f97faffd640 1 -- 172.21.15.121:0/3020956751 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0a8140 con 0x7f97fc06dab0 2024-09-15T23:55:43.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f97faffd640 1 --2- 172.21.15.121:0/3020956751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc0a6c00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009720 tx=0x7f97ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbd5722d254d77f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f97fa7fc640 1 -- 172.21.15.121:0/3020956751 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec037070 con 0x7f97fc06dab0 2024-09-15T23:55:43.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f97fa7fc640 1 -- 172.21.15.121:0/3020956751 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec02ad90 con 0x7f97fc06dab0 2024-09-15T23:55:43.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f97fa7fc640 1 -- 172.21.15.121:0/3020956751 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec032590 con 0x7f97fc06dab0 2024-09-15T23:55:43.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 -- 172.21.15.121:0/3020956751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 msgr2=0x7f97fc0a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 --2- 172.21.15.121:0/3020956751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc0a6c00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009720 tx=0x7f97ec02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 -- 172.21.15.121:0/3020956751 shutdown_connections 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 --2- 172.21.15.121:0/3020956751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc0a6c00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 -- 172.21.15.121:0/3020956751 >> 172.21.15.121:0/3020956751 conn(0x7f97fc0ac620 msgr2=0x7f97fc0aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 -- 172.21.15.121:0/3020956751 shutdown_connections 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.956+0000 7f98018ba640 1 -- 172.21.15.121:0/3020956751 wait complete. 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.957+0000 7f98018ba640 1 Processor -- start 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.957+0000 7f98018ba640 1 -- start start 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f98018ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f98018ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0a3c70 con 0x7f97fc06dab0 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97faffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36420/0 (socket says 172.21.15.121:36420) 2024-09-15T23:55:43.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97faffd640 1 -- 172.21.15.121:0/4053114496 learned_addr learned my addr 172.21.15.121:0/4053114496 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97faffd640 1 -- 172.21.15.121:0/4053114496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc09ff00 con 0x7f97fc06dab0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97faffd640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f97ec035040 tx=0x7f97ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec041070 con 0x7f97fc06dab0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec03c460 con 0x7f97fc06dab0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec037040 con 0x7f97fc06dab0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc0a3090 con 0x7f97fc06dab0 2024-09-15T23:55:43.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.958+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0a1d20 con 0x7f97fc06dab0 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.959+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f97ec044070 con 0x7f97fc06dab0 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.959+0000 7f97f8ff9640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 0x7f97dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.959+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc0a6c00 con 0x7f97fc06dab0 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.959+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3439+0+0 (secure 0 0 0) 0x7f97ec06bbd0 con 0x7f97fc06dab0 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.959+0000 7f97f3fff640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 0x7f97dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:43.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.960+0000 7f97f3fff640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 0x7f97dc03a760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97e4007fd0 tx=0x7f97e4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:43.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:43.964+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97ec03d3f0 con 0x7f97fc06dab0 2024-09-15T23:55:44.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.161+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97fc0a3ee0 con 0x7f97fc06dab0 2024-09-15T23:55:44.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.216+0000 7f97f8ff9640 1 -- 172.21.15.121:0/4053114496 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) ==== 118+0+0 (secure 0 0 0) 0x7f97ec06be20 con 0x7f97fc06dab0 2024-09-15T23:55:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.218+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 msgr2=0x7f97dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:44.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.218+0000 7f98018ba640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 0x7f97dc03a760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f97e4007fd0 tx=0x7f97e4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.218+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 msgr2=0x7f97fc1ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.218+0000 7f98018ba640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f97ec035040 tx=0x7f97ec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 shutdown_connections 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f97dc0382a0 0x7f97dc03a760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 --2- 172.21.15.121:0/4053114496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97fc06dab0 0x7f97fc1ce9a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 >> 172.21.15.121:0/4053114496 conn(0x7f97fc0ac620 msgr2=0x7f97fc1383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 shutdown_connections 2024-09-15T23:55:44.221 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.219+0000 7f98018ba640 1 -- 172.21.15.121:0/4053114496 wait complete. 2024-09-15T23:55:44.231 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:55:44.231 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:55:44.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.331+0000 7fb0a9630640 1 Processor -- start 2024-09-15T23:55:44.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.331+0000 7fb0a9630640 1 -- start start 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a9630640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb0a409f600 0x7fb0a413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a9630640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a40a1150 con 0x7fb0a40a0660 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a9630640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a406d870 con 0x7fb0a409f600 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a2ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb0a40a0660 0x7fb0a40a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35508/0 (socket says 172.21.15.121:35508) 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb09bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb0a409f600 0x7fb0a413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a2ffd640 1 -- 172.21.15.121:0/889186177 learned_addr learned my addr 172.21.15.121:0/889186177 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb09bfff640 1 -- 172.21.15.121:0/889186177 >> v1:172.21.15.121:6789/0 conn(0x7fb0a40a0660 legacy=0x7fb0a40a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:44.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb09bfff640 1 -- 172.21.15.121:0/889186177 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a409fea0 con 0x7fb0a409f600 2024-09-15T23:55:44.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.332+0000 7fb0a27fc640 1 -- 172.21.15.121:0/889186177 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261978076 0 0) 0x7fb0a40a1150 con 0x7fb0a40a0660 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb09bfff640 1 --2- 172.21.15.121:0/889186177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a413ee50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009720 tx=0x7fb08c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eebe9b348c91bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a27fc640 1 -- 172.21.15.121:0/889186177 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c037070 con 0x7fb0a409f600 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a27fc640 1 -- 172.21.15.121:0/889186177 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb08c02ad90 con 0x7fb0a409f600 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a27fc640 1 -- 172.21.15.121:0/889186177 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb08c032590 con 0x7fb0a409f600 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 -- 172.21.15.121:0/889186177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 msgr2=0x7fb0a413ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 --2- 172.21.15.121:0/889186177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a413ee50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009720 tx=0x7fb08c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 -- 172.21.15.121:0/889186177 shutdown_connections 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 --2- 172.21.15.121:0/889186177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a413ee50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 -- 172.21.15.121:0/889186177 >> 172.21.15.121:0/889186177 conn(0x7fb0a40aa380 msgr2=0x7fb0a40aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:44.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 -- 172.21.15.121:0/889186177 shutdown_connections 2024-09-15T23:55:44.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.333+0000 7fb0a9630640 1 -- 172.21.15.121:0/889186177 wait complete. 2024-09-15T23:55:44.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.334+0000 7fb0a9630640 1 Processor -- start 2024-09-15T23:55:44.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.334+0000 7fb0a9630640 1 -- start start 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a9630640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a9630640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a409faf0 con 0x7fb0a409f600 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36436/0 (socket says 172.21.15.121:36436) 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a2ffd640 1 -- 172.21.15.121:0/3214007521 learned_addr learned my addr 172.21.15.121:0/3214007521 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:44.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a2ffd640 1 -- 172.21.15.121:0/3214007521 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a413e490 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a2ffd640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c430 tx=0x7fb09400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094005cd0 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb094007070 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a413c930 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb094007370 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.335+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a413c650 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.336+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb094007510 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.336+0000 7fb09b7fe640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 0x7fb08403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.336+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fb09404aed0 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.336+0000 7fb09bfff640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 0x7fb08403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.336+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a413e180 con 0x7fb0a409f600 2024-09-15T23:55:44.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.337+0000 7fb09bfff640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 0x7fb08403a760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb08c034000 tx=0x7fb08c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:44.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.341+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb094049e10 con 0x7fb0a409f600 2024-09-15T23:55:44.539 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:44.539+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb0a4073940 con 0x7fb0a409f600 2024-09-15T23:55:45.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.222+0000 7fb09b7fe640 1 -- 172.21.15.121:0/3214007521 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fb09401a760 con 0x7fb0a409f600 2024-09-15T23:55:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 msgr2=0x7fb08403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 0x7fb08403a760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb08c034000 tx=0x7fb08c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 msgr2=0x7fb0a41209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb09400c430 tx=0x7fb09400c8f0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 shutdown_connections 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb0840382a0 0x7fb08403a760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 --2- 172.21.15.121:0/3214007521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0a409f600 0x7fb0a41209d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 >> 172.21.15.121:0/3214007521 conn(0x7fb0a40aa380 msgr2=0x7fb0a40a9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 shutdown_connections 2024-09-15T23:55:45.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.224+0000 7fb0a9630640 1 -- 172.21.15.121:0/3214007521 wait complete. 2024-09-15T23:55:45.238 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:55:45.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:45.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.338+0000 7fe764cd9640 1 Processor -- start 2024-09-15T23:55:45.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.338+0000 7fe764cd9640 1 -- start start 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.338+0000 7fe764cd9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe760135f30 0x7fe76013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.338+0000 7fe764cd9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7600a08c0 con 0x7fe760135b50 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.338+0000 7fe764cd9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe76009b310 con 0x7fe760135f30 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.339+0000 7fe75dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe760135f30 0x7fe76013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.339+0000 7fe75e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe760135b50 0x7fe76009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35512/0 (socket says 172.21.15.121:35512) 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.339+0000 7fe75e59c640 1 -- 172.21.15.121:0/1140364966 learned_addr learned my addr 172.21.15.121:0/1140364966 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.339+0000 7fe75dd9b640 1 -- 172.21.15.121:0/1140364966 >> v1:172.21.15.121:6789/0 conn(0x7fe760135b50 legacy=0x7fe76009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.339+0000 7fe75dd9b640 1 -- 172.21.15.121:0/1140364966 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7600a2270 con 0x7fe760135f30 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe75dd9b640 1 --2- 172.21.15.121:0/1140364966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135f30 0x7fe76013bb80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe754009720 tx=0x7fe75402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4400cfc7129030e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe75d59a640 1 -- 172.21.15.121:0/1140364966 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe754037070 con 0x7fe760135f30 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe75d59a640 1 -- 172.21.15.121:0/1140364966 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75402ae20 con 0x7fe760135f30 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe75d59a640 1 -- 172.21.15.121:0/1140364966 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe754032590 con 0x7fe760135f30 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 -- 172.21.15.121:0/1140364966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135f30 msgr2=0x7fe76013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 --2- 172.21.15.121:0/1140364966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135f30 0x7fe76013bb80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe754009720 tx=0x7fe75402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 -- 172.21.15.121:0/1140364966 shutdown_connections 2024-09-15T23:55:45.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 --2- 172.21.15.121:0/1140364966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135f30 0x7fe76013bb80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 -- 172.21.15.121:0/1140364966 >> 172.21.15.121:0/1140364966 conn(0x7fe7600a85e0 msgr2=0x7fe7600a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 -- 172.21.15.121:0/1140364966 shutdown_connections 2024-09-15T23:55:45.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.340+0000 7fe764cd9640 1 -- 172.21.15.121:0/1140364966 wait complete. 2024-09-15T23:55:45.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.341+0000 7fe764cd9640 1 Processor -- start 2024-09-15T23:55:45.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.341+0000 7fe764cd9640 1 -- start start 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe764cd9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe764cd9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe760136350 con 0x7fe760135b50 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe75e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe75e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36454/0 (socket says 172.21.15.121:36454) 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe75e59c640 1 -- 172.21.15.121:0/61808173 learned_addr learned my addr 172.21.15.121:0/61808173 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe75e59c640 1 -- 172.21.15.121:0/61808173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe760070770 con 0x7fe760135b50 2024-09-15T23:55:45.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe75e59c640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c380 tx=0x7fe75000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750005c10 con 0x7fe760135b50 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750005db0 con 0x7fe760135b50 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe760071400 con 0x7fe760135b50 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750004930 con 0x7fe760135b50 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.342+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe760070a30 con 0x7fe760135b50 2024-09-15T23:55:45.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.343+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe75001a020 con 0x7fe760135b50 2024-09-15T23:55:45.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.343+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76006ec30 con 0x7fe760135b50 2024-09-15T23:55:45.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.343+0000 7fe74effd640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 0x7fe74003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.343+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fe75004a9d0 con 0x7fe760135b50 2024-09-15T23:55:45.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.344+0000 7fe75dd9b640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 0x7fe74003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.344+0000 7fe75dd9b640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 0x7fe74003a760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.348+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7500127f0 con 0x7fe760135b50 2024-09-15T23:55:45.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.547+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe76009aae0 con 0x7fe760135b50 2024-09-15T23:55:45.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.547+0000 7fe74effd640 1 -- 172.21.15.121:0/61808173 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7fe750012a50 con 0x7fe760135b50 2024-09-15T23:55:45.548 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:45.549 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:55:45.549 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:55:45.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 msgr2=0x7fe74003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 0x7fe74003a760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe754034000 tx=0x7fe75402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 msgr2=0x7fe760070ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c380 tx=0x7fe75000c840 comp rx=0 tx=0).stop 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 shutdown_connections 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fe7400382a0 0x7fe74003a760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 --2- 172.21.15.121:0/61808173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe760135b50 0x7fe760070ec0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 >> 172.21.15.121:0/61808173 conn(0x7fe7600a85e0 msgr2=0x7fe7600a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 shutdown_connections 2024-09-15T23:55:45.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.549+0000 7fe764cd9640 1 -- 172.21.15.121:0/61808173 wait complete. 2024-09-15T23:55:45.561 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:55:45.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.657+0000 7fa6bf230640 1 Processor -- start 2024-09-15T23:55:45.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.657+0000 7fa6bf230640 1 -- start start 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6bf230640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6b80a4c20 0x7fa6b813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6bf230640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6b813a080 con 0x7fa6b813a280 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6bf230640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b80a3d50 con 0x7fa6b80a4c20 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6b80a4c20 0x7fa6b813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6b80a4c20 0x7fa6b813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36458/0 (socket says 172.21.15.121:36458) 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6bcfcc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa6b813a280 0x7fa6b813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35522/0 (socket says 172.21.15.121:35522) 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b7fff640 1 -- 172.21.15.121:0/1893347363 learned_addr learned my addr 172.21.15.121:0/1893347363 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b7fff640 1 -- 172.21.15.121:0/1893347363 >> v1:172.21.15.121:6789/0 conn(0x7fa6b813a280 legacy=0x7fa6b813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b7fff640 1 -- 172.21.15.121:0/1893347363 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b80a3f80 con 0x7fa6b80a4c20 2024-09-15T23:55:45.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.658+0000 7fa6b77fe640 1 -- 172.21.15.121:0/1893347363 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945838431 0 0) 0x7fa6b813a080 con 0x7fa6b813a280 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.659+0000 7fa6b7fff640 1 --2- 172.21.15.121:0/1893347363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b813f060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097f0 tx=0x7fa6ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c961dd7f4aa562c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.659+0000 7fa6b77fe640 1 -- 172.21.15.121:0/1893347363 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6ac037070 con 0x7fa6b80a4c20 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.659+0000 7fa6b77fe640 1 -- 172.21.15.121:0/1893347363 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ac032440 con 0x7fa6b80a4c20 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.659+0000 7fa6b77fe640 1 -- 172.21.15.121:0/1893347363 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6ac02ae60 con 0x7fa6b80a4c20 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- 172.21.15.121:0/1893347363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 msgr2=0x7fa6b813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 --2- 172.21.15.121:0/1893347363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b813f060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097f0 tx=0x7fa6ac02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- 172.21.15.121:0/1893347363 shutdown_connections 2024-09-15T23:55:45.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 --2- 172.21.15.121:0/1893347363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b813f060 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- 172.21.15.121:0/1893347363 >> 172.21.15.121:0/1893347363 conn(0x7fa6b80ac3e0 msgr2=0x7fa6b80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- 172.21.15.121:0/1893347363 shutdown_connections 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- 172.21.15.121:0/1893347363 wait complete. 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 Processor -- start 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.660+0000 7fa6bf230640 1 -- start start 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bf230640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bf230640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b80a7ec0 con 0x7fa6b80a4c20 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bcfcc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bcfcc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36468/0 (socket says 172.21.15.121:36468) 2024-09-15T23:55:45.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bcfcc640 1 -- 172.21.15.121:0/2008053965 learned_addr learned my addr 172.21.15.121:0/2008053965 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.661+0000 7fa6bcfcc640 1 -- 172.21.15.121:0/2008053965 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b8124f10 con 0x7fa6b80a4c20 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6bcfcc640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c420 tx=0x7fa6a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a8018070 con 0x7fa6b80a4c20 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80074d0 con 0x7fa6b80a4c20 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a8004950 con 0x7fa6b80a4c20 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b8124690 con 0x7fa6b80a4c20 2024-09-15T23:55:45.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b81238a0 con 0x7fa6b80a4c20 2024-09-15T23:55:45.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.662+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa6a801b070 con 0x7fa6b80a4c20 2024-09-15T23:55:45.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.663+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b8122b30 con 0x7fa6b80a4c20 2024-09-15T23:55:45.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.663+0000 7fa6b57fa640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 0x7fa6a403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.663+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fa6a804a580 con 0x7fa6b80a4c20 2024-09-15T23:55:45.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.663+0000 7fa6b7fff640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 0x7fa6a403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.663+0000 7fa6b7fff640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 0x7fa6a403a760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac034000 tx=0x7fa6ac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.667+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6a8011980 con 0x7fa6b80a4c20 2024-09-15T23:55:45.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.833+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6b80a2f00 con 0x7fa6b80a4c20 2024-09-15T23:55:45.835 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.834+0000 7fa6b57fa640 1 -- 172.21.15.121:0/2008053965 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+10675 (secure 0 0 0) 0x7fa6a8011be0 con 0x7fa6b80a4c20 2024-09-15T23:55:45.835 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:45.835 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":27,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:44.212033+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:40.793323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:41.516392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 msgr2=0x7fa6a403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 0x7fa6a403a760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac034000 tx=0x7fa6ac02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 msgr2=0x7fa6b80a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800c420 tx=0x7fa6a800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 shutdown_connections 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa6a40382a0 0x7fa6a403a760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 --2- 172.21.15.121:0/2008053965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6b80a4c20 0x7fa6b80a1080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 >> 172.21.15.121:0/2008053965 conn(0x7fa6b80ac3e0 msgr2=0x7fa6b8139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 shutdown_connections 2024-09-15T23:55:45.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.836+0000 7fa6bf230640 1 -- 172.21.15.121:0/2008053965 wait complete. 2024-09-15T23:55:45.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:55:45.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa362f2a640 1 Processor -- start 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa362f2a640 1 -- start start 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa362f2a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa35c135f30 0x7fa35c13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa362f2a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35c0a08c0 con 0x7fa35c135b50 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa362f2a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa35c09b310 con 0x7fa35c135f30 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa35bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa35c135f30 0x7fa35c13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa35bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa35c135f30 0x7fa35c13bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36470/0 (socket says 172.21.15.121:36470) 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa360cc6640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa35c135b50 0x7fa35c09aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35532/0 (socket says 172.21.15.121:35532) 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.946+0000 7fa35bfff640 1 -- 172.21.15.121:0/4058044414 learned_addr learned my addr 172.21.15.121:0/4058044414 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:45.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.947+0000 7fa35bfff640 1 -- 172.21.15.121:0/4058044414 >> v1:172.21.15.121:6789/0 conn(0x7fa35c135b50 legacy=0x7fa35c09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.947+0000 7fa35b7fe640 1 -- 172.21.15.121:0/4058044414 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499345596 0 0) 0x7fa35c0a08c0 con 0x7fa35c135b50 2024-09-15T23:55:45.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.947+0000 7fa35bfff640 1 -- 172.21.15.121:0/4058044414 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c0a2270 con 0x7fa35c135f30 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.947+0000 7fa35bfff640 1 --2- 172.21.15.121:0/4058044414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135f30 0x7fa35c13bb80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3440097f0 tx=0x7fa34402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d469a2b977c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa35b7fe640 1 -- 172.21.15.121:0/4058044414 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344037070 con 0x7fa35c135f30 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa35b7fe640 1 -- 172.21.15.121:0/4058044414 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa344032440 con 0x7fa35c135f30 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa35b7fe640 1 -- 172.21.15.121:0/4058044414 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa344032740 con 0x7fa35c135f30 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 -- 172.21.15.121:0/4058044414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135f30 msgr2=0x7fa35c13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 --2- 172.21.15.121:0/4058044414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135f30 0x7fa35c13bb80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3440097f0 tx=0x7fa34402a270 comp rx=0 tx=0).stop 2024-09-15T23:55:45.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 -- 172.21.15.121:0/4058044414 shutdown_connections 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 --2- 172.21.15.121:0/4058044414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135f30 0x7fa35c13bb80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 -- 172.21.15.121:0/4058044414 >> 172.21.15.121:0/4058044414 conn(0x7fa35c0a85e0 msgr2=0x7fa35c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 -- 172.21.15.121:0/4058044414 shutdown_connections 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.948+0000 7fa362f2a640 1 -- 172.21.15.121:0/4058044414 wait complete. 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.949+0000 7fa362f2a640 1 Processor -- start 2024-09-15T23:55:45.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.949+0000 7fa362f2a640 1 -- start start 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa362f2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa362f2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa35c136350 con 0x7fa35c135b50 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa360cc6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa360cc6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36478/0 (socket says 172.21.15.121:36478) 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa360cc6640 1 -- 172.21.15.121:0/468987501 learned_addr learned my addr 172.21.15.121:0/468987501 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa360cc6640 1 -- 172.21.15.121:0/468987501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35c11fbe0 con 0x7fa35c135b50 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa360cc6640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c420 tx=0x7fa34c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c018070 con 0x7fa35c135b50 2024-09-15T23:55:45.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34c0074d0 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa35c126060 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34c004950 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.950+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa35c120870 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.951+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa34c01b070 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.951+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35c09aae0 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.951+0000 7fa3597fa640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 0x7fa33c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.951+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fa34c04a590 con 0x7fa35c135b50 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.952+0000 7fa35bfff640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 0x7fa33c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:45.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.952+0000 7fa35bfff640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 0x7fa33c03a760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa344034000 tx=0x7fa34402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:45.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:45.956+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa34c011960 con 0x7fa35c135b50 2024-09-15T23:55:46.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.118+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa35c0a2c40 con 0x7fa33c0382a0 2024-09-15T23:55:46.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.124+0000 7fa3597fa640 1 -- 172.21.15.121:0/468987501 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240666 (secure 0 0 0) 0x7fa35c0a2c40 con 0x7fa33c0382a0 2024-09-15T23:55:46.129 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:46.131 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 msgr2=0x7fa33c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.133 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 0x7fa33c03a760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa344034000 tx=0x7fa34402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 msgr2=0x7fa35c11ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c420 tx=0x7fa34c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 shutdown_connections 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa33c0382a0 0x7fa33c03a760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 --2- 172.21.15.121:0/468987501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa35c135b50 0x7fa35c11ea60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 >> 172.21.15.121:0/468987501 conn(0x7fa35c0a85e0 msgr2=0x7fa35c09d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 shutdown_connections 2024-09-15T23:55:46.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.127+0000 7fa362f2a640 1 -- 172.21.15.121:0/468987501 wait complete. 2024-09-15T23:55:46.138 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-15T23:55:46.028844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87052,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028468,"statfs":{"total":289910292480,"available":289821151232,"internally_reserved":0,"allocated":1843200,"data_stored":1392357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213470+0000","last_change":"2024-09-15T23:55:42.213470+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213470+0000","last_undegraded":"2024-09-15T23:55:42.213470+0000","last_fullsized":"2024-09-15T23:55:42.213470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215439+0000","last_change":"2024-09-15T23:55:42.215439+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215439+0000","last_undegraded":"2024-09-15T23:55:42.215439+0000","last_fullsized":"2024-09-15T23:55:42.215439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215816+0000","last_change":"2024-09-15T23:55:42.215816+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215816+0000","last_undegraded":"2024-09-15T23:55:42.215816+0000","last_fullsized":"2024-09-15T23:55:42.215816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215244+0000","last_change":"2024-09-15T23:55:42.215244+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215244+0000","last_undegraded":"2024-09-15T23:55:42.215244+0000","last_fullsized":"2024-09-15T23:55:42.215244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214155+0000","last_change":"2024-09-15T23:55:42.214155+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214155+0000","last_undegraded":"2024-09-15T23:55:42.214155+0000","last_fullsized":"2024-09-15T23:55:42.214155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215980+0000","last_change":"2024-09-15T23:55:42.215980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215980+0000","last_undegraded":"2024-09-15T23:55:42.215980+0000","last_fullsized":"2024-09-15T23:55:42.215980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212654+0000","last_change":"2024-09-15T23:55:42.212654+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212654+0000","last_undegraded":"2024-09-15T23:55:42.212654+0000","last_fullsized":"2024-09-15T23:55:42.212654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213914+0000","last_change":"2024-09-15T23:55:42.213914+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213914+0000","last_undegraded":"2024-09-15T23:55:42.213914+0000","last_fullsized":"2024-09-15T23:55:42.213914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.219578+0000","last_change":"2024-09-15T23:55:42.219578+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.219578+0000","last_undegraded":"2024-09-15T23:55:42.219578+0000","last_fullsized":"2024-09-15T23:55:42.219578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215419+0000","last_change":"2024-09-15T23:55:42.215419+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215419+0000","last_undegraded":"2024-09-15T23:55:42.215419+0000","last_fullsized":"2024-09-15T23:55:42.215419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211647+0000","last_change":"2024-09-15T23:55:42.211647+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211647+0000","last_undegraded":"2024-09-15T23:55:42.211647+0000","last_fullsized":"2024-09-15T23:55:42.211647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212138+0000","last_change":"2024-09-15T23:55:42.212138+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212138+0000","last_undegraded":"2024-09-15T23:55:42.212138+0000","last_fullsized":"2024-09-15T23:55:42.212138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213705+0000","last_change":"2024-09-15T23:55:42.213705+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213705+0000","last_undegraded":"2024-09-15T23:55:42.213705+0000","last_fullsized":"2024-09-15T23:55:42.213705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210492+0000","last_change":"2024-09-15T23:55:42.210492+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210492+0000","last_undegraded":"2024-09-15T23:55:42.210492+0000","last_fullsized":"2024-09-15T23:55:42.210492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212489+0000","last_change":"2024-09-15T23:55:42.212489+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212489+0000","last_undegraded":"2024-09-15T23:55:42.212489+0000","last_fullsized":"2024-09-15T23:55:42.212489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214921+0000","last_change":"2024-09-15T23:55:42.214921+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214921+0000","last_undegraded":"2024-09-15T23:55:42.214921+0000","last_fullsized":"2024-09-15T23:55:42.214921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212673+0000","last_change":"2024-09-15T23:55:42.212673+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212673+0000","last_undegraded":"2024-09-15T23:55:42.212673+0000","last_fullsized":"2024-09-15T23:55:42.212673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215050+0000","last_change":"2024-09-15T23:55:42.215050+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215050+0000","last_undegraded":"2024-09-15T23:55:42.215050+0000","last_fullsized":"2024-09-15T23:55:42.215050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211272+0000","last_change":"2024-09-15T23:55:42.211272+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211272+0000","last_undegraded":"2024-09-15T23:55:42.211272+0000","last_fullsized":"2024-09-15T23:55:42.211272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213134+0000","last_change":"2024-09-15T23:55:42.213134+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213134+0000","last_undegraded":"2024-09-15T23:55:42.213134+0000","last_fullsized":"2024-09-15T23:55:42.213134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211389+0000","last_change":"2024-09-15T23:55:42.211389+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211389+0000","last_undegraded":"2024-09-15T23:55:42.211389+0000","last_fullsized":"2024-09-15T23:55:42.211389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213079+0000","last_change":"2024-09-15T23:55:42.213079+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213079+0000","last_undegraded":"2024-09-15T23:55:42.213079+0000","last_fullsized":"2024-09-15T23:55:42.213079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210218+0000","last_change":"2024-09-15T23:55:42.210218+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210218+0000","last_undegraded":"2024-09-15T23:55:42.210218+0000","last_fullsized":"2024-09-15T23:55:42.210218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213299+0000","last_change":"2024-09-15T23:55:42.213299+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213299+0000","last_undegraded":"2024-09-15T23:55:42.213299+0000","last_fullsized":"2024-09-15T23:55:42.213299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222637+0000","last_change":"2024-09-15T23:55:42.222637+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222637+0000","last_undegraded":"2024-09-15T23:55:42.222637+0000","last_fullsized":"2024-09-15T23:55:42.222637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212919+0000","last_change":"2024-09-15T23:55:42.212919+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212919+0000","last_undegraded":"2024-09-15T23:55:42.212919+0000","last_fullsized":"2024-09-15T23:55:42.212919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218426+0000","last_change":"2024-09-15T23:55:42.218426+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218426+0000","last_undegraded":"2024-09-15T23:55:42.218426+0000","last_fullsized":"2024-09-15T23:55:42.218426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211019+0000","last_change":"2024-09-15T23:55:42.211019+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211019+0000","last_undegraded":"2024-09-15T23:55:42.211019+0000","last_fullsized":"2024-09-15T23:55:42.211019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210810+0000","last_change":"2024-09-15T23:55:42.210810+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210810+0000","last_undegraded":"2024-09-15T23:55:42.210810+0000","last_fullsized":"2024-09-15T23:55:42.210810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209956+0000","last_change":"2024-09-15T23:55:42.209956+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209956+0000","last_undegraded":"2024-09-15T23:55:42.209956+0000","last_fullsized":"2024-09-15T23:55:42.209956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209530+0000","last_change":"2024-09-15T23:55:42.209530+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209530+0000","last_undegraded":"2024-09-15T23:55:42.209530+0000","last_fullsized":"2024-09-15T23:55:42.209530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212168+0000","last_change":"2024-09-15T23:55:42.212168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212168+0000","last_undegraded":"2024-09-15T23:55:42.212168+0000","last_fullsized":"2024-09-15T23:55:42.212168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214625+0000","last_change":"2024-09-15T23:55:42.214625+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214625+0000","last_undegraded":"2024-09-15T23:55:42.214625+0000","last_fullsized":"2024-09-15T23:55:42.214625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234608+0000","last_change":"2024-09-15T23:55:42.233492+0000","last_active":"2024-09-15T23:55:42.234608+0000","last_peered":"2024-09-15T23:55:42.234608+0000","last_clean":"2024-09-15T23:55:42.234608+0000","last_became_active":"2024-09-15T23:55:42.233237+0000","last_became_peered":"2024-09-15T23:55:42.233237+0000","last_unstale":"2024-09-15T23:55:42.234608+0000","last_undegraded":"2024-09-15T23:55:42.234608+0000","last_fullsized":"2024-09-15T23:55:42.234608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:38.510269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209589+0000","last_change":"2024-09-15T23:55:42.209589+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209589+0000","last_undegraded":"2024-09-15T23:55:42.209589+0000","last_fullsized":"2024-09-15T23:55:42.209589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231304+0000","last_change":"2024-09-15T23:55:42.227655+0000","last_active":"2024-09-15T23:55:42.231304+0000","last_peered":"2024-09-15T23:55:42.231304+0000","last_clean":"2024-09-15T23:55:42.231304+0000","last_became_active":"2024-09-15T23:55:42.227114+0000","last_became_peered":"2024-09-15T23:55:42.227114+0000","last_unstale":"2024-09-15T23:55:42.231304+0000","last_undegraded":"2024-09-15T23:55:42.231304+0000","last_fullsized":"2024-09-15T23:55:42.231304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:45.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210674+0000","last_change":"2024-09-15T23:55:42.210674+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210674+0000","last_undegraded":"2024-09-15T23:55:42.210674+0000","last_fullsized":"2024-09-15T23:55:42.210674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231397+0000","last_change":"2024-09-15T23:55:42.227590+0000","last_active":"2024-09-15T23:55:42.231397+0000","last_peered":"2024-09-15T23:55:42.231397+0000","last_clean":"2024-09-15T23:55:42.231397+0000","last_became_active":"2024-09-15T23:55:42.227300+0000","last_became_peered":"2024-09-15T23:55:42.227300+0000","last_unstale":"2024-09-15T23:55:42.231397+0000","last_undegraded":"2024-09-15T23:55:42.231397+0000","last_fullsized":"2024-09-15T23:55:42.231397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:35.069585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218037+0000","last_change":"2024-09-15T23:55:42.218037+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218037+0000","last_undegraded":"2024-09-15T23:55:42.218037+0000","last_fullsized":"2024-09-15T23:55:42.218037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233608+0000","last_change":"2024-09-15T23:55:42.229229+0000","last_active":"2024-09-15T23:55:42.233608+0000","last_peered":"2024-09-15T23:55:42.233608+0000","last_clean":"2024-09-15T23:55:42.233608+0000","last_became_active":"2024-09-15T23:55:42.228892+0000","last_became_peered":"2024-09-15T23:55:42.228892+0000","last_unstale":"2024-09-15T23:55:42.233608+0000","last_undegraded":"2024-09-15T23:55:42.233608+0000","last_fullsized":"2024-09-15T23:55:42.233608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:52.300497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215633+0000","last_change":"2024-09-15T23:55:42.215633+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215633+0000","last_undegraded":"2024-09-15T23:55:42.215633+0000","last_fullsized":"2024-09-15T23:55:42.215633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230619+0000","last_change":"2024-09-15T23:55:42.228095+0000","last_active":"2024-09-15T23:55:42.230619+0000","last_peered":"2024-09-15T23:55:42.230619+0000","last_clean":"2024-09-15T23:55:42.230619+0000","last_became_active":"2024-09-15T23:55:42.227826+0000","last_became_peered":"2024-09-15T23:55:42.227826+0000","last_unstale":"2024-09-15T23:55:42.230619+0000","last_undegraded":"2024-09-15T23:55:42.230619+0000","last_fullsized":"2024-09-15T23:55:42.230619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:40.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211390+0000","last_change":"2024-09-15T23:55:42.211390+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211390+0000","last_undegraded":"2024-09-15T23:55:42.211390+0000","last_fullsized":"2024-09-15T23:55:42.211390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.226388+0000","last_change":"2024-09-15T23:55:42.223388+0000","last_active":"2024-09-15T23:55:42.226388+0000","last_peered":"2024-09-15T23:55:42.226388+0000","last_clean":"2024-09-15T23:55:42.226388+0000","last_became_active":"2024-09-15T23:55:42.223117+0000","last_became_peered":"2024-09-15T23:55:42.223117+0000","last_unstale":"2024-09-15T23:55:42.226388+0000","last_undegraded":"2024-09-15T23:55:42.226388+0000","last_fullsized":"2024-09-15T23:55:42.226388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:57.599146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218672+0000","last_change":"2024-09-15T23:55:42.218672+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218672+0000","last_undegraded":"2024-09-15T23:55:42.218672+0000","last_fullsized":"2024-09-15T23:55:42.218672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.219278+0000","last_change":"2024-09-15T23:55:42.218000+0000","last_active":"2024-09-15T23:55:42.219278+0000","last_peered":"2024-09-15T23:55:42.219278+0000","last_clean":"2024-09-15T23:55:42.219278+0000","last_became_active":"2024-09-15T23:55:42.217248+0000","last_became_peered":"2024-09-15T23:55:42.217248+0000","last_unstale":"2024-09-15T23:55:42.219278+0000","last_undegraded":"2024-09-15T23:55:42.219278+0000","last_fullsized":"2024-09-15T23:55:42.219278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:12.128635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216432+0000","last_change":"2024-09-15T23:55:42.216432+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216432+0000","last_undegraded":"2024-09-15T23:55:42.216432+0000","last_fullsized":"2024-09-15T23:55:42.216432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233710+0000","last_change":"2024-09-15T23:55:42.230514+0000","last_active":"2024-09-15T23:55:42.233710+0000","last_peered":"2024-09-15T23:55:42.233710+0000","last_clean":"2024-09-15T23:55:42.233710+0000","last_became_active":"2024-09-15T23:55:42.228955+0000","last_became_peered":"2024-09-15T23:55:42.228955+0000","last_unstale":"2024-09-15T23:55:42.233710+0000","last_undegraded":"2024-09-15T23:55:42.233710+0000","last_fullsized":"2024-09-15T23:55:42.233710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:20.726368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211600+0000","last_change":"2024-09-15T23:55:42.211600+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211600+0000","last_undegraded":"2024-09-15T23:55:42.211600+0000","last_fullsized":"2024-09-15T23:55:42.211600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234590+0000","last_change":"2024-09-15T23:55:42.233343+0000","last_active":"2024-09-15T23:55:42.234590+0000","last_peered":"2024-09-15T23:55:42.234590+0000","last_clean":"2024-09-15T23:55:42.234590+0000","last_became_active":"2024-09-15T23:55:42.233082+0000","last_became_peered":"2024-09-15T23:55:42.233082+0000","last_unstale":"2024-09-15T23:55:42.234590+0000","last_undegraded":"2024-09-15T23:55:42.234590+0000","last_fullsized":"2024-09-15T23:55:42.234590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:13.962428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209115+0000","last_change":"2024-09-15T23:55:42.209115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209115+0000","last_undegraded":"2024-09-15T23:55:42.209115+0000","last_fullsized":"2024-09-15T23:55:42.209115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218593+0000","last_change":"2024-09-15T23:55:42.217126+0000","last_active":"2024-09-15T23:55:42.218593+0000","last_peered":"2024-09-15T23:55:42.218593+0000","last_clean":"2024-09-15T23:55:42.218593+0000","last_became_active":"2024-09-15T23:55:42.216854+0000","last_became_peered":"2024-09-15T23:55:42.216854+0000","last_unstale":"2024-09-15T23:55:42.218593+0000","last_undegraded":"2024-09-15T23:55:42.218593+0000","last_fullsized":"2024-09-15T23:55:42.218593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:07.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212554+0000","last_change":"2024-09-15T23:55:42.212554+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212554+0000","last_undegraded":"2024-09-15T23:55:42.212554+0000","last_fullsized":"2024-09-15T23:55:42.212554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231359+0000","last_change":"2024-09-15T23:55:42.227422+0000","last_active":"2024-09-15T23:55:42.231359+0000","last_peered":"2024-09-15T23:55:42.231359+0000","last_clean":"2024-09-15T23:55:42.231359+0000","last_became_active":"2024-09-15T23:55:42.227135+0000","last_became_peered":"2024-09-15T23:55:42.227135+0000","last_unstale":"2024-09-15T23:55:42.231359+0000","last_undegraded":"2024-09-15T23:55:42.231359+0000","last_fullsized":"2024-09-15T23:55:42.231359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:47.730774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210852+0000","last_change":"2024-09-15T23:55:42.210852+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210852+0000","last_undegraded":"2024-09-15T23:55:42.210852+0000","last_fullsized":"2024-09-15T23:55:42.210852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234713+0000","last_change":"2024-09-15T23:55:42.232680+0000","last_active":"2024-09-15T23:55:42.234713+0000","last_peered":"2024-09-15T23:55:42.234713+0000","last_clean":"2024-09-15T23:55:42.234713+0000","last_became_active":"2024-09-15T23:55:42.232415+0000","last_became_peered":"2024-09-15T23:55:42.232415+0000","last_unstale":"2024-09-15T23:55:42.234713+0000","last_undegraded":"2024-09-15T23:55:42.234713+0000","last_fullsized":"2024-09-15T23:55:42.234713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.986284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212729+0000","last_change":"2024-09-15T23:55:42.212729+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212729+0000","last_undegraded":"2024-09-15T23:55:42.212729+0000","last_fullsized":"2024-09-15T23:55:42.212729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233516+0000","last_change":"2024-09-15T23:55:42.229038+0000","last_active":"2024-09-15T23:55:42.233516+0000","last_peered":"2024-09-15T23:55:42.233516+0000","last_clean":"2024-09-15T23:55:42.233516+0000","last_became_active":"2024-09-15T23:55:42.228474+0000","last_became_peered":"2024-09-15T23:55:42.228474+0000","last_unstale":"2024-09-15T23:55:42.233516+0000","last_undegraded":"2024-09-15T23:55:42.233516+0000","last_fullsized":"2024-09-15T23:55:42.233516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:32.453009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210217+0000","last_change":"2024-09-15T23:55:42.210217+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210217+0000","last_undegraded":"2024-09-15T23:55:42.210217+0000","last_fullsized":"2024-09-15T23:55:42.210217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227583+0000","last_change":"2024-09-15T23:55:42.226400+0000","last_active":"2024-09-15T23:55:42.227583+0000","last_peered":"2024-09-15T23:55:42.227583+0000","last_clean":"2024-09-15T23:55:42.227583+0000","last_became_active":"2024-09-15T23:55:42.226109+0000","last_became_peered":"2024-09-15T23:55:42.226109+0000","last_unstale":"2024-09-15T23:55:42.227583+0000","last_undegraded":"2024-09-15T23:55:42.227583+0000","last_fullsized":"2024-09-15T23:55:42.227583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:04.138219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211783+0000","last_change":"2024-09-15T23:55:42.211783+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211783+0000","last_undegraded":"2024-09-15T23:55:42.211783+0000","last_fullsized":"2024-09-15T23:55:42.211783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.221450+0000","last_change":"2024-09-15T23:55:42.220273+0000","last_active":"2024-09-15T23:55:42.221450+0000","last_peered":"2024-09-15T23:55:42.221450+0000","last_clean":"2024-09-15T23:55:42.221450+0000","last_became_active":"2024-09-15T23:55:42.219755+0000","last_became_peered":"2024-09-15T23:55:42.219755+0000","last_unstale":"2024-09-15T23:55:42.221450+0000","last_undegraded":"2024-09-15T23:55:42.221450+0000","last_fullsized":"2024-09-15T23:55:42.221450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:10.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216043+0000","last_change":"2024-09-15T23:55:42.216043+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216043+0000","last_undegraded":"2024-09-15T23:55:42.216043+0000","last_fullsized":"2024-09-15T23:55:42.216043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.235125+0000","last_change":"2024-09-15T23:55:42.233298+0000","last_active":"2024-09-15T23:55:42.235125+0000","last_peered":"2024-09-15T23:55:42.235125+0000","last_clean":"2024-09-15T23:55:42.235125+0000","last_became_active":"2024-09-15T23:55:42.233077+0000","last_became_peered":"2024-09-15T23:55:42.233077+0000","last_unstale":"2024-09-15T23:55:42.235125+0000","last_undegraded":"2024-09-15T23:55:42.235125+0000","last_fullsized":"2024-09-15T23:55:42.235125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:50.606047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212496+0000","last_change":"2024-09-15T23:55:42.212496+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212496+0000","last_undegraded":"2024-09-15T23:55:42.212496+0000","last_fullsized":"2024-09-15T23:55:42.212496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227624+0000","last_change":"2024-09-15T23:55:42.226711+0000","last_active":"2024-09-15T23:55:42.227624+0000","last_peered":"2024-09-15T23:55:42.227624+0000","last_clean":"2024-09-15T23:55:42.227624+0000","last_became_active":"2024-09-15T23:55:42.226436+0000","last_became_peered":"2024-09-15T23:55:42.226436+0000","last_unstale":"2024-09-15T23:55:42.227624+0000","last_undegraded":"2024-09-15T23:55:42.227624+0000","last_fullsized":"2024-09-15T23:55:42.227624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:38.572689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222256+0000","last_change":"2024-09-15T23:55:42.222256+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222256+0000","last_undegraded":"2024-09-15T23:55:42.222256+0000","last_fullsized":"2024-09-15T23:55:42.222256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233541+0000","last_change":"2024-09-15T23:55:42.229093+0000","last_active":"2024-09-15T23:55:42.233541+0000","last_peered":"2024-09-15T23:55:42.233541+0000","last_clean":"2024-09-15T23:55:42.233541+0000","last_became_active":"2024-09-15T23:55:42.228543+0000","last_became_peered":"2024-09-15T23:55:42.228543+0000","last_unstale":"2024-09-15T23:55:42.233541+0000","last_undegraded":"2024-09-15T23:55:42.233541+0000","last_fullsized":"2024-09-15T23:55:42.233541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:43.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211772+0000","last_change":"2024-09-15T23:55:42.211772+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211772+0000","last_undegraded":"2024-09-15T23:55:42.211772+0000","last_fullsized":"2024-09-15T23:55:42.211772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233496+0000","last_change":"2024-09-15T23:55:42.231292+0000","last_active":"2024-09-15T23:55:42.233496+0000","last_peered":"2024-09-15T23:55:42.233496+0000","last_clean":"2024-09-15T23:55:42.233496+0000","last_became_active":"2024-09-15T23:55:42.230815+0000","last_became_peered":"2024-09-15T23:55:42.230815+0000","last_unstale":"2024-09-15T23:55:42.233496+0000","last_undegraded":"2024-09-15T23:55:42.233496+0000","last_fullsized":"2024-09-15T23:55:42.233496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:20.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210029+0000","last_change":"2024-09-15T23:55:42.210029+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210029+0000","last_undegraded":"2024-09-15T23:55:42.210029+0000","last_fullsized":"2024-09-15T23:55:42.210029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231334+0000","last_change":"2024-09-15T23:55:42.227704+0000","last_active":"2024-09-15T23:55:42.231334+0000","last_peered":"2024-09-15T23:55:42.231334+0000","last_clean":"2024-09-15T23:55:42.231334+0000","last_became_active":"2024-09-15T23:55:42.226981+0000","last_became_peered":"2024-09-15T23:55:42.226981+0000","last_unstale":"2024-09-15T23:55:42.231334+0000","last_undegraded":"2024-09-15T23:55:42.231334+0000","last_fullsized":"2024-09-15T23:55:42.231334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:02.879850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210168+0000","last_change":"2024-09-15T23:55:42.210168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210168+0000","last_undegraded":"2024-09-15T23:55:42.210168+0000","last_fullsized":"2024-09-15T23:55:42.210168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231424+0000","last_change":"2024-09-15T23:55:42.228234+0000","last_active":"2024-09-15T23:55:42.231424+0000","last_peered":"2024-09-15T23:55:42.231424+0000","last_clean":"2024-09-15T23:55:42.231424+0000","last_became_active":"2024-09-15T23:55:42.228025+0000","last_became_peered":"2024-09-15T23:55:42.228025+0000","last_unstale":"2024-09-15T23:55:42.231424+0000","last_undegraded":"2024-09-15T23:55:42.231424+0000","last_fullsized":"2024-09-15T23:55:42.231424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:15.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210988+0000","last_change":"2024-09-15T23:55:42.210988+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210988+0000","last_undegraded":"2024-09-15T23:55:42.210988+0000","last_fullsized":"2024-09-15T23:55:42.210988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233685+0000","last_change":"2024-09-15T23:55:42.230626+0000","last_active":"2024-09-15T23:55:42.233685+0000","last_peered":"2024-09-15T23:55:42.233685+0000","last_clean":"2024-09-15T23:55:42.233685+0000","last_became_active":"2024-09-15T23:55:42.229558+0000","last_became_peered":"2024-09-15T23:55:42.229558+0000","last_unstale":"2024-09-15T23:55:42.233685+0000","last_undegraded":"2024-09-15T23:55:42.233685+0000","last_fullsized":"2024-09-15T23:55:42.233685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:53.004728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211320+0000","last_change":"2024-09-15T23:55:42.211320+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211320+0000","last_undegraded":"2024-09-15T23:55:42.211320+0000","last_fullsized":"2024-09-15T23:55:42.211320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233985+0000","last_change":"2024-09-15T23:55:42.232416+0000","last_active":"2024-09-15T23:55:42.233985+0000","last_peered":"2024-09-15T23:55:42.233985+0000","last_clean":"2024-09-15T23:55:42.233985+0000","last_became_active":"2024-09-15T23:55:42.232148+0000","last_became_peered":"2024-09-15T23:55:42.232148+0000","last_unstale":"2024-09-15T23:55:42.233985+0000","last_undegraded":"2024-09-15T23:55:42.233985+0000","last_fullsized":"2024-09-15T23:55:42.233985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.743577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215617+0000","last_change":"2024-09-15T23:55:42.215617+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215617+0000","last_undegraded":"2024-09-15T23:55:42.215617+0000","last_fullsized":"2024-09-15T23:55:42.215617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231135+0000","last_change":"2024-09-15T23:55:42.229509+0000","last_active":"2024-09-15T23:55:42.231135+0000","last_peered":"2024-09-15T23:55:42.231135+0000","last_clean":"2024-09-15T23:55:42.231135+0000","last_became_active":"2024-09-15T23:55:42.229201+0000","last_became_peered":"2024-09-15T23:55:42.229201+0000","last_unstale":"2024-09-15T23:55:42.231135+0000","last_undegraded":"2024-09-15T23:55:42.231135+0000","last_fullsized":"2024-09-15T23:55:42.231135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:44.593277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212102+0000","last_change":"2024-09-15T23:55:42.212102+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212102+0000","last_undegraded":"2024-09-15T23:55:42.212102+0000","last_fullsized":"2024-09-15T23:55:42.212102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233982+0000","last_change":"2024-09-15T23:55:42.232445+0000","last_active":"2024-09-15T23:55:42.233982+0000","last_peered":"2024-09-15T23:55:42.233982+0000","last_clean":"2024-09-15T23:55:42.233982+0000","last_became_active":"2024-09-15T23:55:42.232171+0000","last_became_peered":"2024-09-15T23:55:42.232171+0000","last_unstale":"2024-09-15T23:55:42.233982+0000","last_undegraded":"2024-09-15T23:55:42.233982+0000","last_fullsized":"2024-09-15T23:55:42.233982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:52.279847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212121+0000","last_change":"2024-09-15T23:55:42.212121+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212121+0000","last_undegraded":"2024-09-15T23:55:42.212121+0000","last_fullsized":"2024-09-15T23:55:42.212121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231280+0000","last_change":"2024-09-15T23:55:42.227428+0000","last_active":"2024-09-15T23:55:42.231280+0000","last_peered":"2024-09-15T23:55:42.231280+0000","last_clean":"2024-09-15T23:55:42.231280+0000","last_became_active":"2024-09-15T23:55:42.227111+0000","last_became_peered":"2024-09-15T23:55:42.227111+0000","last_unstale":"2024-09-15T23:55:42.231280+0000","last_undegraded":"2024-09-15T23:55:42.231280+0000","last_fullsized":"2024-09-15T23:55:42.231280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:59.483861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210404+0000","last_change":"2024-09-15T23:55:42.210404+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210404+0000","last_undegraded":"2024-09-15T23:55:42.210404+0000","last_fullsized":"2024-09-15T23:55:42.210404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227796+0000","last_change":"2024-09-15T23:55:42.223960+0000","last_active":"2024-09-15T23:55:42.227796+0000","last_peered":"2024-09-15T23:55:42.227796+0000","last_clean":"2024-09-15T23:55:42.227796+0000","last_became_active":"2024-09-15T23:55:42.223701+0000","last_became_peered":"2024-09-15T23:55:42.223701+0000","last_unstale":"2024-09-15T23:55:42.227796+0000","last_undegraded":"2024-09-15T23:55:42.227796+0000","last_fullsized":"2024-09-15T23:55:42.227796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:38.030906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.208847+0000","last_change":"2024-09-15T23:55:42.208847+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.208847+0000","last_undegraded":"2024-09-15T23:55:42.208847+0000","last_fullsized":"2024-09-15T23:55:42.208847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218320+0000","last_change":"2024-09-15T23:55:42.216705+0000","last_active":"2024-09-15T23:55:42.218320+0000","last_peered":"2024-09-15T23:55:42.218320+0000","last_clean":"2024-09-15T23:55:42.218320+0000","last_became_active":"2024-09-15T23:55:42.216416+0000","last_became_peered":"2024-09-15T23:55:42.216416+0000","last_unstale":"2024-09-15T23:55:42.218320+0000","last_undegraded":"2024-09-15T23:55:42.218320+0000","last_fullsized":"2024-09-15T23:55:42.218320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:50.897137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209955+0000","last_change":"2024-09-15T23:55:42.209955+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209955+0000","last_undegraded":"2024-09-15T23:55:42.209955+0000","last_fullsized":"2024-09-15T23:55:42.209955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234708+0000","last_change":"2024-09-15T23:55:42.232517+0000","last_active":"2024-09-15T23:55:42.234708+0000","last_peered":"2024-09-15T23:55:42.234708+0000","last_clean":"2024-09-15T23:55:42.234708+0000","last_became_active":"2024-09-15T23:55:42.232227+0000","last_became_peered":"2024-09-15T23:55:42.232227+0000","last_unstale":"2024-09-15T23:55:42.234708+0000","last_undegraded":"2024-09-15T23:55:42.234708+0000","last_fullsized":"2024-09-15T23:55:42.234708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.199261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209575+0000","last_change":"2024-09-15T23:55:42.209575+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209575+0000","last_undegraded":"2024-09-15T23:55:42.209575+0000","last_fullsized":"2024-09-15T23:55:42.209575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222296+0000","last_change":"2024-09-15T23:55:42.220495+0000","last_active":"2024-09-15T23:55:42.222296+0000","last_peered":"2024-09-15T23:55:42.222296+0000","last_clean":"2024-09-15T23:55:42.222296+0000","last_became_active":"2024-09-15T23:55:42.219865+0000","last_became_peered":"2024-09-15T23:55:42.219865+0000","last_unstale":"2024-09-15T23:55:42.222296+0000","last_undegraded":"2024-09-15T23:55:42.222296+0000","last_fullsized":"2024-09-15T23:55:42.222296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:38.730404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212980+0000","last_change":"2024-09-15T23:55:42.212980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212980+0000","last_undegraded":"2024-09-15T23:55:42.212980+0000","last_fullsized":"2024-09-15T23:55:42.212980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231367+0000","last_change":"2024-09-15T23:55:42.227968+0000","last_active":"2024-09-15T23:55:42.231367+0000","last_peered":"2024-09-15T23:55:42.231367+0000","last_clean":"2024-09-15T23:55:42.231367+0000","last_became_active":"2024-09-15T23:55:42.227688+0000","last_became_peered":"2024-09-15T23:55:42.227688+0000","last_unstale":"2024-09-15T23:55:42.231367+0000","last_undegraded":"2024-09-15T23:55:42.231367+0000","last_fullsized":"2024-09-15T23:55:42.231367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:14.508276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212115+0000","last_change":"2024-09-15T23:55:42.212115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212115+0000","last_undegraded":"2024-09-15T23:55:42.212115+0000","last_fullsized":"2024-09-15T23:55:42.212115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230957+0000","last_change":"2024-09-15T23:55:42.224100+0000","last_active":"2024-09-15T23:55:42.230957+0000","last_peered":"2024-09-15T23:55:42.230957+0000","last_clean":"2024-09-15T23:55:42.230957+0000","last_became_active":"2024-09-15T23:55:42.223829+0000","last_became_peered":"2024-09-15T23:55:42.223829+0000","last_unstale":"2024-09-15T23:55:42.230957+0000","last_undegraded":"2024-09-15T23:55:42.230957+0000","last_fullsized":"2024-09-15T23:55:42.230957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.446581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222947+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:42.222947+0000","last_peered":"2024-09-15T23:55:42.222947+0000","last_clean":"2024-09-15T23:55:42.222947+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:42.222947+0000","last_undegraded":"2024-09-15T23:55:42.222947+0000","last_fullsized":"2024-09-15T23:55:42.222947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":71862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":658265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:46.143 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:46.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.277+0000 7f013fd9f640 1 Processor -- start 2024-09-15T23:55:46.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.277+0000 7f013fd9f640 1 -- start start 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.277+0000 7f013fd9f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0138133640 0x7f013813b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.277+0000 7f013fd9f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380a16c0 con 0x7f01380a39c0 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.277+0000 7f013fd9f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f01380a1490 con 0x7f0138133640 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013d33a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0138133640 0x7f013813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013db3b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f01380a39c0 0x7f0138132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35542/0 (socket says 172.21.15.121:35542) 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013d33a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0138133640 0x7f013813b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36494/0 (socket says 172.21.15.121:36494) 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013db3b640 1 -- 172.21.15.121:0/3313903491 learned_addr learned my addr 172.21.15.121:0/3313903491 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:46.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013d33a640 1 -- 172.21.15.121:0/3313903491 >> v1:172.21.15.121:6789/0 conn(0x7f01380a39c0 legacy=0x7f0138132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013d33a640 1 -- 172.21.15.121:0/3313903491 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01380a4010 con 0x7f0138133640 2024-09-15T23:55:46.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013cb39640 1 -- 172.21.15.121:0/3313903491 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081869791 0 0) 0x7f01380a16c0 con 0x7f01380a39c0 2024-09-15T23:55:46.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.278+0000 7f013d33a640 1 --2- 172.21.15.121:0/3313903491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0138133640 0x7f013813b270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0128009720 tx=0x7f012802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28fcf98d4d063a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013cb39640 1 -- 172.21.15.121:0/3313903491 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0128037070 con 0x7f0138133640 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013cb39640 1 -- 172.21.15.121:0/3313903491 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012802ad90 con 0x7f0138133640 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013cb39640 1 -- 172.21.15.121:0/3313903491 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0128032590 con 0x7f0138133640 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 -- 172.21.15.121:0/3313903491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0138133640 msgr2=0x7f013813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3313903491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0138133640 0x7f013813b270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0128009720 tx=0x7f012802a110 comp rx=0 tx=0).stop 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 -- 172.21.15.121:0/3313903491 shutdown_connections 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3313903491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0138133640 0x7f013813b270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 -- 172.21.15.121:0/3313903491 >> 172.21.15.121:0/3313903491 conn(0x7f01380a85e0 msgr2=0x7f01380a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 -- 172.21.15.121:0/3313903491 shutdown_connections 2024-09-15T23:55:46.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.279+0000 7f013fd9f640 1 -- 172.21.15.121:0/3313903491 wait complete. 2024-09-15T23:55:46.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.280+0000 7f013fd9f640 1 Processor -- start 2024-09-15T23:55:46.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.280+0000 7f013fd9f640 1 -- start start 2024-09-15T23:55:46.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013fd9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013fd9f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01381329c0 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013db3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013db3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36498/0 (socket says 172.21.15.121:36498) 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013db3b640 1 -- 172.21.15.121:0/3139247191 learned_addr learned my addr 172.21.15.121:0/3139247191 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013db3b640 1 -- 172.21.15.121:0/3139247191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013809df80 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013db3b640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f013400c370 tx=0x7f013400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0134007410 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01340075d0 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013809c420 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0134004950 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.281+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013809c140 con 0x7f01380a39c0 2024-09-15T23:55:46.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.282+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0134011070 con 0x7f01380a39c0 2024-09-15T23:55:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.282+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01380a2340 con 0x7f01380a39c0 2024-09-15T23:55:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.282+0000 7f012e7fc640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 0x7f011c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.283+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f013404adb0 con 0x7f01380a39c0 2024-09-15T23:55:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.283+0000 7f013d33a640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 0x7f011c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.283+0000 7f013d33a640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 0x7f011c03a760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f012802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.287+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f013401cbd0 con 0x7f01380a39c0 2024-09-15T23:55:46.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.446+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01381313b0 con 0x7f011c0382a0 2024-09-15T23:55:46.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.452+0000 7f012e7fc640 1 -- 172.21.15.121:0/3139247191 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240666 (secure 0 0 0) 0x7f01280093c0 con 0x7f011c0382a0 2024-09-15T23:55:46.455 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:46.456 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 msgr2=0x7f011c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 0x7f011c03a760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0128034000 tx=0x7f012802e000 comp rx=0 tx=0).stop 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 msgr2=0x7f013809ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f013400c370 tx=0x7f013400c830 comp rx=0 tx=0).stop 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 shutdown_connections 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f011c0382a0 0x7f011c03a760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 --2- 172.21.15.121:0/3139247191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01380a39c0 0x7f013809ac30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 >> 172.21.15.121:0/3139247191 conn(0x7f01380a85e0 msgr2=0x7f01380a68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 shutdown_connections 2024-09-15T23:55:46.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.455+0000 7f013fd9f640 1 -- 172.21.15.121:0/3139247191 wait complete. 2024-09-15T23:55:46.466 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-15T23:55:46.028844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87052,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028468,"statfs":{"total":289910292480,"available":289821151232,"internally_reserved":0,"allocated":1843200,"data_stored":1392357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213470+0000","last_change":"2024-09-15T23:55:42.213470+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213470+0000","last_undegraded":"2024-09-15T23:55:42.213470+0000","last_fullsized":"2024-09-15T23:55:42.213470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215439+0000","last_change":"2024-09-15T23:55:42.215439+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215439+0000","last_undegraded":"2024-09-15T23:55:42.215439+0000","last_fullsized":"2024-09-15T23:55:42.215439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215816+0000","last_change":"2024-09-15T23:55:42.215816+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215816+0000","last_undegraded":"2024-09-15T23:55:42.215816+0000","last_fullsized":"2024-09-15T23:55:42.215816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215244+0000","last_change":"2024-09-15T23:55:42.215244+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215244+0000","last_undegraded":"2024-09-15T23:55:42.215244+0000","last_fullsized":"2024-09-15T23:55:42.215244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214155+0000","last_change":"2024-09-15T23:55:42.214155+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214155+0000","last_undegraded":"2024-09-15T23:55:42.214155+0000","last_fullsized":"2024-09-15T23:55:42.214155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215980+0000","last_change":"2024-09-15T23:55:42.215980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215980+0000","last_undegraded":"2024-09-15T23:55:42.215980+0000","last_fullsized":"2024-09-15T23:55:42.215980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212654+0000","last_change":"2024-09-15T23:55:42.212654+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212654+0000","last_undegraded":"2024-09-15T23:55:42.212654+0000","last_fullsized":"2024-09-15T23:55:42.212654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213914+0000","last_change":"2024-09-15T23:55:42.213914+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213914+0000","last_undegraded":"2024-09-15T23:55:42.213914+0000","last_fullsized":"2024-09-15T23:55:42.213914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.219578+0000","last_change":"2024-09-15T23:55:42.219578+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.219578+0000","last_undegraded":"2024-09-15T23:55:42.219578+0000","last_fullsized":"2024-09-15T23:55:42.219578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215419+0000","last_change":"2024-09-15T23:55:42.215419+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215419+0000","last_undegraded":"2024-09-15T23:55:42.215419+0000","last_fullsized":"2024-09-15T23:55:42.215419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211647+0000","last_change":"2024-09-15T23:55:42.211647+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211647+0000","last_undegraded":"2024-09-15T23:55:42.211647+0000","last_fullsized":"2024-09-15T23:55:42.211647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212138+0000","last_change":"2024-09-15T23:55:42.212138+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212138+0000","last_undegraded":"2024-09-15T23:55:42.212138+0000","last_fullsized":"2024-09-15T23:55:42.212138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213705+0000","last_change":"2024-09-15T23:55:42.213705+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213705+0000","last_undegraded":"2024-09-15T23:55:42.213705+0000","last_fullsized":"2024-09-15T23:55:42.213705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210492+0000","last_change":"2024-09-15T23:55:42.210492+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210492+0000","last_undegraded":"2024-09-15T23:55:42.210492+0000","last_fullsized":"2024-09-15T23:55:42.210492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212489+0000","last_change":"2024-09-15T23:55:42.212489+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212489+0000","last_undegraded":"2024-09-15T23:55:42.212489+0000","last_fullsized":"2024-09-15T23:55:42.212489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214921+0000","last_change":"2024-09-15T23:55:42.214921+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214921+0000","last_undegraded":"2024-09-15T23:55:42.214921+0000","last_fullsized":"2024-09-15T23:55:42.214921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212673+0000","last_change":"2024-09-15T23:55:42.212673+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212673+0000","last_undegraded":"2024-09-15T23:55:42.212673+0000","last_fullsized":"2024-09-15T23:55:42.212673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215050+0000","last_change":"2024-09-15T23:55:42.215050+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215050+0000","last_undegraded":"2024-09-15T23:55:42.215050+0000","last_fullsized":"2024-09-15T23:55:42.215050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211272+0000","last_change":"2024-09-15T23:55:42.211272+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211272+0000","last_undegraded":"2024-09-15T23:55:42.211272+0000","last_fullsized":"2024-09-15T23:55:42.211272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213134+0000","last_change":"2024-09-15T23:55:42.213134+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213134+0000","last_undegraded":"2024-09-15T23:55:42.213134+0000","last_fullsized":"2024-09-15T23:55:42.213134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211389+0000","last_change":"2024-09-15T23:55:42.211389+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211389+0000","last_undegraded":"2024-09-15T23:55:42.211389+0000","last_fullsized":"2024-09-15T23:55:42.211389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213079+0000","last_change":"2024-09-15T23:55:42.213079+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213079+0000","last_undegraded":"2024-09-15T23:55:42.213079+0000","last_fullsized":"2024-09-15T23:55:42.213079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210218+0000","last_change":"2024-09-15T23:55:42.210218+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210218+0000","last_undegraded":"2024-09-15T23:55:42.210218+0000","last_fullsized":"2024-09-15T23:55:42.210218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213299+0000","last_change":"2024-09-15T23:55:42.213299+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213299+0000","last_undegraded":"2024-09-15T23:55:42.213299+0000","last_fullsized":"2024-09-15T23:55:42.213299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222637+0000","last_change":"2024-09-15T23:55:42.222637+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222637+0000","last_undegraded":"2024-09-15T23:55:42.222637+0000","last_fullsized":"2024-09-15T23:55:42.222637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212919+0000","last_change":"2024-09-15T23:55:42.212919+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212919+0000","last_undegraded":"2024-09-15T23:55:42.212919+0000","last_fullsized":"2024-09-15T23:55:42.212919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218426+0000","last_change":"2024-09-15T23:55:42.218426+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218426+0000","last_undegraded":"2024-09-15T23:55:42.218426+0000","last_fullsized":"2024-09-15T23:55:42.218426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211019+0000","last_change":"2024-09-15T23:55:42.211019+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211019+0000","last_undegraded":"2024-09-15T23:55:42.211019+0000","last_fullsized":"2024-09-15T23:55:42.211019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210810+0000","last_change":"2024-09-15T23:55:42.210810+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210810+0000","last_undegraded":"2024-09-15T23:55:42.210810+0000","last_fullsized":"2024-09-15T23:55:42.210810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209956+0000","last_change":"2024-09-15T23:55:42.209956+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209956+0000","last_undegraded":"2024-09-15T23:55:42.209956+0000","last_fullsized":"2024-09-15T23:55:42.209956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209530+0000","last_change":"2024-09-15T23:55:42.209530+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209530+0000","last_undegraded":"2024-09-15T23:55:42.209530+0000","last_fullsized":"2024-09-15T23:55:42.209530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212168+0000","last_change":"2024-09-15T23:55:42.212168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212168+0000","last_undegraded":"2024-09-15T23:55:42.212168+0000","last_fullsized":"2024-09-15T23:55:42.212168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214625+0000","last_change":"2024-09-15T23:55:42.214625+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214625+0000","last_undegraded":"2024-09-15T23:55:42.214625+0000","last_fullsized":"2024-09-15T23:55:42.214625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234608+0000","last_change":"2024-09-15T23:55:42.233492+0000","last_active":"2024-09-15T23:55:42.234608+0000","last_peered":"2024-09-15T23:55:42.234608+0000","last_clean":"2024-09-15T23:55:42.234608+0000","last_became_active":"2024-09-15T23:55:42.233237+0000","last_became_peered":"2024-09-15T23:55:42.233237+0000","last_unstale":"2024-09-15T23:55:42.234608+0000","last_undegraded":"2024-09-15T23:55:42.234608+0000","last_fullsized":"2024-09-15T23:55:42.234608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:38.510269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209589+0000","last_change":"2024-09-15T23:55:42.209589+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209589+0000","last_undegraded":"2024-09-15T23:55:42.209589+0000","last_fullsized":"2024-09-15T23:55:42.209589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231304+0000","last_change":"2024-09-15T23:55:42.227655+0000","last_active":"2024-09-15T23:55:42.231304+0000","last_peered":"2024-09-15T23:55:42.231304+0000","last_clean":"2024-09-15T23:55:42.231304+0000","last_became_active":"2024-09-15T23:55:42.227114+0000","last_became_peered":"2024-09-15T23:55:42.227114+0000","last_unstale":"2024-09-15T23:55:42.231304+0000","last_undegraded":"2024-09-15T23:55:42.231304+0000","last_fullsized":"2024-09-15T23:55:42.231304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:45.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210674+0000","last_change":"2024-09-15T23:55:42.210674+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210674+0000","last_undegraded":"2024-09-15T23:55:42.210674+0000","last_fullsized":"2024-09-15T23:55:42.210674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231397+0000","last_change":"2024-09-15T23:55:42.227590+0000","last_active":"2024-09-15T23:55:42.231397+0000","last_peered":"2024-09-15T23:55:42.231397+0000","last_clean":"2024-09-15T23:55:42.231397+0000","last_became_active":"2024-09-15T23:55:42.227300+0000","last_became_peered":"2024-09-15T23:55:42.227300+0000","last_unstale":"2024-09-15T23:55:42.231397+0000","last_undegraded":"2024-09-15T23:55:42.231397+0000","last_fullsized":"2024-09-15T23:55:42.231397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:35.069585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218037+0000","last_change":"2024-09-15T23:55:42.218037+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218037+0000","last_undegraded":"2024-09-15T23:55:42.218037+0000","last_fullsized":"2024-09-15T23:55:42.218037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233608+0000","last_change":"2024-09-15T23:55:42.229229+0000","last_active":"2024-09-15T23:55:42.233608+0000","last_peered":"2024-09-15T23:55:42.233608+0000","last_clean":"2024-09-15T23:55:42.233608+0000","last_became_active":"2024-09-15T23:55:42.228892+0000","last_became_peered":"2024-09-15T23:55:42.228892+0000","last_unstale":"2024-09-15T23:55:42.233608+0000","last_undegraded":"2024-09-15T23:55:42.233608+0000","last_fullsized":"2024-09-15T23:55:42.233608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:52.300497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215633+0000","last_change":"2024-09-15T23:55:42.215633+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215633+0000","last_undegraded":"2024-09-15T23:55:42.215633+0000","last_fullsized":"2024-09-15T23:55:42.215633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230619+0000","last_change":"2024-09-15T23:55:42.228095+0000","last_active":"2024-09-15T23:55:42.230619+0000","last_peered":"2024-09-15T23:55:42.230619+0000","last_clean":"2024-09-15T23:55:42.230619+0000","last_became_active":"2024-09-15T23:55:42.227826+0000","last_became_peered":"2024-09-15T23:55:42.227826+0000","last_unstale":"2024-09-15T23:55:42.230619+0000","last_undegraded":"2024-09-15T23:55:42.230619+0000","last_fullsized":"2024-09-15T23:55:42.230619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:40.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211390+0000","last_change":"2024-09-15T23:55:42.211390+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211390+0000","last_undegraded":"2024-09-15T23:55:42.211390+0000","last_fullsized":"2024-09-15T23:55:42.211390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.226388+0000","last_change":"2024-09-15T23:55:42.223388+0000","last_active":"2024-09-15T23:55:42.226388+0000","last_peered":"2024-09-15T23:55:42.226388+0000","last_clean":"2024-09-15T23:55:42.226388+0000","last_became_active":"2024-09-15T23:55:42.223117+0000","last_became_peered":"2024-09-15T23:55:42.223117+0000","last_unstale":"2024-09-15T23:55:42.226388+0000","last_undegraded":"2024-09-15T23:55:42.226388+0000","last_fullsized":"2024-09-15T23:55:42.226388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:57.599146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218672+0000","last_change":"2024-09-15T23:55:42.218672+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218672+0000","last_undegraded":"2024-09-15T23:55:42.218672+0000","last_fullsized":"2024-09-15T23:55:42.218672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.219278+0000","last_change":"2024-09-15T23:55:42.218000+0000","last_active":"2024-09-15T23:55:42.219278+0000","last_peered":"2024-09-15T23:55:42.219278+0000","last_clean":"2024-09-15T23:55:42.219278+0000","last_became_active":"2024-09-15T23:55:42.217248+0000","last_became_peered":"2024-09-15T23:55:42.217248+0000","last_unstale":"2024-09-15T23:55:42.219278+0000","last_undegraded":"2024-09-15T23:55:42.219278+0000","last_fullsized":"2024-09-15T23:55:42.219278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:12.128635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216432+0000","last_change":"2024-09-15T23:55:42.216432+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216432+0000","last_undegraded":"2024-09-15T23:55:42.216432+0000","last_fullsized":"2024-09-15T23:55:42.216432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233710+0000","last_change":"2024-09-15T23:55:42.230514+0000","last_active":"2024-09-15T23:55:42.233710+0000","last_peered":"2024-09-15T23:55:42.233710+0000","last_clean":"2024-09-15T23:55:42.233710+0000","last_became_active":"2024-09-15T23:55:42.228955+0000","last_became_peered":"2024-09-15T23:55:42.228955+0000","last_unstale":"2024-09-15T23:55:42.233710+0000","last_undegraded":"2024-09-15T23:55:42.233710+0000","last_fullsized":"2024-09-15T23:55:42.233710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:20.726368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211600+0000","last_change":"2024-09-15T23:55:42.211600+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211600+0000","last_undegraded":"2024-09-15T23:55:42.211600+0000","last_fullsized":"2024-09-15T23:55:42.211600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234590+0000","last_change":"2024-09-15T23:55:42.233343+0000","last_active":"2024-09-15T23:55:42.234590+0000","last_peered":"2024-09-15T23:55:42.234590+0000","last_clean":"2024-09-15T23:55:42.234590+0000","last_became_active":"2024-09-15T23:55:42.233082+0000","last_became_peered":"2024-09-15T23:55:42.233082+0000","last_unstale":"2024-09-15T23:55:42.234590+0000","last_undegraded":"2024-09-15T23:55:42.234590+0000","last_fullsized":"2024-09-15T23:55:42.234590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:13.962428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209115+0000","last_change":"2024-09-15T23:55:42.209115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209115+0000","last_undegraded":"2024-09-15T23:55:42.209115+0000","last_fullsized":"2024-09-15T23:55:42.209115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218593+0000","last_change":"2024-09-15T23:55:42.217126+0000","last_active":"2024-09-15T23:55:42.218593+0000","last_peered":"2024-09-15T23:55:42.218593+0000","last_clean":"2024-09-15T23:55:42.218593+0000","last_became_active":"2024-09-15T23:55:42.216854+0000","last_became_peered":"2024-09-15T23:55:42.216854+0000","last_unstale":"2024-09-15T23:55:42.218593+0000","last_undegraded":"2024-09-15T23:55:42.218593+0000","last_fullsized":"2024-09-15T23:55:42.218593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:07.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212554+0000","last_change":"2024-09-15T23:55:42.212554+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212554+0000","last_undegraded":"2024-09-15T23:55:42.212554+0000","last_fullsized":"2024-09-15T23:55:42.212554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231359+0000","last_change":"2024-09-15T23:55:42.227422+0000","last_active":"2024-09-15T23:55:42.231359+0000","last_peered":"2024-09-15T23:55:42.231359+0000","last_clean":"2024-09-15T23:55:42.231359+0000","last_became_active":"2024-09-15T23:55:42.227135+0000","last_became_peered":"2024-09-15T23:55:42.227135+0000","last_unstale":"2024-09-15T23:55:42.231359+0000","last_undegraded":"2024-09-15T23:55:42.231359+0000","last_fullsized":"2024-09-15T23:55:42.231359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:47.730774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210852+0000","last_change":"2024-09-15T23:55:42.210852+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210852+0000","last_undegraded":"2024-09-15T23:55:42.210852+0000","last_fullsized":"2024-09-15T23:55:42.210852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234713+0000","last_change":"2024-09-15T23:55:42.232680+0000","last_active":"2024-09-15T23:55:42.234713+0000","last_peered":"2024-09-15T23:55:42.234713+0000","last_clean":"2024-09-15T23:55:42.234713+0000","last_became_active":"2024-09-15T23:55:42.232415+0000","last_became_peered":"2024-09-15T23:55:42.232415+0000","last_unstale":"2024-09-15T23:55:42.234713+0000","last_undegraded":"2024-09-15T23:55:42.234713+0000","last_fullsized":"2024-09-15T23:55:42.234713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.986284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212729+0000","last_change":"2024-09-15T23:55:42.212729+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212729+0000","last_undegraded":"2024-09-15T23:55:42.212729+0000","last_fullsized":"2024-09-15T23:55:42.212729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233516+0000","last_change":"2024-09-15T23:55:42.229038+0000","last_active":"2024-09-15T23:55:42.233516+0000","last_peered":"2024-09-15T23:55:42.233516+0000","last_clean":"2024-09-15T23:55:42.233516+0000","last_became_active":"2024-09-15T23:55:42.228474+0000","last_became_peered":"2024-09-15T23:55:42.228474+0000","last_unstale":"2024-09-15T23:55:42.233516+0000","last_undegraded":"2024-09-15T23:55:42.233516+0000","last_fullsized":"2024-09-15T23:55:42.233516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:32.453009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210217+0000","last_change":"2024-09-15T23:55:42.210217+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210217+0000","last_undegraded":"2024-09-15T23:55:42.210217+0000","last_fullsized":"2024-09-15T23:55:42.210217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227583+0000","last_change":"2024-09-15T23:55:42.226400+0000","last_active":"2024-09-15T23:55:42.227583+0000","last_peered":"2024-09-15T23:55:42.227583+0000","last_clean":"2024-09-15T23:55:42.227583+0000","last_became_active":"2024-09-15T23:55:42.226109+0000","last_became_peered":"2024-09-15T23:55:42.226109+0000","last_unstale":"2024-09-15T23:55:42.227583+0000","last_undegraded":"2024-09-15T23:55:42.227583+0000","last_fullsized":"2024-09-15T23:55:42.227583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:04.138219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211783+0000","last_change":"2024-09-15T23:55:42.211783+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211783+0000","last_undegraded":"2024-09-15T23:55:42.211783+0000","last_fullsized":"2024-09-15T23:55:42.211783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.221450+0000","last_change":"2024-09-15T23:55:42.220273+0000","last_active":"2024-09-15T23:55:42.221450+0000","last_peered":"2024-09-15T23:55:42.221450+0000","last_clean":"2024-09-15T23:55:42.221450+0000","last_became_active":"2024-09-15T23:55:42.219755+0000","last_became_peered":"2024-09-15T23:55:42.219755+0000","last_unstale":"2024-09-15T23:55:42.221450+0000","last_undegraded":"2024-09-15T23:55:42.221450+0000","last_fullsized":"2024-09-15T23:55:42.221450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:10.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216043+0000","last_change":"2024-09-15T23:55:42.216043+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216043+0000","last_undegraded":"2024-09-15T23:55:42.216043+0000","last_fullsized":"2024-09-15T23:55:42.216043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.235125+0000","last_change":"2024-09-15T23:55:42.233298+0000","last_active":"2024-09-15T23:55:42.235125+0000","last_peered":"2024-09-15T23:55:42.235125+0000","last_clean":"2024-09-15T23:55:42.235125+0000","last_became_active":"2024-09-15T23:55:42.233077+0000","last_became_peered":"2024-09-15T23:55:42.233077+0000","last_unstale":"2024-09-15T23:55:42.235125+0000","last_undegraded":"2024-09-15T23:55:42.235125+0000","last_fullsized":"2024-09-15T23:55:42.235125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:50.606047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212496+0000","last_change":"2024-09-15T23:55:42.212496+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212496+0000","last_undegraded":"2024-09-15T23:55:42.212496+0000","last_fullsized":"2024-09-15T23:55:42.212496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227624+0000","last_change":"2024-09-15T23:55:42.226711+0000","last_active":"2024-09-15T23:55:42.227624+0000","last_peered":"2024-09-15T23:55:42.227624+0000","last_clean":"2024-09-15T23:55:42.227624+0000","last_became_active":"2024-09-15T23:55:42.226436+0000","last_became_peered":"2024-09-15T23:55:42.226436+0000","last_unstale":"2024-09-15T23:55:42.227624+0000","last_undegraded":"2024-09-15T23:55:42.227624+0000","last_fullsized":"2024-09-15T23:55:42.227624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:38.572689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222256+0000","last_change":"2024-09-15T23:55:42.222256+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222256+0000","last_undegraded":"2024-09-15T23:55:42.222256+0000","last_fullsized":"2024-09-15T23:55:42.222256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233541+0000","last_change":"2024-09-15T23:55:42.229093+0000","last_active":"2024-09-15T23:55:42.233541+0000","last_peered":"2024-09-15T23:55:42.233541+0000","last_clean":"2024-09-15T23:55:42.233541+0000","last_became_active":"2024-09-15T23:55:42.228543+0000","last_became_peered":"2024-09-15T23:55:42.228543+0000","last_unstale":"2024-09-15T23:55:42.233541+0000","last_undegraded":"2024-09-15T23:55:42.233541+0000","last_fullsized":"2024-09-15T23:55:42.233541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:43.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211772+0000","last_change":"2024-09-15T23:55:42.211772+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211772+0000","last_undegraded":"2024-09-15T23:55:42.211772+0000","last_fullsized":"2024-09-15T23:55:42.211772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233496+0000","last_change":"2024-09-15T23:55:42.231292+0000","last_active":"2024-09-15T23:55:42.233496+0000","last_peered":"2024-09-15T23:55:42.233496+0000","last_clean":"2024-09-15T23:55:42.233496+0000","last_became_active":"2024-09-15T23:55:42.230815+0000","last_became_peered":"2024-09-15T23:55:42.230815+0000","last_unstale":"2024-09-15T23:55:42.233496+0000","last_undegraded":"2024-09-15T23:55:42.233496+0000","last_fullsized":"2024-09-15T23:55:42.233496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:20.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210029+0000","last_change":"2024-09-15T23:55:42.210029+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210029+0000","last_undegraded":"2024-09-15T23:55:42.210029+0000","last_fullsized":"2024-09-15T23:55:42.210029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231334+0000","last_change":"2024-09-15T23:55:42.227704+0000","last_active":"2024-09-15T23:55:42.231334+0000","last_peered":"2024-09-15T23:55:42.231334+0000","last_clean":"2024-09-15T23:55:42.231334+0000","last_became_active":"2024-09-15T23:55:42.226981+0000","last_became_peered":"2024-09-15T23:55:42.226981+0000","last_unstale":"2024-09-15T23:55:42.231334+0000","last_undegraded":"2024-09-15T23:55:42.231334+0000","last_fullsized":"2024-09-15T23:55:42.231334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:02.879850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210168+0000","last_change":"2024-09-15T23:55:42.210168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210168+0000","last_undegraded":"2024-09-15T23:55:42.210168+0000","last_fullsized":"2024-09-15T23:55:42.210168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231424+0000","last_change":"2024-09-15T23:55:42.228234+0000","last_active":"2024-09-15T23:55:42.231424+0000","last_peered":"2024-09-15T23:55:42.231424+0000","last_clean":"2024-09-15T23:55:42.231424+0000","last_became_active":"2024-09-15T23:55:42.228025+0000","last_became_peered":"2024-09-15T23:55:42.228025+0000","last_unstale":"2024-09-15T23:55:42.231424+0000","last_undegraded":"2024-09-15T23:55:42.231424+0000","last_fullsized":"2024-09-15T23:55:42.231424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:15.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210988+0000","last_change":"2024-09-15T23:55:42.210988+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210988+0000","last_undegraded":"2024-09-15T23:55:42.210988+0000","last_fullsized":"2024-09-15T23:55:42.210988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233685+0000","last_change":"2024-09-15T23:55:42.230626+0000","last_active":"2024-09-15T23:55:42.233685+0000","last_peered":"2024-09-15T23:55:42.233685+0000","last_clean":"2024-09-15T23:55:42.233685+0000","last_became_active":"2024-09-15T23:55:42.229558+0000","last_became_peered":"2024-09-15T23:55:42.229558+0000","last_unstale":"2024-09-15T23:55:42.233685+0000","last_undegraded":"2024-09-15T23:55:42.233685+0000","last_fullsized":"2024-09-15T23:55:42.233685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:53.004728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211320+0000","last_change":"2024-09-15T23:55:42.211320+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211320+0000","last_undegraded":"2024-09-15T23:55:42.211320+0000","last_fullsized":"2024-09-15T23:55:42.211320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233985+0000","last_change":"2024-09-15T23:55:42.232416+0000","last_active":"2024-09-15T23:55:42.233985+0000","last_peered":"2024-09-15T23:55:42.233985+0000","last_clean":"2024-09-15T23:55:42.233985+0000","last_became_active":"2024-09-15T23:55:42.232148+0000","last_became_peered":"2024-09-15T23:55:42.232148+0000","last_unstale":"2024-09-15T23:55:42.233985+0000","last_undegraded":"2024-09-15T23:55:42.233985+0000","last_fullsized":"2024-09-15T23:55:42.233985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.743577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215617+0000","last_change":"2024-09-15T23:55:42.215617+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215617+0000","last_undegraded":"2024-09-15T23:55:42.215617+0000","last_fullsized":"2024-09-15T23:55:42.215617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231135+0000","last_change":"2024-09-15T23:55:42.229509+0000","last_active":"2024-09-15T23:55:42.231135+0000","last_peered":"2024-09-15T23:55:42.231135+0000","last_clean":"2024-09-15T23:55:42.231135+0000","last_became_active":"2024-09-15T23:55:42.229201+0000","last_became_peered":"2024-09-15T23:55:42.229201+0000","last_unstale":"2024-09-15T23:55:42.231135+0000","last_undegraded":"2024-09-15T23:55:42.231135+0000","last_fullsized":"2024-09-15T23:55:42.231135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:44.593277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212102+0000","last_change":"2024-09-15T23:55:42.212102+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212102+0000","last_undegraded":"2024-09-15T23:55:42.212102+0000","last_fullsized":"2024-09-15T23:55:42.212102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233982+0000","last_change":"2024-09-15T23:55:42.232445+0000","last_active":"2024-09-15T23:55:42.233982+0000","last_peered":"2024-09-15T23:55:42.233982+0000","last_clean":"2024-09-15T23:55:42.233982+0000","last_became_active":"2024-09-15T23:55:42.232171+0000","last_became_peered":"2024-09-15T23:55:42.232171+0000","last_unstale":"2024-09-15T23:55:42.233982+0000","last_undegraded":"2024-09-15T23:55:42.233982+0000","last_fullsized":"2024-09-15T23:55:42.233982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:52.279847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212121+0000","last_change":"2024-09-15T23:55:42.212121+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212121+0000","last_undegraded":"2024-09-15T23:55:42.212121+0000","last_fullsized":"2024-09-15T23:55:42.212121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231280+0000","last_change":"2024-09-15T23:55:42.227428+0000","last_active":"2024-09-15T23:55:42.231280+0000","last_peered":"2024-09-15T23:55:42.231280+0000","last_clean":"2024-09-15T23:55:42.231280+0000","last_became_active":"2024-09-15T23:55:42.227111+0000","last_became_peered":"2024-09-15T23:55:42.227111+0000","last_unstale":"2024-09-15T23:55:42.231280+0000","last_undegraded":"2024-09-15T23:55:42.231280+0000","last_fullsized":"2024-09-15T23:55:42.231280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:59.483861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210404+0000","last_change":"2024-09-15T23:55:42.210404+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210404+0000","last_undegraded":"2024-09-15T23:55:42.210404+0000","last_fullsized":"2024-09-15T23:55:42.210404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227796+0000","last_change":"2024-09-15T23:55:42.223960+0000","last_active":"2024-09-15T23:55:42.227796+0000","last_peered":"2024-09-15T23:55:42.227796+0000","last_clean":"2024-09-15T23:55:42.227796+0000","last_became_active":"2024-09-15T23:55:42.223701+0000","last_became_peered":"2024-09-15T23:55:42.223701+0000","last_unstale":"2024-09-15T23:55:42.227796+0000","last_undegraded":"2024-09-15T23:55:42.227796+0000","last_fullsized":"2024-09-15T23:55:42.227796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:38.030906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.208847+0000","last_change":"2024-09-15T23:55:42.208847+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.208847+0000","last_undegraded":"2024-09-15T23:55:42.208847+0000","last_fullsized":"2024-09-15T23:55:42.208847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218320+0000","last_change":"2024-09-15T23:55:42.216705+0000","last_active":"2024-09-15T23:55:42.218320+0000","last_peered":"2024-09-15T23:55:42.218320+0000","last_clean":"2024-09-15T23:55:42.218320+0000","last_became_active":"2024-09-15T23:55:42.216416+0000","last_became_peered":"2024-09-15T23:55:42.216416+0000","last_unstale":"2024-09-15T23:55:42.218320+0000","last_undegraded":"2024-09-15T23:55:42.218320+0000","last_fullsized":"2024-09-15T23:55:42.218320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:50.897137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209955+0000","last_change":"2024-09-15T23:55:42.209955+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209955+0000","last_undegraded":"2024-09-15T23:55:42.209955+0000","last_fullsized":"2024-09-15T23:55:42.209955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234708+0000","last_change":"2024-09-15T23:55:42.232517+0000","last_active":"2024-09-15T23:55:42.234708+0000","last_peered":"2024-09-15T23:55:42.234708+0000","last_clean":"2024-09-15T23:55:42.234708+0000","last_became_active":"2024-09-15T23:55:42.232227+0000","last_became_peered":"2024-09-15T23:55:42.232227+0000","last_unstale":"2024-09-15T23:55:42.234708+0000","last_undegraded":"2024-09-15T23:55:42.234708+0000","last_fullsized":"2024-09-15T23:55:42.234708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.199261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209575+0000","last_change":"2024-09-15T23:55:42.209575+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209575+0000","last_undegraded":"2024-09-15T23:55:42.209575+0000","last_fullsized":"2024-09-15T23:55:42.209575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222296+0000","last_change":"2024-09-15T23:55:42.220495+0000","last_active":"2024-09-15T23:55:42.222296+0000","last_peered":"2024-09-15T23:55:42.222296+0000","last_clean":"2024-09-15T23:55:42.222296+0000","last_became_active":"2024-09-15T23:55:42.219865+0000","last_became_peered":"2024-09-15T23:55:42.219865+0000","last_unstale":"2024-09-15T23:55:42.222296+0000","last_undegraded":"2024-09-15T23:55:42.222296+0000","last_fullsized":"2024-09-15T23:55:42.222296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:38.730404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212980+0000","last_change":"2024-09-15T23:55:42.212980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212980+0000","last_undegraded":"2024-09-15T23:55:42.212980+0000","last_fullsized":"2024-09-15T23:55:42.212980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231367+0000","last_change":"2024-09-15T23:55:42.227968+0000","last_active":"2024-09-15T23:55:42.231367+0000","last_peered":"2024-09-15T23:55:42.231367+0000","last_clean":"2024-09-15T23:55:42.231367+0000","last_became_active":"2024-09-15T23:55:42.227688+0000","last_became_peered":"2024-09-15T23:55:42.227688+0000","last_unstale":"2024-09-15T23:55:42.231367+0000","last_undegraded":"2024-09-15T23:55:42.231367+0000","last_fullsized":"2024-09-15T23:55:42.231367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:14.508276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212115+0000","last_change":"2024-09-15T23:55:42.212115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212115+0000","last_undegraded":"2024-09-15T23:55:42.212115+0000","last_fullsized":"2024-09-15T23:55:42.212115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230957+0000","last_change":"2024-09-15T23:55:42.224100+0000","last_active":"2024-09-15T23:55:42.230957+0000","last_peered":"2024-09-15T23:55:42.230957+0000","last_clean":"2024-09-15T23:55:42.230957+0000","last_became_active":"2024-09-15T23:55:42.223829+0000","last_became_peered":"2024-09-15T23:55:42.223829+0000","last_unstale":"2024-09-15T23:55:42.230957+0000","last_undegraded":"2024-09-15T23:55:42.230957+0000","last_fullsized":"2024-09-15T23:55:42.230957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.446581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222947+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:42.222947+0000","last_peered":"2024-09-15T23:55:42.222947+0000","last_clean":"2024-09-15T23:55:42.222947+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:42.222947+0000","last_undegraded":"2024-09-15T23:55:42.222947+0000","last_fullsized":"2024-09-15T23:55:42.222947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":71862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":658265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:46.470 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:46.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.604+0000 7f581f711640 1 Processor -- start 2024-09-15T23:55:46.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.604+0000 7f581f711640 1 -- start start 2024-09-15T23:55:46.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581f711640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5818135b50 0x7f581809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581f711640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581809b020 con 0x7f5818135f30 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581f711640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f581809b310 con 0x7f5818135b50 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581d4ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5818135b50 0x7f581809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581ccac640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f5818135f30 0x7f58180a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35546/0 (socket says 172.21.15.121:35546) 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581d4ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f5818135b50 0x7f581809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36514/0 (socket says 172.21.15.121:36514) 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581ccac640 1 -- 172.21.15.121:0/2856534571 learned_addr learned my addr 172.21.15.121:0/2856534571 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581d4ad640 1 -- 172.21.15.121:0/2856534571 >> v1:172.21.15.121:6789/0 conn(0x7f5818135f30 legacy=0x7f58180a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f580ffff640 1 -- 172.21.15.121:0/2856534571 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992126952 0 0) 0x7f581809b020 con 0x7f5818135f30 2024-09-15T23:55:46.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.605+0000 7f581d4ad640 1 -- 172.21.15.121:0/2856534571 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58180a08c0 con 0x7f5818135b50 2024-09-15T23:55:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.606+0000 7f581d4ad640 1 --2- 172.21.15.121:0/2856534571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f581809aae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5808009720 tx=0x7f580802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c652d13fb51a927 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.606+0000 7f580ffff640 1 -- 172.21.15.121:0/2856534571 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808037070 con 0x7f5818135b50 2024-09-15T23:55:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.606+0000 7f580ffff640 1 -- 172.21.15.121:0/2856534571 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580802ae20 con 0x7f5818135b50 2024-09-15T23:55:46.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.606+0000 7f580ffff640 1 -- 172.21.15.121:0/2856534571 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808032590 con 0x7f5818135b50 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 -- 172.21.15.121:0/2856534571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 msgr2=0x7f581809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 --2- 172.21.15.121:0/2856534571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f581809aae0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5808009720 tx=0x7f580802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 -- 172.21.15.121:0/2856534571 shutdown_connections 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 --2- 172.21.15.121:0/2856534571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f581809aae0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 -- 172.21.15.121:0/2856534571 >> 172.21.15.121:0/2856534571 conn(0x7f58180a85e0 msgr2=0x7f58180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 -- 172.21.15.121:0/2856534571 shutdown_connections 2024-09-15T23:55:46.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.607+0000 7f581f711640 1 -- 172.21.15.121:0/2856534571 wait complete. 2024-09-15T23:55:46.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581f711640 1 Processor -- start 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581f711640 1 -- start start 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581f711640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581f711640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f58180a5430 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581d4ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581d4ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36520/0 (socket says 172.21.15.121:36520) 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.608+0000 7f581d4ad640 1 -- 172.21.15.121:0/1224167631 learned_addr learned my addr 172.21.15.121:0/1224167631 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f581d4ad640 1 -- 172.21.15.121:0/1224167631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58181cc120 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f581d4ad640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5808035040 tx=0x7f58080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808037040 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5808032e30 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5818123300 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808004160 con 0x7f5818135b50 2024-09-15T23:55:46.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.609+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5818122080 con 0x7f5818135b50 2024-09-15T23:55:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.610+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f580803a040 con 0x7f5818135b50 2024-09-15T23:55:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.610+0000 7f580dffb640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 0x7f57fc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.610+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818122ff0 con 0x7f5818135b50 2024-09-15T23:55:46.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.610+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f580806bb30 con 0x7f5818135b50 2024-09-15T23:55:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.610+0000 7f581ccac640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 0x7f57fc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.611+0000 7f581ccac640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 0x7f57fc03a760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f5814007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.615+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5808042020 con 0x7f5818135b50 2024-09-15T23:55:46.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.778+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58181cc420 con 0x7f57fc0382a0 2024-09-15T23:55:46.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.784+0000 7f580dffb640 1 -- 172.21.15.121:0/1224167631 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240666 (secure 0 0 0) 0x7f58140070d0 con 0x7f57fc0382a0 2024-09-15T23:55:46.786 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:46.812 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 msgr2=0x7f57fc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 0x7f57fc03a760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f5814007910 comp rx=0 tx=0).stop 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 msgr2=0x7f58181cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5808035040 tx=0x7f58080046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 shutdown_connections 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f57fc0382a0 0x7f57fc03a760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 --2- 172.21.15.121:0/1224167631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5818135b50 0x7f58181cc810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 >> 172.21.15.121:0/1224167631 conn(0x7f58180a85e0 msgr2=0x7f58180a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 shutdown_connections 2024-09-15T23:55:46.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.787+0000 7f581f711640 1 -- 172.21.15.121:0/1224167631 wait complete. 2024-09-15T23:55:46.816 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-15T23:55:46.028844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87052,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028468,"statfs":{"total":289910292480,"available":289821151232,"internally_reserved":0,"allocated":1843200,"data_stored":1392357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213470+0000","last_change":"2024-09-15T23:55:42.213470+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213470+0000","last_undegraded":"2024-09-15T23:55:42.213470+0000","last_fullsized":"2024-09-15T23:55:42.213470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215439+0000","last_change":"2024-09-15T23:55:42.215439+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215439+0000","last_undegraded":"2024-09-15T23:55:42.215439+0000","last_fullsized":"2024-09-15T23:55:42.215439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215816+0000","last_change":"2024-09-15T23:55:42.215816+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215816+0000","last_undegraded":"2024-09-15T23:55:42.215816+0000","last_fullsized":"2024-09-15T23:55:42.215816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215244+0000","last_change":"2024-09-15T23:55:42.215244+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215244+0000","last_undegraded":"2024-09-15T23:55:42.215244+0000","last_fullsized":"2024-09-15T23:55:42.215244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214155+0000","last_change":"2024-09-15T23:55:42.214155+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214155+0000","last_undegraded":"2024-09-15T23:55:42.214155+0000","last_fullsized":"2024-09-15T23:55:42.214155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215980+0000","last_change":"2024-09-15T23:55:42.215980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215980+0000","last_undegraded":"2024-09-15T23:55:42.215980+0000","last_fullsized":"2024-09-15T23:55:42.215980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212654+0000","last_change":"2024-09-15T23:55:42.212654+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212654+0000","last_undegraded":"2024-09-15T23:55:42.212654+0000","last_fullsized":"2024-09-15T23:55:42.212654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213914+0000","last_change":"2024-09-15T23:55:42.213914+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213914+0000","last_undegraded":"2024-09-15T23:55:42.213914+0000","last_fullsized":"2024-09-15T23:55:42.213914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.219578+0000","last_change":"2024-09-15T23:55:42.219578+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.219578+0000","last_undegraded":"2024-09-15T23:55:42.219578+0000","last_fullsized":"2024-09-15T23:55:42.219578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215419+0000","last_change":"2024-09-15T23:55:42.215419+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215419+0000","last_undegraded":"2024-09-15T23:55:42.215419+0000","last_fullsized":"2024-09-15T23:55:42.215419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211647+0000","last_change":"2024-09-15T23:55:42.211647+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211647+0000","last_undegraded":"2024-09-15T23:55:42.211647+0000","last_fullsized":"2024-09-15T23:55:42.211647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212138+0000","last_change":"2024-09-15T23:55:42.212138+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212138+0000","last_undegraded":"2024-09-15T23:55:42.212138+0000","last_fullsized":"2024-09-15T23:55:42.212138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213705+0000","last_change":"2024-09-15T23:55:42.213705+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213705+0000","last_undegraded":"2024-09-15T23:55:42.213705+0000","last_fullsized":"2024-09-15T23:55:42.213705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210492+0000","last_change":"2024-09-15T23:55:42.210492+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210492+0000","last_undegraded":"2024-09-15T23:55:42.210492+0000","last_fullsized":"2024-09-15T23:55:42.210492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212489+0000","last_change":"2024-09-15T23:55:42.212489+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212489+0000","last_undegraded":"2024-09-15T23:55:42.212489+0000","last_fullsized":"2024-09-15T23:55:42.212489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214921+0000","last_change":"2024-09-15T23:55:42.214921+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214921+0000","last_undegraded":"2024-09-15T23:55:42.214921+0000","last_fullsized":"2024-09-15T23:55:42.214921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212673+0000","last_change":"2024-09-15T23:55:42.212673+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212673+0000","last_undegraded":"2024-09-15T23:55:42.212673+0000","last_fullsized":"2024-09-15T23:55:42.212673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215050+0000","last_change":"2024-09-15T23:55:42.215050+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215050+0000","last_undegraded":"2024-09-15T23:55:42.215050+0000","last_fullsized":"2024-09-15T23:55:42.215050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211272+0000","last_change":"2024-09-15T23:55:42.211272+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211272+0000","last_undegraded":"2024-09-15T23:55:42.211272+0000","last_fullsized":"2024-09-15T23:55:42.211272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213134+0000","last_change":"2024-09-15T23:55:42.213134+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213134+0000","last_undegraded":"2024-09-15T23:55:42.213134+0000","last_fullsized":"2024-09-15T23:55:42.213134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211389+0000","last_change":"2024-09-15T23:55:42.211389+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211389+0000","last_undegraded":"2024-09-15T23:55:42.211389+0000","last_fullsized":"2024-09-15T23:55:42.211389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213079+0000","last_change":"2024-09-15T23:55:42.213079+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213079+0000","last_undegraded":"2024-09-15T23:55:42.213079+0000","last_fullsized":"2024-09-15T23:55:42.213079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210218+0000","last_change":"2024-09-15T23:55:42.210218+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210218+0000","last_undegraded":"2024-09-15T23:55:42.210218+0000","last_fullsized":"2024-09-15T23:55:42.210218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213299+0000","last_change":"2024-09-15T23:55:42.213299+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213299+0000","last_undegraded":"2024-09-15T23:55:42.213299+0000","last_fullsized":"2024-09-15T23:55:42.213299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222637+0000","last_change":"2024-09-15T23:55:42.222637+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222637+0000","last_undegraded":"2024-09-15T23:55:42.222637+0000","last_fullsized":"2024-09-15T23:55:42.222637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212919+0000","last_change":"2024-09-15T23:55:42.212919+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212919+0000","last_undegraded":"2024-09-15T23:55:42.212919+0000","last_fullsized":"2024-09-15T23:55:42.212919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218426+0000","last_change":"2024-09-15T23:55:42.218426+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218426+0000","last_undegraded":"2024-09-15T23:55:42.218426+0000","last_fullsized":"2024-09-15T23:55:42.218426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211019+0000","last_change":"2024-09-15T23:55:42.211019+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211019+0000","last_undegraded":"2024-09-15T23:55:42.211019+0000","last_fullsized":"2024-09-15T23:55:42.211019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210810+0000","last_change":"2024-09-15T23:55:42.210810+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210810+0000","last_undegraded":"2024-09-15T23:55:42.210810+0000","last_fullsized":"2024-09-15T23:55:42.210810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209956+0000","last_change":"2024-09-15T23:55:42.209956+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209956+0000","last_undegraded":"2024-09-15T23:55:42.209956+0000","last_fullsized":"2024-09-15T23:55:42.209956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209530+0000","last_change":"2024-09-15T23:55:42.209530+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209530+0000","last_undegraded":"2024-09-15T23:55:42.209530+0000","last_fullsized":"2024-09-15T23:55:42.209530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212168+0000","last_change":"2024-09-15T23:55:42.212168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212168+0000","last_undegraded":"2024-09-15T23:55:42.212168+0000","last_fullsized":"2024-09-15T23:55:42.212168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214625+0000","last_change":"2024-09-15T23:55:42.214625+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214625+0000","last_undegraded":"2024-09-15T23:55:42.214625+0000","last_fullsized":"2024-09-15T23:55:42.214625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234608+0000","last_change":"2024-09-15T23:55:42.233492+0000","last_active":"2024-09-15T23:55:42.234608+0000","last_peered":"2024-09-15T23:55:42.234608+0000","last_clean":"2024-09-15T23:55:42.234608+0000","last_became_active":"2024-09-15T23:55:42.233237+0000","last_became_peered":"2024-09-15T23:55:42.233237+0000","last_unstale":"2024-09-15T23:55:42.234608+0000","last_undegraded":"2024-09-15T23:55:42.234608+0000","last_fullsized":"2024-09-15T23:55:42.234608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:38.510269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209589+0000","last_change":"2024-09-15T23:55:42.209589+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209589+0000","last_undegraded":"2024-09-15T23:55:42.209589+0000","last_fullsized":"2024-09-15T23:55:42.209589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231304+0000","last_change":"2024-09-15T23:55:42.227655+0000","last_active":"2024-09-15T23:55:42.231304+0000","last_peered":"2024-09-15T23:55:42.231304+0000","last_clean":"2024-09-15T23:55:42.231304+0000","last_became_active":"2024-09-15T23:55:42.227114+0000","last_became_peered":"2024-09-15T23:55:42.227114+0000","last_unstale":"2024-09-15T23:55:42.231304+0000","last_undegraded":"2024-09-15T23:55:42.231304+0000","last_fullsized":"2024-09-15T23:55:42.231304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:45.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210674+0000","last_change":"2024-09-15T23:55:42.210674+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210674+0000","last_undegraded":"2024-09-15T23:55:42.210674+0000","last_fullsized":"2024-09-15T23:55:42.210674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231397+0000","last_change":"2024-09-15T23:55:42.227590+0000","last_active":"2024-09-15T23:55:42.231397+0000","last_peered":"2024-09-15T23:55:42.231397+0000","last_clean":"2024-09-15T23:55:42.231397+0000","last_became_active":"2024-09-15T23:55:42.227300+0000","last_became_peered":"2024-09-15T23:55:42.227300+0000","last_unstale":"2024-09-15T23:55:42.231397+0000","last_undegraded":"2024-09-15T23:55:42.231397+0000","last_fullsized":"2024-09-15T23:55:42.231397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:35.069585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218037+0000","last_change":"2024-09-15T23:55:42.218037+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218037+0000","last_undegraded":"2024-09-15T23:55:42.218037+0000","last_fullsized":"2024-09-15T23:55:42.218037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233608+0000","last_change":"2024-09-15T23:55:42.229229+0000","last_active":"2024-09-15T23:55:42.233608+0000","last_peered":"2024-09-15T23:55:42.233608+0000","last_clean":"2024-09-15T23:55:42.233608+0000","last_became_active":"2024-09-15T23:55:42.228892+0000","last_became_peered":"2024-09-15T23:55:42.228892+0000","last_unstale":"2024-09-15T23:55:42.233608+0000","last_undegraded":"2024-09-15T23:55:42.233608+0000","last_fullsized":"2024-09-15T23:55:42.233608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:52.300497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215633+0000","last_change":"2024-09-15T23:55:42.215633+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215633+0000","last_undegraded":"2024-09-15T23:55:42.215633+0000","last_fullsized":"2024-09-15T23:55:42.215633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230619+0000","last_change":"2024-09-15T23:55:42.228095+0000","last_active":"2024-09-15T23:55:42.230619+0000","last_peered":"2024-09-15T23:55:42.230619+0000","last_clean":"2024-09-15T23:55:42.230619+0000","last_became_active":"2024-09-15T23:55:42.227826+0000","last_became_peered":"2024-09-15T23:55:42.227826+0000","last_unstale":"2024-09-15T23:55:42.230619+0000","last_undegraded":"2024-09-15T23:55:42.230619+0000","last_fullsized":"2024-09-15T23:55:42.230619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:40.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211390+0000","last_change":"2024-09-15T23:55:42.211390+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211390+0000","last_undegraded":"2024-09-15T23:55:42.211390+0000","last_fullsized":"2024-09-15T23:55:42.211390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.226388+0000","last_change":"2024-09-15T23:55:42.223388+0000","last_active":"2024-09-15T23:55:42.226388+0000","last_peered":"2024-09-15T23:55:42.226388+0000","last_clean":"2024-09-15T23:55:42.226388+0000","last_became_active":"2024-09-15T23:55:42.223117+0000","last_became_peered":"2024-09-15T23:55:42.223117+0000","last_unstale":"2024-09-15T23:55:42.226388+0000","last_undegraded":"2024-09-15T23:55:42.226388+0000","last_fullsized":"2024-09-15T23:55:42.226388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:57.599146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218672+0000","last_change":"2024-09-15T23:55:42.218672+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218672+0000","last_undegraded":"2024-09-15T23:55:42.218672+0000","last_fullsized":"2024-09-15T23:55:42.218672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.219278+0000","last_change":"2024-09-15T23:55:42.218000+0000","last_active":"2024-09-15T23:55:42.219278+0000","last_peered":"2024-09-15T23:55:42.219278+0000","last_clean":"2024-09-15T23:55:42.219278+0000","last_became_active":"2024-09-15T23:55:42.217248+0000","last_became_peered":"2024-09-15T23:55:42.217248+0000","last_unstale":"2024-09-15T23:55:42.219278+0000","last_undegraded":"2024-09-15T23:55:42.219278+0000","last_fullsized":"2024-09-15T23:55:42.219278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:12.128635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216432+0000","last_change":"2024-09-15T23:55:42.216432+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216432+0000","last_undegraded":"2024-09-15T23:55:42.216432+0000","last_fullsized":"2024-09-15T23:55:42.216432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233710+0000","last_change":"2024-09-15T23:55:42.230514+0000","last_active":"2024-09-15T23:55:42.233710+0000","last_peered":"2024-09-15T23:55:42.233710+0000","last_clean":"2024-09-15T23:55:42.233710+0000","last_became_active":"2024-09-15T23:55:42.228955+0000","last_became_peered":"2024-09-15T23:55:42.228955+0000","last_unstale":"2024-09-15T23:55:42.233710+0000","last_undegraded":"2024-09-15T23:55:42.233710+0000","last_fullsized":"2024-09-15T23:55:42.233710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:20.726368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211600+0000","last_change":"2024-09-15T23:55:42.211600+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211600+0000","last_undegraded":"2024-09-15T23:55:42.211600+0000","last_fullsized":"2024-09-15T23:55:42.211600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234590+0000","last_change":"2024-09-15T23:55:42.233343+0000","last_active":"2024-09-15T23:55:42.234590+0000","last_peered":"2024-09-15T23:55:42.234590+0000","last_clean":"2024-09-15T23:55:42.234590+0000","last_became_active":"2024-09-15T23:55:42.233082+0000","last_became_peered":"2024-09-15T23:55:42.233082+0000","last_unstale":"2024-09-15T23:55:42.234590+0000","last_undegraded":"2024-09-15T23:55:42.234590+0000","last_fullsized":"2024-09-15T23:55:42.234590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:13.962428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209115+0000","last_change":"2024-09-15T23:55:42.209115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209115+0000","last_undegraded":"2024-09-15T23:55:42.209115+0000","last_fullsized":"2024-09-15T23:55:42.209115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218593+0000","last_change":"2024-09-15T23:55:42.217126+0000","last_active":"2024-09-15T23:55:42.218593+0000","last_peered":"2024-09-15T23:55:42.218593+0000","last_clean":"2024-09-15T23:55:42.218593+0000","last_became_active":"2024-09-15T23:55:42.216854+0000","last_became_peered":"2024-09-15T23:55:42.216854+0000","last_unstale":"2024-09-15T23:55:42.218593+0000","last_undegraded":"2024-09-15T23:55:42.218593+0000","last_fullsized":"2024-09-15T23:55:42.218593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:07.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212554+0000","last_change":"2024-09-15T23:55:42.212554+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212554+0000","last_undegraded":"2024-09-15T23:55:42.212554+0000","last_fullsized":"2024-09-15T23:55:42.212554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231359+0000","last_change":"2024-09-15T23:55:42.227422+0000","last_active":"2024-09-15T23:55:42.231359+0000","last_peered":"2024-09-15T23:55:42.231359+0000","last_clean":"2024-09-15T23:55:42.231359+0000","last_became_active":"2024-09-15T23:55:42.227135+0000","last_became_peered":"2024-09-15T23:55:42.227135+0000","last_unstale":"2024-09-15T23:55:42.231359+0000","last_undegraded":"2024-09-15T23:55:42.231359+0000","last_fullsized":"2024-09-15T23:55:42.231359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:47.730774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210852+0000","last_change":"2024-09-15T23:55:42.210852+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210852+0000","last_undegraded":"2024-09-15T23:55:42.210852+0000","last_fullsized":"2024-09-15T23:55:42.210852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234713+0000","last_change":"2024-09-15T23:55:42.232680+0000","last_active":"2024-09-15T23:55:42.234713+0000","last_peered":"2024-09-15T23:55:42.234713+0000","last_clean":"2024-09-15T23:55:42.234713+0000","last_became_active":"2024-09-15T23:55:42.232415+0000","last_became_peered":"2024-09-15T23:55:42.232415+0000","last_unstale":"2024-09-15T23:55:42.234713+0000","last_undegraded":"2024-09-15T23:55:42.234713+0000","last_fullsized":"2024-09-15T23:55:42.234713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.986284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212729+0000","last_change":"2024-09-15T23:55:42.212729+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212729+0000","last_undegraded":"2024-09-15T23:55:42.212729+0000","last_fullsized":"2024-09-15T23:55:42.212729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233516+0000","last_change":"2024-09-15T23:55:42.229038+0000","last_active":"2024-09-15T23:55:42.233516+0000","last_peered":"2024-09-15T23:55:42.233516+0000","last_clean":"2024-09-15T23:55:42.233516+0000","last_became_active":"2024-09-15T23:55:42.228474+0000","last_became_peered":"2024-09-15T23:55:42.228474+0000","last_unstale":"2024-09-15T23:55:42.233516+0000","last_undegraded":"2024-09-15T23:55:42.233516+0000","last_fullsized":"2024-09-15T23:55:42.233516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:32.453009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210217+0000","last_change":"2024-09-15T23:55:42.210217+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210217+0000","last_undegraded":"2024-09-15T23:55:42.210217+0000","last_fullsized":"2024-09-15T23:55:42.210217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227583+0000","last_change":"2024-09-15T23:55:42.226400+0000","last_active":"2024-09-15T23:55:42.227583+0000","last_peered":"2024-09-15T23:55:42.227583+0000","last_clean":"2024-09-15T23:55:42.227583+0000","last_became_active":"2024-09-15T23:55:42.226109+0000","last_became_peered":"2024-09-15T23:55:42.226109+0000","last_unstale":"2024-09-15T23:55:42.227583+0000","last_undegraded":"2024-09-15T23:55:42.227583+0000","last_fullsized":"2024-09-15T23:55:42.227583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:04.138219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211783+0000","last_change":"2024-09-15T23:55:42.211783+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211783+0000","last_undegraded":"2024-09-15T23:55:42.211783+0000","last_fullsized":"2024-09-15T23:55:42.211783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.221450+0000","last_change":"2024-09-15T23:55:42.220273+0000","last_active":"2024-09-15T23:55:42.221450+0000","last_peered":"2024-09-15T23:55:42.221450+0000","last_clean":"2024-09-15T23:55:42.221450+0000","last_became_active":"2024-09-15T23:55:42.219755+0000","last_became_peered":"2024-09-15T23:55:42.219755+0000","last_unstale":"2024-09-15T23:55:42.221450+0000","last_undegraded":"2024-09-15T23:55:42.221450+0000","last_fullsized":"2024-09-15T23:55:42.221450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:10.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216043+0000","last_change":"2024-09-15T23:55:42.216043+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216043+0000","last_undegraded":"2024-09-15T23:55:42.216043+0000","last_fullsized":"2024-09-15T23:55:42.216043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.235125+0000","last_change":"2024-09-15T23:55:42.233298+0000","last_active":"2024-09-15T23:55:42.235125+0000","last_peered":"2024-09-15T23:55:42.235125+0000","last_clean":"2024-09-15T23:55:42.235125+0000","last_became_active":"2024-09-15T23:55:42.233077+0000","last_became_peered":"2024-09-15T23:55:42.233077+0000","last_unstale":"2024-09-15T23:55:42.235125+0000","last_undegraded":"2024-09-15T23:55:42.235125+0000","last_fullsized":"2024-09-15T23:55:42.235125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:50.606047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212496+0000","last_change":"2024-09-15T23:55:42.212496+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212496+0000","last_undegraded":"2024-09-15T23:55:42.212496+0000","last_fullsized":"2024-09-15T23:55:42.212496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227624+0000","last_change":"2024-09-15T23:55:42.226711+0000","last_active":"2024-09-15T23:55:42.227624+0000","last_peered":"2024-09-15T23:55:42.227624+0000","last_clean":"2024-09-15T23:55:42.227624+0000","last_became_active":"2024-09-15T23:55:42.226436+0000","last_became_peered":"2024-09-15T23:55:42.226436+0000","last_unstale":"2024-09-15T23:55:42.227624+0000","last_undegraded":"2024-09-15T23:55:42.227624+0000","last_fullsized":"2024-09-15T23:55:42.227624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:38.572689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222256+0000","last_change":"2024-09-15T23:55:42.222256+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222256+0000","last_undegraded":"2024-09-15T23:55:42.222256+0000","last_fullsized":"2024-09-15T23:55:42.222256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233541+0000","last_change":"2024-09-15T23:55:42.229093+0000","last_active":"2024-09-15T23:55:42.233541+0000","last_peered":"2024-09-15T23:55:42.233541+0000","last_clean":"2024-09-15T23:55:42.233541+0000","last_became_active":"2024-09-15T23:55:42.228543+0000","last_became_peered":"2024-09-15T23:55:42.228543+0000","last_unstale":"2024-09-15T23:55:42.233541+0000","last_undegraded":"2024-09-15T23:55:42.233541+0000","last_fullsized":"2024-09-15T23:55:42.233541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:43.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211772+0000","last_change":"2024-09-15T23:55:42.211772+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211772+0000","last_undegraded":"2024-09-15T23:55:42.211772+0000","last_fullsized":"2024-09-15T23:55:42.211772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233496+0000","last_change":"2024-09-15T23:55:42.231292+0000","last_active":"2024-09-15T23:55:42.233496+0000","last_peered":"2024-09-15T23:55:42.233496+0000","last_clean":"2024-09-15T23:55:42.233496+0000","last_became_active":"2024-09-15T23:55:42.230815+0000","last_became_peered":"2024-09-15T23:55:42.230815+0000","last_unstale":"2024-09-15T23:55:42.233496+0000","last_undegraded":"2024-09-15T23:55:42.233496+0000","last_fullsized":"2024-09-15T23:55:42.233496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:20.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210029+0000","last_change":"2024-09-15T23:55:42.210029+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210029+0000","last_undegraded":"2024-09-15T23:55:42.210029+0000","last_fullsized":"2024-09-15T23:55:42.210029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231334+0000","last_change":"2024-09-15T23:55:42.227704+0000","last_active":"2024-09-15T23:55:42.231334+0000","last_peered":"2024-09-15T23:55:42.231334+0000","last_clean":"2024-09-15T23:55:42.231334+0000","last_became_active":"2024-09-15T23:55:42.226981+0000","last_became_peered":"2024-09-15T23:55:42.226981+0000","last_unstale":"2024-09-15T23:55:42.231334+0000","last_undegraded":"2024-09-15T23:55:42.231334+0000","last_fullsized":"2024-09-15T23:55:42.231334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:02.879850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210168+0000","last_change":"2024-09-15T23:55:42.210168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210168+0000","last_undegraded":"2024-09-15T23:55:42.210168+0000","last_fullsized":"2024-09-15T23:55:42.210168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231424+0000","last_change":"2024-09-15T23:55:42.228234+0000","last_active":"2024-09-15T23:55:42.231424+0000","last_peered":"2024-09-15T23:55:42.231424+0000","last_clean":"2024-09-15T23:55:42.231424+0000","last_became_active":"2024-09-15T23:55:42.228025+0000","last_became_peered":"2024-09-15T23:55:42.228025+0000","last_unstale":"2024-09-15T23:55:42.231424+0000","last_undegraded":"2024-09-15T23:55:42.231424+0000","last_fullsized":"2024-09-15T23:55:42.231424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:15.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210988+0000","last_change":"2024-09-15T23:55:42.210988+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210988+0000","last_undegraded":"2024-09-15T23:55:42.210988+0000","last_fullsized":"2024-09-15T23:55:42.210988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233685+0000","last_change":"2024-09-15T23:55:42.230626+0000","last_active":"2024-09-15T23:55:42.233685+0000","last_peered":"2024-09-15T23:55:42.233685+0000","last_clean":"2024-09-15T23:55:42.233685+0000","last_became_active":"2024-09-15T23:55:42.229558+0000","last_became_peered":"2024-09-15T23:55:42.229558+0000","last_unstale":"2024-09-15T23:55:42.233685+0000","last_undegraded":"2024-09-15T23:55:42.233685+0000","last_fullsized":"2024-09-15T23:55:42.233685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:53.004728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211320+0000","last_change":"2024-09-15T23:55:42.211320+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211320+0000","last_undegraded":"2024-09-15T23:55:42.211320+0000","last_fullsized":"2024-09-15T23:55:42.211320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233985+0000","last_change":"2024-09-15T23:55:42.232416+0000","last_active":"2024-09-15T23:55:42.233985+0000","last_peered":"2024-09-15T23:55:42.233985+0000","last_clean":"2024-09-15T23:55:42.233985+0000","last_became_active":"2024-09-15T23:55:42.232148+0000","last_became_peered":"2024-09-15T23:55:42.232148+0000","last_unstale":"2024-09-15T23:55:42.233985+0000","last_undegraded":"2024-09-15T23:55:42.233985+0000","last_fullsized":"2024-09-15T23:55:42.233985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.743577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215617+0000","last_change":"2024-09-15T23:55:42.215617+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215617+0000","last_undegraded":"2024-09-15T23:55:42.215617+0000","last_fullsized":"2024-09-15T23:55:42.215617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231135+0000","last_change":"2024-09-15T23:55:42.229509+0000","last_active":"2024-09-15T23:55:42.231135+0000","last_peered":"2024-09-15T23:55:42.231135+0000","last_clean":"2024-09-15T23:55:42.231135+0000","last_became_active":"2024-09-15T23:55:42.229201+0000","last_became_peered":"2024-09-15T23:55:42.229201+0000","last_unstale":"2024-09-15T23:55:42.231135+0000","last_undegraded":"2024-09-15T23:55:42.231135+0000","last_fullsized":"2024-09-15T23:55:42.231135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:44.593277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212102+0000","last_change":"2024-09-15T23:55:42.212102+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212102+0000","last_undegraded":"2024-09-15T23:55:42.212102+0000","last_fullsized":"2024-09-15T23:55:42.212102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233982+0000","last_change":"2024-09-15T23:55:42.232445+0000","last_active":"2024-09-15T23:55:42.233982+0000","last_peered":"2024-09-15T23:55:42.233982+0000","last_clean":"2024-09-15T23:55:42.233982+0000","last_became_active":"2024-09-15T23:55:42.232171+0000","last_became_peered":"2024-09-15T23:55:42.232171+0000","last_unstale":"2024-09-15T23:55:42.233982+0000","last_undegraded":"2024-09-15T23:55:42.233982+0000","last_fullsized":"2024-09-15T23:55:42.233982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:52.279847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212121+0000","last_change":"2024-09-15T23:55:42.212121+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212121+0000","last_undegraded":"2024-09-15T23:55:42.212121+0000","last_fullsized":"2024-09-15T23:55:42.212121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231280+0000","last_change":"2024-09-15T23:55:42.227428+0000","last_active":"2024-09-15T23:55:42.231280+0000","last_peered":"2024-09-15T23:55:42.231280+0000","last_clean":"2024-09-15T23:55:42.231280+0000","last_became_active":"2024-09-15T23:55:42.227111+0000","last_became_peered":"2024-09-15T23:55:42.227111+0000","last_unstale":"2024-09-15T23:55:42.231280+0000","last_undegraded":"2024-09-15T23:55:42.231280+0000","last_fullsized":"2024-09-15T23:55:42.231280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:59.483861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210404+0000","last_change":"2024-09-15T23:55:42.210404+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210404+0000","last_undegraded":"2024-09-15T23:55:42.210404+0000","last_fullsized":"2024-09-15T23:55:42.210404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227796+0000","last_change":"2024-09-15T23:55:42.223960+0000","last_active":"2024-09-15T23:55:42.227796+0000","last_peered":"2024-09-15T23:55:42.227796+0000","last_clean":"2024-09-15T23:55:42.227796+0000","last_became_active":"2024-09-15T23:55:42.223701+0000","last_became_peered":"2024-09-15T23:55:42.223701+0000","last_unstale":"2024-09-15T23:55:42.227796+0000","last_undegraded":"2024-09-15T23:55:42.227796+0000","last_fullsized":"2024-09-15T23:55:42.227796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:38.030906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.208847+0000","last_change":"2024-09-15T23:55:42.208847+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.208847+0000","last_undegraded":"2024-09-15T23:55:42.208847+0000","last_fullsized":"2024-09-15T23:55:42.208847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218320+0000","last_change":"2024-09-15T23:55:42.216705+0000","last_active":"2024-09-15T23:55:42.218320+0000","last_peered":"2024-09-15T23:55:42.218320+0000","last_clean":"2024-09-15T23:55:42.218320+0000","last_became_active":"2024-09-15T23:55:42.216416+0000","last_became_peered":"2024-09-15T23:55:42.216416+0000","last_unstale":"2024-09-15T23:55:42.218320+0000","last_undegraded":"2024-09-15T23:55:42.218320+0000","last_fullsized":"2024-09-15T23:55:42.218320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:50.897137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209955+0000","last_change":"2024-09-15T23:55:42.209955+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209955+0000","last_undegraded":"2024-09-15T23:55:42.209955+0000","last_fullsized":"2024-09-15T23:55:42.209955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234708+0000","last_change":"2024-09-15T23:55:42.232517+0000","last_active":"2024-09-15T23:55:42.234708+0000","last_peered":"2024-09-15T23:55:42.234708+0000","last_clean":"2024-09-15T23:55:42.234708+0000","last_became_active":"2024-09-15T23:55:42.232227+0000","last_became_peered":"2024-09-15T23:55:42.232227+0000","last_unstale":"2024-09-15T23:55:42.234708+0000","last_undegraded":"2024-09-15T23:55:42.234708+0000","last_fullsized":"2024-09-15T23:55:42.234708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.199261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209575+0000","last_change":"2024-09-15T23:55:42.209575+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209575+0000","last_undegraded":"2024-09-15T23:55:42.209575+0000","last_fullsized":"2024-09-15T23:55:42.209575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222296+0000","last_change":"2024-09-15T23:55:42.220495+0000","last_active":"2024-09-15T23:55:42.222296+0000","last_peered":"2024-09-15T23:55:42.222296+0000","last_clean":"2024-09-15T23:55:42.222296+0000","last_became_active":"2024-09-15T23:55:42.219865+0000","last_became_peered":"2024-09-15T23:55:42.219865+0000","last_unstale":"2024-09-15T23:55:42.222296+0000","last_undegraded":"2024-09-15T23:55:42.222296+0000","last_fullsized":"2024-09-15T23:55:42.222296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:38.730404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212980+0000","last_change":"2024-09-15T23:55:42.212980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212980+0000","last_undegraded":"2024-09-15T23:55:42.212980+0000","last_fullsized":"2024-09-15T23:55:42.212980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231367+0000","last_change":"2024-09-15T23:55:42.227968+0000","last_active":"2024-09-15T23:55:42.231367+0000","last_peered":"2024-09-15T23:55:42.231367+0000","last_clean":"2024-09-15T23:55:42.231367+0000","last_became_active":"2024-09-15T23:55:42.227688+0000","last_became_peered":"2024-09-15T23:55:42.227688+0000","last_unstale":"2024-09-15T23:55:42.231367+0000","last_undegraded":"2024-09-15T23:55:42.231367+0000","last_fullsized":"2024-09-15T23:55:42.231367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:14.508276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212115+0000","last_change":"2024-09-15T23:55:42.212115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212115+0000","last_undegraded":"2024-09-15T23:55:42.212115+0000","last_fullsized":"2024-09-15T23:55:42.212115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230957+0000","last_change":"2024-09-15T23:55:42.224100+0000","last_active":"2024-09-15T23:55:42.230957+0000","last_peered":"2024-09-15T23:55:42.230957+0000","last_clean":"2024-09-15T23:55:42.230957+0000","last_became_active":"2024-09-15T23:55:42.223829+0000","last_became_peered":"2024-09-15T23:55:42.223829+0000","last_unstale":"2024-09-15T23:55:42.230957+0000","last_undegraded":"2024-09-15T23:55:42.230957+0000","last_fullsized":"2024-09-15T23:55:42.230957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.446581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222947+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:42.222947+0000","last_peered":"2024-09-15T23:55:42.222947+0000","last_clean":"2024-09-15T23:55:42.222947+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:42.222947+0000","last_undegraded":"2024-09-15T23:55:42.222947+0000","last_fullsized":"2024-09-15T23:55:42.222947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":71862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":658265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:46.819 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-15T23:55:46.819 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213470+0000', 'last_change': '2024-09-15T23:55:42.213470+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213470+0000', 'last_undegraded': '2024-09-15T23:55:42.213470+0000', 'last_fullsized': '2024-09-15T23:55:42.213470+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215439+0000', 'last_change': '2024-09-15T23:55:42.215439+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215439+0000', 'last_undegraded': '2024-09-15T23:55:42.215439+0000', 'last_fullsized': '2024-09-15T23:55:42.215439+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215816+0000', 'last_change': '2024-09-15T23:55:42.215816+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215816+0000', 'last_undegraded': '2024-09-15T23:55:42.215816+0000', 'last_fullsized': '2024-09-15T23:55:42.215816+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215244+0000', 'last_change': '2024-09-15T23:55:42.215244+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215244+0000', 'last_undegraded': '2024-09-15T23:55:42.215244+0000', 'last_fullsized': '2024-09-15T23:55:42.215244+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.214155+0000', 'last_change': '2024-09-15T23:55:42.214155+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.214155+0000', 'last_undegraded': '2024-09-15T23:55:42.214155+0000', 'last_fullsized': '2024-09-15T23:55:42.214155+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-15T23:55:46.820 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215980+0000', 'last_change': '2024-09-15T23:55:42.215980+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215980+0000', 'last_undegraded': '2024-09-15T23:55:42.215980+0000', 'last_fullsized': '2024-09-15T23:55:42.215980+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212654+0000', 'last_change': '2024-09-15T23:55:42.212654+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212654+0000', 'last_undegraded': '2024-09-15T23:55:42.212654+0000', 'last_fullsized': '2024-09-15T23:55:42.212654+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213914+0000', 'last_change': '2024-09-15T23:55:42.213914+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213914+0000', 'last_undegraded': '2024-09-15T23:55:42.213914+0000', 'last_fullsized': '2024-09-15T23:55:42.213914+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.219578+0000', 'last_change': '2024-09-15T23:55:42.219578+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.219578+0000', 'last_undegraded': '2024-09-15T23:55:42.219578+0000', 'last_fullsized': '2024-09-15T23:55:42.219578+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215419+0000', 'last_change': '2024-09-15T23:55:42.215419+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215419+0000', 'last_undegraded': '2024-09-15T23:55:42.215419+0000', 'last_fullsized': '2024-09-15T23:55:42.215419+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211647+0000', 'last_change': '2024-09-15T23:55:42.211647+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211647+0000', 'last_undegraded': '2024-09-15T23:55:42.211647+0000', 'last_fullsized': '2024-09-15T23:55:42.211647+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-15T23:55:46.821 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212138+0000', 'last_change': '2024-09-15T23:55:42.212138+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212138+0000', 'last_undegraded': '2024-09-15T23:55:42.212138+0000', 'last_fullsized': '2024-09-15T23:55:42.212138+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213705+0000', 'last_change': '2024-09-15T23:55:42.213705+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213705+0000', 'last_undegraded': '2024-09-15T23:55:42.213705+0000', 'last_fullsized': '2024-09-15T23:55:42.213705+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210492+0000', 'last_change': '2024-09-15T23:55:42.210492+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210492+0000', 'last_undegraded': '2024-09-15T23:55:42.210492+0000', 'last_fullsized': '2024-09-15T23:55:42.210492+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212489+0000', 'last_change': '2024-09-15T23:55:42.212489+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212489+0000', 'last_undegraded': '2024-09-15T23:55:42.212489+0000', 'last_fullsized': '2024-09-15T23:55:42.212489+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.214921+0000', 'last_change': '2024-09-15T23:55:42.214921+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.214921+0000', 'last_undegraded': '2024-09-15T23:55:42.214921+0000', 'last_fullsized': '2024-09-15T23:55:42.214921+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-15T23:55:46.822 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212673+0000', 'last_change': '2024-09-15T23:55:42.212673+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212673+0000', 'last_undegraded': '2024-09-15T23:55:42.212673+0000', 'last_fullsized': '2024-09-15T23:55:42.212673+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215050+0000', 'last_change': '2024-09-15T23:55:42.215050+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215050+0000', 'last_undegraded': '2024-09-15T23:55:42.215050+0000', 'last_fullsized': '2024-09-15T23:55:42.215050+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211272+0000', 'last_change': '2024-09-15T23:55:42.211272+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211272+0000', 'last_undegraded': '2024-09-15T23:55:42.211272+0000', 'last_fullsized': '2024-09-15T23:55:42.211272+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213134+0000', 'last_change': '2024-09-15T23:55:42.213134+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213134+0000', 'last_undegraded': '2024-09-15T23:55:42.213134+0000', 'last_fullsized': '2024-09-15T23:55:42.213134+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211389+0000', 'last_change': '2024-09-15T23:55:42.211389+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211389+0000', 'last_undegraded': '2024-09-15T23:55:42.211389+0000', 'last_fullsized': '2024-09-15T23:55:42.211389+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213079+0000', 'last_change': '2024-09-15T23:55:42.213079+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213079+0000', 'last_undegraded': '2024-09-15T23:55:42.213079+0000', 'last_fullsized': '2024-09-15T23:55:42.213079+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-15T23:55:46.823 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210218+0000', 'last_change': '2024-09-15T23:55:42.210218+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210218+0000', 'last_undegraded': '2024-09-15T23:55:42.210218+0000', 'last_fullsized': '2024-09-15T23:55:42.210218+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.213299+0000', 'last_change': '2024-09-15T23:55:42.213299+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.213299+0000', 'last_undegraded': '2024-09-15T23:55:42.213299+0000', 'last_fullsized': '2024-09-15T23:55:42.213299+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.222637+0000', 'last_change': '2024-09-15T23:55:42.222637+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.222637+0000', 'last_undegraded': '2024-09-15T23:55:42.222637+0000', 'last_fullsized': '2024-09-15T23:55:42.222637+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212919+0000', 'last_change': '2024-09-15T23:55:42.212919+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212919+0000', 'last_undegraded': '2024-09-15T23:55:42.212919+0000', 'last_fullsized': '2024-09-15T23:55:42.212919+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.824 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.218426+0000', 'last_change': '2024-09-15T23:55:42.218426+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.218426+0000', 'last_undegraded': '2024-09-15T23:55:42.218426+0000', 'last_fullsized': '2024-09-15T23:55:42.218426+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211019+0000', 'last_change': '2024-09-15T23:55:42.211019+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211019+0000', 'last_undegraded': '2024-09-15T23:55:42.211019+0000', 'last_fullsized': '2024-09-15T23:55:42.211019+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210810+0000', 'last_change': '2024-09-15T23:55:42.210810+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210810+0000', 'last_undegraded': '2024-09-15T23:55:42.210810+0000', 'last_fullsized': '2024-09-15T23:55:42.210810+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209956+0000', 'last_change': '2024-09-15T23:55:42.209956+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209956+0000', 'last_undegraded': '2024-09-15T23:55:42.209956+0000', 'last_fullsized': '2024-09-15T23:55:42.209956+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209530+0000', 'last_change': '2024-09-15T23:55:42.209530+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209530+0000', 'last_undegraded': '2024-09-15T23:55:42.209530+0000', 'last_fullsized': '2024-09-15T23:55:42.209530+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-15T23:55:46.825 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212168+0000', 'last_change': '2024-09-15T23:55:42.212168+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212168+0000', 'last_undegraded': '2024-09-15T23:55:42.212168+0000', 'last_fullsized': '2024-09-15T23:55:42.212168+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.214625+0000', 'last_change': '2024-09-15T23:55:42.214625+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.214625+0000', 'last_undegraded': '2024-09-15T23:55:42.214625+0000', 'last_fullsized': '2024-09-15T23:55:42.214625+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209589+0000', 'last_change': '2024-09-15T23:55:42.209589+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209589+0000', 'last_undegraded': '2024-09-15T23:55:42.209589+0000', 'last_fullsized': '2024-09-15T23:55:42.209589+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210674+0000', 'last_change': '2024-09-15T23:55:42.210674+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210674+0000', 'last_undegraded': '2024-09-15T23:55:42.210674+0000', 'last_fullsized': '2024-09-15T23:55:42.210674+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.218037+0000', 'last_change': '2024-09-15T23:55:42.218037+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.218037+0000', 'last_undegraded': '2024-09-15T23:55:42.218037+0000', 'last_fullsized': '2024-09-15T23:55:42.218037+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215633+0000', 'last_change': '2024-09-15T23:55:42.215633+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215633+0000', 'last_undegraded': '2024-09-15T23:55:42.215633+0000', 'last_fullsized': '2024-09-15T23:55:42.215633+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.826 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211390+0000', 'last_change': '2024-09-15T23:55:42.211390+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211390+0000', 'last_undegraded': '2024-09-15T23:55:42.211390+0000', 'last_fullsized': '2024-09-15T23:55:42.211390+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.218672+0000', 'last_change': '2024-09-15T23:55:42.218672+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.218672+0000', 'last_undegraded': '2024-09-15T23:55:42.218672+0000', 'last_fullsized': '2024-09-15T23:55:42.218672+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.216432+0000', 'last_change': '2024-09-15T23:55:42.216432+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.216432+0000', 'last_undegraded': '2024-09-15T23:55:42.216432+0000', 'last_fullsized': '2024-09-15T23:55:42.216432+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211600+0000', 'last_change': '2024-09-15T23:55:42.211600+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211600+0000', 'last_undegraded': '2024-09-15T23:55:42.211600+0000', 'last_fullsized': '2024-09-15T23:55:42.211600+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209115+0000', 'last_change': '2024-09-15T23:55:42.209115+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209115+0000', 'last_undegraded': '2024-09-15T23:55:42.209115+0000', 'last_fullsized': '2024-09-15T23:55:42.209115+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-15T23:55:46.827 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212554+0000', 'last_change': '2024-09-15T23:55:42.212554+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212554+0000', 'last_undegraded': '2024-09-15T23:55:42.212554+0000', 'last_fullsized': '2024-09-15T23:55:42.212554+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210852+0000', 'last_change': '2024-09-15T23:55:42.210852+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210852+0000', 'last_undegraded': '2024-09-15T23:55:42.210852+0000', 'last_fullsized': '2024-09-15T23:55:42.210852+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212729+0000', 'last_change': '2024-09-15T23:55:42.212729+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212729+0000', 'last_undegraded': '2024-09-15T23:55:42.212729+0000', 'last_fullsized': '2024-09-15T23:55:42.212729+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210217+0000', 'last_change': '2024-09-15T23:55:42.210217+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210217+0000', 'last_undegraded': '2024-09-15T23:55:42.210217+0000', 'last_fullsized': '2024-09-15T23:55:42.210217+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211783+0000', 'last_change': '2024-09-15T23:55:42.211783+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211783+0000', 'last_undegraded': '2024-09-15T23:55:42.211783+0000', 'last_fullsized': '2024-09-15T23:55:42.211783+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-15T23:55:46.828 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.216043+0000', 'last_change': '2024-09-15T23:55:42.216043+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.216043+0000', 'last_undegraded': '2024-09-15T23:55:42.216043+0000', 'last_fullsized': '2024-09-15T23:55:42.216043+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212496+0000', 'last_change': '2024-09-15T23:55:42.212496+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212496+0000', 'last_undegraded': '2024-09-15T23:55:42.212496+0000', 'last_fullsized': '2024-09-15T23:55:42.212496+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.222256+0000', 'last_change': '2024-09-15T23:55:42.222256+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.222256+0000', 'last_undegraded': '2024-09-15T23:55:42.222256+0000', 'last_fullsized': '2024-09-15T23:55:42.222256+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-15T23:55:46.829 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211772+0000', 'last_change': '2024-09-15T23:55:42.211772+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211772+0000', 'last_undegraded': '2024-09-15T23:55:42.211772+0000', 'last_fullsized': '2024-09-15T23:55:42.211772+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210029+0000', 'last_change': '2024-09-15T23:55:42.210029+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210029+0000', 'last_undegraded': '2024-09-15T23:55:42.210029+0000', 'last_fullsized': '2024-09-15T23:55:42.210029+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210168+0000', 'last_change': '2024-09-15T23:55:42.210168+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210168+0000', 'last_undegraded': '2024-09-15T23:55:42.210168+0000', 'last_fullsized': '2024-09-15T23:55:42.210168+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-15T23:55:46.830 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210988+0000', 'last_change': '2024-09-15T23:55:42.210988+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210988+0000', 'last_undegraded': '2024-09-15T23:55:42.210988+0000', 'last_fullsized': '2024-09-15T23:55:42.210988+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.211320+0000', 'last_change': '2024-09-15T23:55:42.211320+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.211320+0000', 'last_undegraded': '2024-09-15T23:55:42.211320+0000', 'last_fullsized': '2024-09-15T23:55:42.211320+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.215617+0000', 'last_change': '2024-09-15T23:55:42.215617+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.215617+0000', 'last_undegraded': '2024-09-15T23:55:42.215617+0000', 'last_fullsized': '2024-09-15T23:55:42.215617+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212102+0000', 'last_change': '2024-09-15T23:55:42.212102+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212102+0000', 'last_undegraded': '2024-09-15T23:55:42.212102+0000', 'last_fullsized': '2024-09-15T23:55:42.212102+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-15T23:55:46.831 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212121+0000', 'last_change': '2024-09-15T23:55:42.212121+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212121+0000', 'last_undegraded': '2024-09-15T23:55:42.212121+0000', 'last_fullsized': '2024-09-15T23:55:42.212121+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.210404+0000', 'last_change': '2024-09-15T23:55:42.210404+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.210404+0000', 'last_undegraded': '2024-09-15T23:55:42.210404+0000', 'last_fullsized': '2024-09-15T23:55:42.210404+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.208847+0000', 'last_change': '2024-09-15T23:55:42.208847+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.208847+0000', 'last_undegraded': '2024-09-15T23:55:42.208847+0000', 'last_fullsized': '2024-09-15T23:55:42.208847+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209955+0000', 'last_change': '2024-09-15T23:55:42.209955+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209955+0000', 'last_undegraded': '2024-09-15T23:55:42.209955+0000', 'last_fullsized': '2024-09-15T23:55:42.209955+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.209575+0000', 'last_change': '2024-09-15T23:55:42.209575+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.209575+0000', 'last_undegraded': '2024-09-15T23:55:42.209575+0000', 'last_fullsized': '2024-09-15T23:55:42.209575+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-15T23:55:46.832 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212980+0000', 'last_change': '2024-09-15T23:55:42.212980+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212980+0000', 'last_undegraded': '2024-09-15T23:55:42.212980+0000', 'last_fullsized': '2024-09-15T23:55:42.212980+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:55:46.833 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-15T23:55:46.833 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 25, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:55:42.212115+0000', 'last_change': '2024-09-15T23:55:42.212115+0000', 'last_active': '2024-09-15T23:55:42.201069+0000', 'last_peered': '2024-09-15T23:55:42.201069+0000', 'last_clean': '2024-09-15T23:55:42.201069+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:55:42.212115+0000', 'last_undegraded': '2024-09-15T23:55:42.212115+0000', 'last_fullsized': '2024-09-15T23:55:42.212115+0000', 'mapping_epoch': 25, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 25, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'last_clean_scrub_stamp': '2024-09-15T23:55:42.201069+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:55:46.833 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:55:46.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.929+0000 7f3bed0f1640 1 Processor -- start 2024-09-15T23:55:46.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.929+0000 7f3bed0f1640 1 -- start start 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3bed0f1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3be809f230 0x7f3be813cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3bed0f1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be809d7c0 con 0x7f3be8134910 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3bed0f1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3be809e6d0 con 0x7f3be809f230 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3be809f230 0x7f3be813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3be809f230 0x7f3be813cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36528/0 (socket says 172.21.15.121:36528) 2024-09-15T23:55:46.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be659c640 1 -- 172.21.15.121:0/418452072 learned_addr learned my addr 172.21.15.121:0/418452072 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:46.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be6d9d640 1 --1- 172.21.15.121:0/418452072 >> v1:172.21.15.121:6789/0 conn(0x7f3be8134910 0x7f3be8134cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35562/0 (socket says 172.21.15.121:35562) 2024-09-15T23:55:46.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be659c640 1 -- 172.21.15.121:0/418452072 >> v1:172.21.15.121:6789/0 conn(0x7f3be8134910 legacy=0x7f3be8134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be5d9b640 1 -- 172.21.15.121:0/418452072 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823825862 0 0) 0x7f3be809d7c0 con 0x7f3be8134910 2024-09-15T23:55:46.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.930+0000 7f3be659c640 1 -- 172.21.15.121:0/418452072 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be809f680 con 0x7f3be809f230 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3be659c640 1 --2- 172.21.15.121:0/418452072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be813cc90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0097f0 tx=0x7f3bdc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5894543f8233d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3be5d9b640 1 -- 172.21.15.121:0/418452072 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc037070 con 0x7f3be809f230 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3be5d9b640 1 -- 172.21.15.121:0/418452072 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc032440 con 0x7f3be809f230 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3be5d9b640 1 -- 172.21.15.121:0/418452072 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc02ae60 con 0x7f3be809f230 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 -- 172.21.15.121:0/418452072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 msgr2=0x7f3be813cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/418452072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be813cc90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0097f0 tx=0x7f3bdc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 -- 172.21.15.121:0/418452072 shutdown_connections 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/418452072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be813cc90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 -- 172.21.15.121:0/418452072 >> 172.21.15.121:0/418452072 conn(0x7f3be80a8400 msgr2=0x7f3be80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 -- 172.21.15.121:0/418452072 shutdown_connections 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.931+0000 7f3bed0f1640 1 -- 172.21.15.121:0/418452072 wait complete. 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3bed0f1640 1 Processor -- start 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3bed0f1640 1 -- start start 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3bed0f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3bed0f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3be809e900 con 0x7f3be809f230 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3be6d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3be6d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36542/0 (socket says 172.21.15.121:36542) 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.933+0000 7f3be6d9d640 1 -- 172.21.15.121:0/3049262018 learned_addr learned my addr 172.21.15.121:0/3049262018 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3be6d9d640 1 -- 172.21.15.121:0/3049262018 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be8072e50 con 0x7f3be809f230 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3be6d9d640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c4d0 tx=0x7f3bd800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd8007470 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd8007610 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be8073160 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd8005980 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.934+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be8071320 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.935+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3bd8005b20 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.935+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be811eb70 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.935+0000 7f3bcf7fe640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 0x7f3bd403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.935+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f3bd804af40 con 0x7f3be809f230 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.935+0000 7f3be659c640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 0x7f3bd403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:46.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.936+0000 7f3be659c640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 0x7f3bd403a760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc034000 tx=0x7f3bdc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:46.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:46.940+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3be811eb70 con 0x7f3be809f230 2024-09-15T23:55:47.058 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-09-15T23:55:47.057+0000 7fa112af0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:55:47.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.170+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3be80a6ee0 con 0x7f3be809f230 2024-09-15T23:55:47.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.170+0000 7f3bcf7fe640 1 -- 172.21.15.121:0/3049262018 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1967 (secure 0 0 0) 0x7f3bd80182b0 con 0x7f3be809f230 2024-09-15T23:55:47.171 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:47.172 INFO:teuthology.orchestra.run.smithi121.stdout:{"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":55,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":27,"num_osds":3,"num_up_osds":3,"osd_up_since":1726444502,"num_in_osds":3,"osd_in_since":1726444492,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":89141248,"bytes_avail":289821151232,"bytes_total":289910292480,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4330}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-15T23:55:34.027062+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:55:47.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 msgr2=0x7f3bd403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 0x7f3bd403a760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc034000 tx=0x7f3bdc02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 msgr2=0x7f3be811e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800c4d0 tx=0x7f3bd800c990 comp rx=0 tx=0).stop 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 shutdown_connections 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f3bd40382a0 0x7f3bd403a760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 --2- 172.21.15.121:0/3049262018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3be809f230 0x7f3be811e3f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 >> 172.21.15.121:0/3049262018 conn(0x7f3be80a8400 msgr2=0x7f3be81bfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 shutdown_connections 2024-09-15T23:55:47.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.172+0000 7f3bed0f1640 1 -- 172.21.15.121:0/3049262018 wait complete. 2024-09-15T23:55:47.185 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:55:47.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:47.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.291+0000 7f60acf8d640 1 Processor -- start 2024-09-15T23:55:47.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.291+0000 7f60acf8d640 1 -- start start 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.292+0000 7f60acf8d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60a813a280 0x7f60a813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.292+0000 7f60acf8d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a813a080 con 0x7f60a80a4c20 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.292+0000 7f60acf8d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f60a80a3d50 con 0x7f60a813a280 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60a813a280 0x7f60a813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f60a813a280 0x7f60a813a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36546/0 (socket says 172.21.15.121:36546) 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a659c640 1 -- 172.21.15.121:0/2990068805 learned_addr learned my addr 172.21.15.121:0/2990068805 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a5d9b640 1 --1- 172.21.15.121:0/2990068805 >> v1:172.21.15.121:6789/0 conn(0x7f60a80a4c20 0x7f60a80a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35572/0 (socket says 172.21.15.121:35572) 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a659c640 1 -- 172.21.15.121:0/2990068805 >> v1:172.21.15.121:6789/0 conn(0x7f60a80a4c20 legacy=0x7f60a80a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.293+0000 7f60a659c640 1 -- 172.21.15.121:0/2990068805 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a80a3f80 con 0x7f60a813a280 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.294+0000 7f60a659c640 1 --2- 172.21.15.121:0/2990068805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a813a280 0x7f60a813a660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f60980097f0 tx=0x7f609802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2163f5cc4dad1684 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:47.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.294+0000 7f60a559a640 1 -- 172.21.15.121:0/2990068805 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6098037070 con 0x7f60a813a280 2024-09-15T23:55:47.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.294+0000 7f60a559a640 1 -- 172.21.15.121:0/2990068805 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6098032440 con 0x7f60a813a280 2024-09-15T23:55:47.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.294+0000 7f60a559a640 1 -- 172.21.15.121:0/2990068805 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f609802ae60 con 0x7f60a813a280 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 -- 172.21.15.121:0/2990068805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a813a280 msgr2=0x7f60a813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 --2- 172.21.15.121:0/2990068805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a813a280 0x7f60a813a660 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f60980097f0 tx=0x7f609802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 -- 172.21.15.121:0/2990068805 shutdown_connections 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 --2- 172.21.15.121:0/2990068805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a813a280 0x7f60a813a660 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 -- 172.21.15.121:0/2990068805 >> 172.21.15.121:0/2990068805 conn(0x7f60a80ac3e0 msgr2=0x7f60a80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 -- 172.21.15.121:0/2990068805 shutdown_connections 2024-09-15T23:55:47.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.295+0000 7f60acf8d640 1 -- 172.21.15.121:0/2990068805 wait complete. 2024-09-15T23:55:47.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.297+0000 7f60acf8d640 1 Processor -- start 2024-09-15T23:55:47.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.297+0000 7f60acf8d640 1 -- start start 2024-09-15T23:55:47.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.297+0000 7f60acf8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:47.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.297+0000 7f60acf8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60a8139d40 con 0x7f60a80a4c20 2024-09-15T23:55:47.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60a659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:47.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60a659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36552/0 (socket says 172.21.15.121:36552) 2024-09-15T23:55:47.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60a659c640 1 -- 172.21.15.121:0/3217157557 learned_addr learned my addr 172.21.15.121:0/3217157557 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60a659c640 1 -- 172.21.15.121:0/3217157557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a8124ff0 con 0x7f60a80a4c20 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60a659c640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6098035040 tx=0x7f60980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6098041020 con 0x7f60a80a4c20 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60980307f0 con 0x7f60a80a4c20 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a8125270 con 0x7f60a80a4c20 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6098037040 con 0x7f60a80a4c20 2024-09-15T23:55:47.301 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.298+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a8138290 con 0x7f60a80a4c20 2024-09-15T23:55:47.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.299+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6098044020 con 0x7f60a80a4c20 2024-09-15T23:55:47.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.299+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a806dab0 con 0x7f60a80a4c20 2024-09-15T23:55:47.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.300+0000 7f6096ffd640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 0x7f608803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:47.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.300+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f609806bc10 con 0x7f60a80a4c20 2024-09-15T23:55:47.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.300+0000 7f60a5d9b640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 0x7f608803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:47.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.300+0000 7f60a5d9b640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 0x7f608803a710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f609c001550 tx=0x7f609c007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:47.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.304+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f609804b030 con 0x7f60a80a4c20 2024-09-15T23:55:47.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.473+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60a80a2f50 con 0x7f6088038250 2024-09-15T23:55:47.485 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.484+0000 7f6096ffd640 1 -- 172.21.15.121:0/3217157557 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240666 (secure 0 0 0) 0x7f60a80a2f50 con 0x7f6088038250 2024-09-15T23:55:47.487 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:47.488 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:47.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 msgr2=0x7f608803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 0x7f608803a710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f609c001550 tx=0x7f609c007a40 comp rx=0 tx=0).stop 2024-09-15T23:55:47.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 msgr2=0x7f60a80a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:47.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6098035040 tx=0x7f60980046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 shutdown_connections 2024-09-15T23:55:47.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f6088038250 0x7f608803a710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 --2- 172.21.15.121:0/3217157557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60a80a4c20 0x7f60a80a1150 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:47.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 >> 172.21.15.121:0/3217157557 conn(0x7f60a80ac3e0 msgr2=0x7f60a80aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:47.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 shutdown_connections 2024-09-15T23:55:47.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:47.487+0000 7f60acf8d640 1 -- 172.21.15.121:0/3217157557 wait complete. 2024-09-15T23:55:47.498 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-15T23:55:46.028844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87052,"kb_used_data":1800,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028468,"statfs":{"total":289910292480,"available":289821151232,"internally_reserved":0,"allocated":1843200,"data_stored":1392357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827751"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213470+0000","last_change":"2024-09-15T23:55:42.213470+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213470+0000","last_undegraded":"2024-09-15T23:55:42.213470+0000","last_fullsized":"2024-09-15T23:55:42.213470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215439+0000","last_change":"2024-09-15T23:55:42.215439+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215439+0000","last_undegraded":"2024-09-15T23:55:42.215439+0000","last_fullsized":"2024-09-15T23:55:42.215439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215816+0000","last_change":"2024-09-15T23:55:42.215816+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215816+0000","last_undegraded":"2024-09-15T23:55:42.215816+0000","last_fullsized":"2024-09-15T23:55:42.215816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215244+0000","last_change":"2024-09-15T23:55:42.215244+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215244+0000","last_undegraded":"2024-09-15T23:55:42.215244+0000","last_fullsized":"2024-09-15T23:55:42.215244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214155+0000","last_change":"2024-09-15T23:55:42.214155+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214155+0000","last_undegraded":"2024-09-15T23:55:42.214155+0000","last_fullsized":"2024-09-15T23:55:42.214155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215980+0000","last_change":"2024-09-15T23:55:42.215980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215980+0000","last_undegraded":"2024-09-15T23:55:42.215980+0000","last_fullsized":"2024-09-15T23:55:42.215980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212654+0000","last_change":"2024-09-15T23:55:42.212654+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212654+0000","last_undegraded":"2024-09-15T23:55:42.212654+0000","last_fullsized":"2024-09-15T23:55:42.212654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213914+0000","last_change":"2024-09-15T23:55:42.213914+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213914+0000","last_undegraded":"2024-09-15T23:55:42.213914+0000","last_fullsized":"2024-09-15T23:55:42.213914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.219578+0000","last_change":"2024-09-15T23:55:42.219578+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.219578+0000","last_undegraded":"2024-09-15T23:55:42.219578+0000","last_fullsized":"2024-09-15T23:55:42.219578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215419+0000","last_change":"2024-09-15T23:55:42.215419+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215419+0000","last_undegraded":"2024-09-15T23:55:42.215419+0000","last_fullsized":"2024-09-15T23:55:42.215419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211647+0000","last_change":"2024-09-15T23:55:42.211647+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211647+0000","last_undegraded":"2024-09-15T23:55:42.211647+0000","last_fullsized":"2024-09-15T23:55:42.211647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212138+0000","last_change":"2024-09-15T23:55:42.212138+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212138+0000","last_undegraded":"2024-09-15T23:55:42.212138+0000","last_fullsized":"2024-09-15T23:55:42.212138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213705+0000","last_change":"2024-09-15T23:55:42.213705+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213705+0000","last_undegraded":"2024-09-15T23:55:42.213705+0000","last_fullsized":"2024-09-15T23:55:42.213705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210492+0000","last_change":"2024-09-15T23:55:42.210492+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210492+0000","last_undegraded":"2024-09-15T23:55:42.210492+0000","last_fullsized":"2024-09-15T23:55:42.210492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212489+0000","last_change":"2024-09-15T23:55:42.212489+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212489+0000","last_undegraded":"2024-09-15T23:55:42.212489+0000","last_fullsized":"2024-09-15T23:55:42.212489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214921+0000","last_change":"2024-09-15T23:55:42.214921+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214921+0000","last_undegraded":"2024-09-15T23:55:42.214921+0000","last_fullsized":"2024-09-15T23:55:42.214921+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212673+0000","last_change":"2024-09-15T23:55:42.212673+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212673+0000","last_undegraded":"2024-09-15T23:55:42.212673+0000","last_fullsized":"2024-09-15T23:55:42.212673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215050+0000","last_change":"2024-09-15T23:55:42.215050+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215050+0000","last_undegraded":"2024-09-15T23:55:42.215050+0000","last_fullsized":"2024-09-15T23:55:42.215050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211272+0000","last_change":"2024-09-15T23:55:42.211272+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211272+0000","last_undegraded":"2024-09-15T23:55:42.211272+0000","last_fullsized":"2024-09-15T23:55:42.211272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213134+0000","last_change":"2024-09-15T23:55:42.213134+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213134+0000","last_undegraded":"2024-09-15T23:55:42.213134+0000","last_fullsized":"2024-09-15T23:55:42.213134+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211389+0000","last_change":"2024-09-15T23:55:42.211389+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211389+0000","last_undegraded":"2024-09-15T23:55:42.211389+0000","last_fullsized":"2024-09-15T23:55:42.211389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213079+0000","last_change":"2024-09-15T23:55:42.213079+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213079+0000","last_undegraded":"2024-09-15T23:55:42.213079+0000","last_fullsized":"2024-09-15T23:55:42.213079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210218+0000","last_change":"2024-09-15T23:55:42.210218+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210218+0000","last_undegraded":"2024-09-15T23:55:42.210218+0000","last_fullsized":"2024-09-15T23:55:42.210218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.213299+0000","last_change":"2024-09-15T23:55:42.213299+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.213299+0000","last_undegraded":"2024-09-15T23:55:42.213299+0000","last_fullsized":"2024-09-15T23:55:42.213299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222637+0000","last_change":"2024-09-15T23:55:42.222637+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222637+0000","last_undegraded":"2024-09-15T23:55:42.222637+0000","last_fullsized":"2024-09-15T23:55:42.222637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212919+0000","last_change":"2024-09-15T23:55:42.212919+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212919+0000","last_undegraded":"2024-09-15T23:55:42.212919+0000","last_fullsized":"2024-09-15T23:55:42.212919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218426+0000","last_change":"2024-09-15T23:55:42.218426+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218426+0000","last_undegraded":"2024-09-15T23:55:42.218426+0000","last_fullsized":"2024-09-15T23:55:42.218426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211019+0000","last_change":"2024-09-15T23:55:42.211019+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211019+0000","last_undegraded":"2024-09-15T23:55:42.211019+0000","last_fullsized":"2024-09-15T23:55:42.211019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210810+0000","last_change":"2024-09-15T23:55:42.210810+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210810+0000","last_undegraded":"2024-09-15T23:55:42.210810+0000","last_fullsized":"2024-09-15T23:55:42.210810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209956+0000","last_change":"2024-09-15T23:55:42.209956+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209956+0000","last_undegraded":"2024-09-15T23:55:42.209956+0000","last_fullsized":"2024-09-15T23:55:42.209956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209530+0000","last_change":"2024-09-15T23:55:42.209530+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209530+0000","last_undegraded":"2024-09-15T23:55:42.209530+0000","last_fullsized":"2024-09-15T23:55:42.209530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212168+0000","last_change":"2024-09-15T23:55:42.212168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212168+0000","last_undegraded":"2024-09-15T23:55:42.212168+0000","last_fullsized":"2024-09-15T23:55:42.212168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.214625+0000","last_change":"2024-09-15T23:55:42.214625+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.214625+0000","last_undegraded":"2024-09-15T23:55:42.214625+0000","last_fullsized":"2024-09-15T23:55:42.214625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234608+0000","last_change":"2024-09-15T23:55:42.233492+0000","last_active":"2024-09-15T23:55:42.234608+0000","last_peered":"2024-09-15T23:55:42.234608+0000","last_clean":"2024-09-15T23:55:42.234608+0000","last_became_active":"2024-09-15T23:55:42.233237+0000","last_became_peered":"2024-09-15T23:55:42.233237+0000","last_unstale":"2024-09-15T23:55:42.234608+0000","last_undegraded":"2024-09-15T23:55:42.234608+0000","last_fullsized":"2024-09-15T23:55:42.234608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:38.510269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209589+0000","last_change":"2024-09-15T23:55:42.209589+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209589+0000","last_undegraded":"2024-09-15T23:55:42.209589+0000","last_fullsized":"2024-09-15T23:55:42.209589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231304+0000","last_change":"2024-09-15T23:55:42.227655+0000","last_active":"2024-09-15T23:55:42.231304+0000","last_peered":"2024-09-15T23:55:42.231304+0000","last_clean":"2024-09-15T23:55:42.231304+0000","last_became_active":"2024-09-15T23:55:42.227114+0000","last_became_peered":"2024-09-15T23:55:42.227114+0000","last_unstale":"2024-09-15T23:55:42.231304+0000","last_undegraded":"2024-09-15T23:55:42.231304+0000","last_fullsized":"2024-09-15T23:55:42.231304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:45.106175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210674+0000","last_change":"2024-09-15T23:55:42.210674+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210674+0000","last_undegraded":"2024-09-15T23:55:42.210674+0000","last_fullsized":"2024-09-15T23:55:42.210674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231397+0000","last_change":"2024-09-15T23:55:42.227590+0000","last_active":"2024-09-15T23:55:42.231397+0000","last_peered":"2024-09-15T23:55:42.231397+0000","last_clean":"2024-09-15T23:55:42.231397+0000","last_became_active":"2024-09-15T23:55:42.227300+0000","last_became_peered":"2024-09-15T23:55:42.227300+0000","last_unstale":"2024-09-15T23:55:42.231397+0000","last_undegraded":"2024-09-15T23:55:42.231397+0000","last_fullsized":"2024-09-15T23:55:42.231397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:35.069585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218037+0000","last_change":"2024-09-15T23:55:42.218037+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218037+0000","last_undegraded":"2024-09-15T23:55:42.218037+0000","last_fullsized":"2024-09-15T23:55:42.218037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233608+0000","last_change":"2024-09-15T23:55:42.229229+0000","last_active":"2024-09-15T23:55:42.233608+0000","last_peered":"2024-09-15T23:55:42.233608+0000","last_clean":"2024-09-15T23:55:42.233608+0000","last_became_active":"2024-09-15T23:55:42.228892+0000","last_became_peered":"2024-09-15T23:55:42.228892+0000","last_unstale":"2024-09-15T23:55:42.233608+0000","last_undegraded":"2024-09-15T23:55:42.233608+0000","last_fullsized":"2024-09-15T23:55:42.233608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:52.300497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215633+0000","last_change":"2024-09-15T23:55:42.215633+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215633+0000","last_undegraded":"2024-09-15T23:55:42.215633+0000","last_fullsized":"2024-09-15T23:55:42.215633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230619+0000","last_change":"2024-09-15T23:55:42.228095+0000","last_active":"2024-09-15T23:55:42.230619+0000","last_peered":"2024-09-15T23:55:42.230619+0000","last_clean":"2024-09-15T23:55:42.230619+0000","last_became_active":"2024-09-15T23:55:42.227826+0000","last_became_peered":"2024-09-15T23:55:42.227826+0000","last_unstale":"2024-09-15T23:55:42.230619+0000","last_undegraded":"2024-09-15T23:55:42.230619+0000","last_fullsized":"2024-09-15T23:55:42.230619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:40.831432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211390+0000","last_change":"2024-09-15T23:55:42.211390+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211390+0000","last_undegraded":"2024-09-15T23:55:42.211390+0000","last_fullsized":"2024-09-15T23:55:42.211390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.226388+0000","last_change":"2024-09-15T23:55:42.223388+0000","last_active":"2024-09-15T23:55:42.226388+0000","last_peered":"2024-09-15T23:55:42.226388+0000","last_clean":"2024-09-15T23:55:42.226388+0000","last_became_active":"2024-09-15T23:55:42.223117+0000","last_became_peered":"2024-09-15T23:55:42.223117+0000","last_unstale":"2024-09-15T23:55:42.226388+0000","last_undegraded":"2024-09-15T23:55:42.226388+0000","last_fullsized":"2024-09-15T23:55:42.226388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:57.599146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.218672+0000","last_change":"2024-09-15T23:55:42.218672+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.218672+0000","last_undegraded":"2024-09-15T23:55:42.218672+0000","last_fullsized":"2024-09-15T23:55:42.218672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.219278+0000","last_change":"2024-09-15T23:55:42.218000+0000","last_active":"2024-09-15T23:55:42.219278+0000","last_peered":"2024-09-15T23:55:42.219278+0000","last_clean":"2024-09-15T23:55:42.219278+0000","last_became_active":"2024-09-15T23:55:42.217248+0000","last_became_peered":"2024-09-15T23:55:42.217248+0000","last_unstale":"2024-09-15T23:55:42.219278+0000","last_undegraded":"2024-09-15T23:55:42.219278+0000","last_fullsized":"2024-09-15T23:55:42.219278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:12.128635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216432+0000","last_change":"2024-09-15T23:55:42.216432+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216432+0000","last_undegraded":"2024-09-15T23:55:42.216432+0000","last_fullsized":"2024-09-15T23:55:42.216432+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233710+0000","last_change":"2024-09-15T23:55:42.230514+0000","last_active":"2024-09-15T23:55:42.233710+0000","last_peered":"2024-09-15T23:55:42.233710+0000","last_clean":"2024-09-15T23:55:42.233710+0000","last_became_active":"2024-09-15T23:55:42.228955+0000","last_became_peered":"2024-09-15T23:55:42.228955+0000","last_unstale":"2024-09-15T23:55:42.233710+0000","last_undegraded":"2024-09-15T23:55:42.233710+0000","last_fullsized":"2024-09-15T23:55:42.233710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:20.726368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211600+0000","last_change":"2024-09-15T23:55:42.211600+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211600+0000","last_undegraded":"2024-09-15T23:55:42.211600+0000","last_fullsized":"2024-09-15T23:55:42.211600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234590+0000","last_change":"2024-09-15T23:55:42.233343+0000","last_active":"2024-09-15T23:55:42.234590+0000","last_peered":"2024-09-15T23:55:42.234590+0000","last_clean":"2024-09-15T23:55:42.234590+0000","last_became_active":"2024-09-15T23:55:42.233082+0000","last_became_peered":"2024-09-15T23:55:42.233082+0000","last_unstale":"2024-09-15T23:55:42.234590+0000","last_undegraded":"2024-09-15T23:55:42.234590+0000","last_fullsized":"2024-09-15T23:55:42.234590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:13.962428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209115+0000","last_change":"2024-09-15T23:55:42.209115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209115+0000","last_undegraded":"2024-09-15T23:55:42.209115+0000","last_fullsized":"2024-09-15T23:55:42.209115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218593+0000","last_change":"2024-09-15T23:55:42.217126+0000","last_active":"2024-09-15T23:55:42.218593+0000","last_peered":"2024-09-15T23:55:42.218593+0000","last_clean":"2024-09-15T23:55:42.218593+0000","last_became_active":"2024-09-15T23:55:42.216854+0000","last_became_peered":"2024-09-15T23:55:42.216854+0000","last_unstale":"2024-09-15T23:55:42.218593+0000","last_undegraded":"2024-09-15T23:55:42.218593+0000","last_fullsized":"2024-09-15T23:55:42.218593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:07.234549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212554+0000","last_change":"2024-09-15T23:55:42.212554+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212554+0000","last_undegraded":"2024-09-15T23:55:42.212554+0000","last_fullsized":"2024-09-15T23:55:42.212554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231359+0000","last_change":"2024-09-15T23:55:42.227422+0000","last_active":"2024-09-15T23:55:42.231359+0000","last_peered":"2024-09-15T23:55:42.231359+0000","last_clean":"2024-09-15T23:55:42.231359+0000","last_became_active":"2024-09-15T23:55:42.227135+0000","last_became_peered":"2024-09-15T23:55:42.227135+0000","last_unstale":"2024-09-15T23:55:42.231359+0000","last_undegraded":"2024-09-15T23:55:42.231359+0000","last_fullsized":"2024-09-15T23:55:42.231359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:47.730774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210852+0000","last_change":"2024-09-15T23:55:42.210852+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210852+0000","last_undegraded":"2024-09-15T23:55:42.210852+0000","last_fullsized":"2024-09-15T23:55:42.210852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234713+0000","last_change":"2024-09-15T23:55:42.232680+0000","last_active":"2024-09-15T23:55:42.234713+0000","last_peered":"2024-09-15T23:55:42.234713+0000","last_clean":"2024-09-15T23:55:42.234713+0000","last_became_active":"2024-09-15T23:55:42.232415+0000","last_became_peered":"2024-09-15T23:55:42.232415+0000","last_unstale":"2024-09-15T23:55:42.234713+0000","last_undegraded":"2024-09-15T23:55:42.234713+0000","last_fullsized":"2024-09-15T23:55:42.234713+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.986284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212729+0000","last_change":"2024-09-15T23:55:42.212729+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212729+0000","last_undegraded":"2024-09-15T23:55:42.212729+0000","last_fullsized":"2024-09-15T23:55:42.212729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233516+0000","last_change":"2024-09-15T23:55:42.229038+0000","last_active":"2024-09-15T23:55:42.233516+0000","last_peered":"2024-09-15T23:55:42.233516+0000","last_clean":"2024-09-15T23:55:42.233516+0000","last_became_active":"2024-09-15T23:55:42.228474+0000","last_became_peered":"2024-09-15T23:55:42.228474+0000","last_unstale":"2024-09-15T23:55:42.233516+0000","last_undegraded":"2024-09-15T23:55:42.233516+0000","last_fullsized":"2024-09-15T23:55:42.233516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:32.453009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210217+0000","last_change":"2024-09-15T23:55:42.210217+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210217+0000","last_undegraded":"2024-09-15T23:55:42.210217+0000","last_fullsized":"2024-09-15T23:55:42.210217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227583+0000","last_change":"2024-09-15T23:55:42.226400+0000","last_active":"2024-09-15T23:55:42.227583+0000","last_peered":"2024-09-15T23:55:42.227583+0000","last_clean":"2024-09-15T23:55:42.227583+0000","last_became_active":"2024-09-15T23:55:42.226109+0000","last_became_peered":"2024-09-15T23:55:42.226109+0000","last_unstale":"2024-09-15T23:55:42.227583+0000","last_undegraded":"2024-09-15T23:55:42.227583+0000","last_fullsized":"2024-09-15T23:55:42.227583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:04.138219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211783+0000","last_change":"2024-09-15T23:55:42.211783+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211783+0000","last_undegraded":"2024-09-15T23:55:42.211783+0000","last_fullsized":"2024-09-15T23:55:42.211783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.221450+0000","last_change":"2024-09-15T23:55:42.220273+0000","last_active":"2024-09-15T23:55:42.221450+0000","last_peered":"2024-09-15T23:55:42.221450+0000","last_clean":"2024-09-15T23:55:42.221450+0000","last_became_active":"2024-09-15T23:55:42.219755+0000","last_became_peered":"2024-09-15T23:55:42.219755+0000","last_unstale":"2024-09-15T23:55:42.221450+0000","last_undegraded":"2024-09-15T23:55:42.221450+0000","last_fullsized":"2024-09-15T23:55:42.221450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:10.677304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.216043+0000","last_change":"2024-09-15T23:55:42.216043+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.216043+0000","last_undegraded":"2024-09-15T23:55:42.216043+0000","last_fullsized":"2024-09-15T23:55:42.216043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.235125+0000","last_change":"2024-09-15T23:55:42.233298+0000","last_active":"2024-09-15T23:55:42.235125+0000","last_peered":"2024-09-15T23:55:42.235125+0000","last_clean":"2024-09-15T23:55:42.235125+0000","last_became_active":"2024-09-15T23:55:42.233077+0000","last_became_peered":"2024-09-15T23:55:42.233077+0000","last_unstale":"2024-09-15T23:55:42.235125+0000","last_undegraded":"2024-09-15T23:55:42.235125+0000","last_fullsized":"2024-09-15T23:55:42.235125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:50.606047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212496+0000","last_change":"2024-09-15T23:55:42.212496+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212496+0000","last_undegraded":"2024-09-15T23:55:42.212496+0000","last_fullsized":"2024-09-15T23:55:42.212496+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227624+0000","last_change":"2024-09-15T23:55:42.226711+0000","last_active":"2024-09-15T23:55:42.227624+0000","last_peered":"2024-09-15T23:55:42.227624+0000","last_clean":"2024-09-15T23:55:42.227624+0000","last_became_active":"2024-09-15T23:55:42.226436+0000","last_became_peered":"2024-09-15T23:55:42.226436+0000","last_unstale":"2024-09-15T23:55:42.227624+0000","last_undegraded":"2024-09-15T23:55:42.227624+0000","last_fullsized":"2024-09-15T23:55:42.227624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:38.572689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.222256+0000","last_change":"2024-09-15T23:55:42.222256+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.222256+0000","last_undegraded":"2024-09-15T23:55:42.222256+0000","last_fullsized":"2024-09-15T23:55:42.222256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233541+0000","last_change":"2024-09-15T23:55:42.229093+0000","last_active":"2024-09-15T23:55:42.233541+0000","last_peered":"2024-09-15T23:55:42.233541+0000","last_clean":"2024-09-15T23:55:42.233541+0000","last_became_active":"2024-09-15T23:55:42.228543+0000","last_became_peered":"2024-09-15T23:55:42.228543+0000","last_unstale":"2024-09-15T23:55:42.233541+0000","last_undegraded":"2024-09-15T23:55:42.233541+0000","last_fullsized":"2024-09-15T23:55:42.233541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:43.322933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211772+0000","last_change":"2024-09-15T23:55:42.211772+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211772+0000","last_undegraded":"2024-09-15T23:55:42.211772+0000","last_fullsized":"2024-09-15T23:55:42.211772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233496+0000","last_change":"2024-09-15T23:55:42.231292+0000","last_active":"2024-09-15T23:55:42.233496+0000","last_peered":"2024-09-15T23:55:42.233496+0000","last_clean":"2024-09-15T23:55:42.233496+0000","last_became_active":"2024-09-15T23:55:42.230815+0000","last_became_peered":"2024-09-15T23:55:42.230815+0000","last_unstale":"2024-09-15T23:55:42.233496+0000","last_undegraded":"2024-09-15T23:55:42.233496+0000","last_fullsized":"2024-09-15T23:55:42.233496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:20.635960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210029+0000","last_change":"2024-09-15T23:55:42.210029+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210029+0000","last_undegraded":"2024-09-15T23:55:42.210029+0000","last_fullsized":"2024-09-15T23:55:42.210029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231334+0000","last_change":"2024-09-15T23:55:42.227704+0000","last_active":"2024-09-15T23:55:42.231334+0000","last_peered":"2024-09-15T23:55:42.231334+0000","last_clean":"2024-09-15T23:55:42.231334+0000","last_became_active":"2024-09-15T23:55:42.226981+0000","last_became_peered":"2024-09-15T23:55:42.226981+0000","last_unstale":"2024-09-15T23:55:42.231334+0000","last_undegraded":"2024-09-15T23:55:42.231334+0000","last_fullsized":"2024-09-15T23:55:42.231334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:02.879850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210168+0000","last_change":"2024-09-15T23:55:42.210168+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210168+0000","last_undegraded":"2024-09-15T23:55:42.210168+0000","last_fullsized":"2024-09-15T23:55:42.210168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231424+0000","last_change":"2024-09-15T23:55:42.228234+0000","last_active":"2024-09-15T23:55:42.231424+0000","last_peered":"2024-09-15T23:55:42.231424+0000","last_clean":"2024-09-15T23:55:42.231424+0000","last_became_active":"2024-09-15T23:55:42.228025+0000","last_became_peered":"2024-09-15T23:55:42.228025+0000","last_unstale":"2024-09-15T23:55:42.231424+0000","last_undegraded":"2024-09-15T23:55:42.231424+0000","last_fullsized":"2024-09-15T23:55:42.231424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:15.652503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210988+0000","last_change":"2024-09-15T23:55:42.210988+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210988+0000","last_undegraded":"2024-09-15T23:55:42.210988+0000","last_fullsized":"2024-09-15T23:55:42.210988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233685+0000","last_change":"2024-09-15T23:55:42.230626+0000","last_active":"2024-09-15T23:55:42.233685+0000","last_peered":"2024-09-15T23:55:42.233685+0000","last_clean":"2024-09-15T23:55:42.233685+0000","last_became_active":"2024-09-15T23:55:42.229558+0000","last_became_peered":"2024-09-15T23:55:42.229558+0000","last_unstale":"2024-09-15T23:55:42.233685+0000","last_undegraded":"2024-09-15T23:55:42.233685+0000","last_fullsized":"2024-09-15T23:55:42.233685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:53.004728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.211320+0000","last_change":"2024-09-15T23:55:42.211320+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.211320+0000","last_undegraded":"2024-09-15T23:55:42.211320+0000","last_fullsized":"2024-09-15T23:55:42.211320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233985+0000","last_change":"2024-09-15T23:55:42.232416+0000","last_active":"2024-09-15T23:55:42.233985+0000","last_peered":"2024-09-15T23:55:42.233985+0000","last_clean":"2024-09-15T23:55:42.233985+0000","last_became_active":"2024-09-15T23:55:42.232148+0000","last_became_peered":"2024-09-15T23:55:42.232148+0000","last_unstale":"2024-09-15T23:55:42.233985+0000","last_undegraded":"2024-09-15T23:55:42.233985+0000","last_fullsized":"2024-09-15T23:55:42.233985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.743577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.215617+0000","last_change":"2024-09-15T23:55:42.215617+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.215617+0000","last_undegraded":"2024-09-15T23:55:42.215617+0000","last_fullsized":"2024-09-15T23:55:42.215617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231135+0000","last_change":"2024-09-15T23:55:42.229509+0000","last_active":"2024-09-15T23:55:42.231135+0000","last_peered":"2024-09-15T23:55:42.231135+0000","last_clean":"2024-09-15T23:55:42.231135+0000","last_became_active":"2024-09-15T23:55:42.229201+0000","last_became_peered":"2024-09-15T23:55:42.229201+0000","last_unstale":"2024-09-15T23:55:42.231135+0000","last_undegraded":"2024-09-15T23:55:42.231135+0000","last_fullsized":"2024-09-15T23:55:42.231135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:44.593277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212102+0000","last_change":"2024-09-15T23:55:42.212102+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212102+0000","last_undegraded":"2024-09-15T23:55:42.212102+0000","last_fullsized":"2024-09-15T23:55:42.212102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.233982+0000","last_change":"2024-09-15T23:55:42.232445+0000","last_active":"2024-09-15T23:55:42.233982+0000","last_peered":"2024-09-15T23:55:42.233982+0000","last_clean":"2024-09-15T23:55:42.233982+0000","last_became_active":"2024-09-15T23:55:42.232171+0000","last_became_peered":"2024-09-15T23:55:42.232171+0000","last_unstale":"2024-09-15T23:55:42.233982+0000","last_undegraded":"2024-09-15T23:55:42.233982+0000","last_fullsized":"2024-09-15T23:55:42.233982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:52.279847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212121+0000","last_change":"2024-09-15T23:55:42.212121+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212121+0000","last_undegraded":"2024-09-15T23:55:42.212121+0000","last_fullsized":"2024-09-15T23:55:42.212121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231280+0000","last_change":"2024-09-15T23:55:42.227428+0000","last_active":"2024-09-15T23:55:42.231280+0000","last_peered":"2024-09-15T23:55:42.231280+0000","last_clean":"2024-09-15T23:55:42.231280+0000","last_became_active":"2024-09-15T23:55:42.227111+0000","last_became_peered":"2024-09-15T23:55:42.227111+0000","last_unstale":"2024-09-15T23:55:42.231280+0000","last_undegraded":"2024-09-15T23:55:42.231280+0000","last_fullsized":"2024-09-15T23:55:42.231280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:59.483861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.210404+0000","last_change":"2024-09-15T23:55:42.210404+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.210404+0000","last_undegraded":"2024-09-15T23:55:42.210404+0000","last_fullsized":"2024-09-15T23:55:42.210404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.227796+0000","last_change":"2024-09-15T23:55:42.223960+0000","last_active":"2024-09-15T23:55:42.227796+0000","last_peered":"2024-09-15T23:55:42.227796+0000","last_clean":"2024-09-15T23:55:42.227796+0000","last_became_active":"2024-09-15T23:55:42.223701+0000","last_became_peered":"2024-09-15T23:55:42.223701+0000","last_unstale":"2024-09-15T23:55:42.227796+0000","last_undegraded":"2024-09-15T23:55:42.227796+0000","last_fullsized":"2024-09-15T23:55:42.227796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:38.030906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.208847+0000","last_change":"2024-09-15T23:55:42.208847+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.208847+0000","last_undegraded":"2024-09-15T23:55:42.208847+0000","last_fullsized":"2024-09-15T23:55:42.208847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.218320+0000","last_change":"2024-09-15T23:55:42.216705+0000","last_active":"2024-09-15T23:55:42.218320+0000","last_peered":"2024-09-15T23:55:42.218320+0000","last_clean":"2024-09-15T23:55:42.218320+0000","last_became_active":"2024-09-15T23:55:42.216416+0000","last_became_peered":"2024-09-15T23:55:42.216416+0000","last_unstale":"2024-09-15T23:55:42.218320+0000","last_undegraded":"2024-09-15T23:55:42.218320+0000","last_fullsized":"2024-09-15T23:55:42.218320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:50.897137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209955+0000","last_change":"2024-09-15T23:55:42.209955+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209955+0000","last_undegraded":"2024-09-15T23:55:42.209955+0000","last_fullsized":"2024-09-15T23:55:42.209955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.234708+0000","last_change":"2024-09-15T23:55:42.232517+0000","last_active":"2024-09-15T23:55:42.234708+0000","last_peered":"2024-09-15T23:55:42.234708+0000","last_clean":"2024-09-15T23:55:42.234708+0000","last_became_active":"2024-09-15T23:55:42.232227+0000","last_became_peered":"2024-09-15T23:55:42.232227+0000","last_unstale":"2024-09-15T23:55:42.234708+0000","last_undegraded":"2024-09-15T23:55:42.234708+0000","last_fullsized":"2024-09-15T23:55:42.234708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.199261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.209575+0000","last_change":"2024-09-15T23:55:42.209575+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.209575+0000","last_undegraded":"2024-09-15T23:55:42.209575+0000","last_fullsized":"2024-09-15T23:55:42.209575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222296+0000","last_change":"2024-09-15T23:55:42.220495+0000","last_active":"2024-09-15T23:55:42.222296+0000","last_peered":"2024-09-15T23:55:42.222296+0000","last_clean":"2024-09-15T23:55:42.222296+0000","last_became_active":"2024-09-15T23:55:42.219865+0000","last_became_peered":"2024-09-15T23:55:42.219865+0000","last_unstale":"2024-09-15T23:55:42.222296+0000","last_undegraded":"2024-09-15T23:55:42.222296+0000","last_fullsized":"2024-09-15T23:55:42.222296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:38.730404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212980+0000","last_change":"2024-09-15T23:55:42.212980+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212980+0000","last_undegraded":"2024-09-15T23:55:42.212980+0000","last_fullsized":"2024-09-15T23:55:42.212980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.231367+0000","last_change":"2024-09-15T23:55:42.227968+0000","last_active":"2024-09-15T23:55:42.231367+0000","last_peered":"2024-09-15T23:55:42.231367+0000","last_clean":"2024-09-15T23:55:42.231367+0000","last_became_active":"2024-09-15T23:55:42.227688+0000","last_became_peered":"2024-09-15T23:55:42.227688+0000","last_unstale":"2024-09-15T23:55:42.231367+0000","last_undegraded":"2024-09-15T23:55:42.231367+0000","last_fullsized":"2024-09-15T23:55:42.231367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:14.508276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"creating+peering","last_fresh":"2024-09-15T23:55:42.212115+0000","last_change":"2024-09-15T23:55:42.212115+0000","last_active":"2024-09-15T23:55:42.201069+0000","last_peered":"2024-09-15T23:55:42.201069+0000","last_clean":"2024-09-15T23:55:42.201069+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:55:42.212115+0000","last_undegraded":"2024-09-15T23:55:42.212115+0000","last_fullsized":"2024-09-15T23:55:42.212115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.230957+0000","last_change":"2024-09-15T23:55:42.224100+0000","last_active":"2024-09-15T23:55:42.230957+0000","last_peered":"2024-09-15T23:55:42.230957+0000","last_clean":"2024-09-15T23:55:42.230957+0000","last_became_active":"2024-09-15T23:55:42.223829+0000","last_became_peered":"2024-09-15T23:55:42.223829+0000","last_unstale":"2024-09-15T23:55:42.230957+0000","last_undegraded":"2024-09-15T23:55:42.230957+0000","last_fullsized":"2024-09-15T23:55:42.230957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:33.446581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T23:55:42.222947+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:42.222947+0000","last_peered":"2024-09-15T23:55:42.222947+0000","last_clean":"2024-09-15T23:55:42.222947+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:42.222947+0000","last_undegraded":"2024-09-15T23:55:42.222947+0000","last_fullsized":"2024-09-15T23:55:42.222947+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":221184,"data_stored":71862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705675,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":658265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:50.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:55:50.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.613+0000 7fb5184d9640 1 Processor -- start 2024-09-15T23:55:50.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.613+0000 7fb5184d9640 1 -- start start 2024-09-15T23:55:50.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb5184d9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb510135b50 0x7fb51009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb5184d9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51009b020 con 0x7fb510135f30 2024-09-15T23:55:50.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb5184d9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb51009b310 con 0x7fb510135b50 2024-09-15T23:55:50.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb516275640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb510135b50 0x7fb51009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb516275640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb510135b50 0x7fb51009aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36560/0 (socket says 172.21.15.121:36560) 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb515a74640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb510135f30 0x7fb5100a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35578/0 (socket says 172.21.15.121:35578) 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.614+0000 7fb516275640 1 -- 172.21.15.121:0/71245927 learned_addr learned my addr 172.21.15.121:0/71245927 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb516275640 1 -- 172.21.15.121:0/71245927 >> v1:172.21.15.121:6789/0 conn(0x7fb510135f30 legacy=0x7fb5100a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb516275640 1 -- 172.21.15.121:0/71245927 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5100a08c0 con 0x7fb510135b50 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb515273640 1 -- 172.21.15.121:0/71245927 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4135895287 0 0) 0x7fb51009b020 con 0x7fb510135f30 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb516275640 1 --2- 172.21.15.121:0/71245927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009aae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097f0 tx=0x7fb50002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852403396a116d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb515273640 1 -- 172.21.15.121:0/71245927 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500037070 con 0x7fb510135b50 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.615+0000 7fb515273640 1 -- 172.21.15.121:0/71245927 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb500032440 con 0x7fb510135b50 2024-09-15T23:55:50.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb515273640 1 -- 172.21.15.121:0/71245927 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500032740 con 0x7fb510135b50 2024-09-15T23:55:50.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 -- 172.21.15.121:0/71245927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 msgr2=0x7fb51009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 --2- 172.21.15.121:0/71245927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009aae0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097f0 tx=0x7fb50002a270 comp rx=0 tx=0).stop 2024-09-15T23:55:50.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 -- 172.21.15.121:0/71245927 shutdown_connections 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 --2- 172.21.15.121:0/71245927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009aae0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 -- 172.21.15.121:0/71245927 >> 172.21.15.121:0/71245927 conn(0x7fb5100a85e0 msgr2=0x7fb5100a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 -- 172.21.15.121:0/71245927 shutdown_connections 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.616+0000 7fb5184d9640 1 -- 172.21.15.121:0/71245927 wait complete. 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.617+0000 7fb5184d9640 1 Processor -- start 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.617+0000 7fb5184d9640 1 -- start start 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb5184d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb5184d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100a5430 con 0x7fb510135b50 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb516275640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb516275640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36576/0 (socket says 172.21.15.121:36576) 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb516275640 1 -- 172.21.15.121:0/198184587 learned_addr learned my addr 172.21.15.121:0/198184587 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb516275640 1 -- 172.21.15.121:0/198184587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb510125f40 con 0x7fb510135b50 2024-09-15T23:55:50.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb516275640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb500035040 tx=0x7fb5000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500041070 con 0x7fb510135b50 2024-09-15T23:55:50.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50003c7a0 con 0x7fb510135b50 2024-09-15T23:55:50.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101255e0 con 0x7fb510135b50 2024-09-15T23:55:50.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb500037040 con 0x7fb510135b50 2024-09-15T23:55:50.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.618+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb510124980 con 0x7fb510135b50 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.619+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb500044070 con 0x7fb510135b50 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.619+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb510125d30 con 0x7fb510135b50 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.619+0000 7fb506ffd640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 0x7fb4f403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.619+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fb50006bc30 con 0x7fb510135b50 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.620+0000 7fb515a74640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 0x7fb4f403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.620+0000 7fb515a74640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 0x7fb4f403a760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb50c000c00 tx=0x7fb50c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.624+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb500072080 con 0x7fb510135b50 2024-09-15T23:55:50.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.785+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 --> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5100a6620 con 0x7fb4f40382a0 2024-09-15T23:55:50.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.791+0000 7fb506ffd640 1 -- 172.21.15.121:0/198184587 <== mgr.4102 v2:172.21.15.121:6824/1047503300 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245967 (secure 0 0 0) 0x7fb50c0070d0 con 0x7fb4f40382a0 2024-09-15T23:55:50.795 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:50.796 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 msgr2=0x7fb4f403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 0x7fb4f403a760 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb50c000c00 tx=0x7fb50c007910 comp rx=0 tx=0).stop 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 msgr2=0x7fb51009b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb500035040 tx=0x7fb5000046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 shutdown_connections 2024-09-15T23:55:50.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb4f40382a0 0x7fb4f403a760 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 --2- 172.21.15.121:0/198184587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510135b50 0x7fb51009b570 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 >> 172.21.15.121:0/198184587 conn(0x7fb5100a85e0 msgr2=0x7fb5100a3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:50.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 shutdown_connections 2024-09-15T23:55:50.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.794+0000 7fb5184d9640 1 -- 172.21.15.121:0/198184587 wait complete. 2024-09-15T23:55:50.806 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-15T23:55:50.029450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87172,"kb_used_data":1920,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028348,"statfs":{"total":289910292480,"available":289821028352,"internally_reserved":0,"allocated":1966080,"data_stored":1426627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.825038"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040960+0000","last_change":"2024-09-15T23:55:43.227898+0000","last_active":"2024-09-15T23:55:45.040960+0000","last_peered":"2024-09-15T23:55:45.040960+0000","last_clean":"2024-09-15T23:55:45.040960+0000","last_became_active":"2024-09-15T23:55:43.227492+0000","last_became_peered":"2024-09-15T23:55:43.227492+0000","last_unstale":"2024-09-15T23:55:45.040960+0000","last_undegraded":"2024-09-15T23:55:45.040960+0000","last_fullsized":"2024-09-15T23:55:45.040960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:43.589227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211611+0000","last_change":"2024-09-15T23:55:43.232950+0000","last_active":"2024-09-15T23:55:45.211611+0000","last_peered":"2024-09-15T23:55:45.211611+0000","last_clean":"2024-09-15T23:55:45.211611+0000","last_became_active":"2024-09-15T23:55:43.232593+0000","last_became_peered":"2024-09-15T23:55:43.232593+0000","last_unstale":"2024-09-15T23:55:45.211611+0000","last_undegraded":"2024-09-15T23:55:45.211611+0000","last_fullsized":"2024-09-15T23:55:45.211611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224576+0000","last_change":"2024-09-15T23:55:43.235136+0000","last_active":"2024-09-15T23:55:44.224576+0000","last_peered":"2024-09-15T23:55:44.224576+0000","last_clean":"2024-09-15T23:55:44.224576+0000","last_became_active":"2024-09-15T23:55:43.234874+0000","last_became_peered":"2024-09-15T23:55:43.234874+0000","last_unstale":"2024-09-15T23:55:44.224576+0000","last_undegraded":"2024-09-15T23:55:44.224576+0000","last_fullsized":"2024-09-15T23:55:44.224576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:05.236401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224136+0000","last_change":"2024-09-15T23:55:43.231759+0000","last_active":"2024-09-15T23:55:44.224136+0000","last_peered":"2024-09-15T23:55:44.224136+0000","last_clean":"2024-09-15T23:55:44.224136+0000","last_became_active":"2024-09-15T23:55:43.230026+0000","last_became_peered":"2024-09-15T23:55:43.230026+0000","last_unstale":"2024-09-15T23:55:44.224136+0000","last_undegraded":"2024-09-15T23:55:44.224136+0000","last_fullsized":"2024-09-15T23:55:44.224136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:13.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041258+0000","last_change":"2024-09-15T23:55:43.244951+0000","last_active":"2024-09-15T23:55:45.041258+0000","last_peered":"2024-09-15T23:55:45.041258+0000","last_clean":"2024-09-15T23:55:45.041258+0000","last_became_active":"2024-09-15T23:55:43.244677+0000","last_became_peered":"2024-09-15T23:55:43.244677+0000","last_unstale":"2024-09-15T23:55:45.041258+0000","last_undegraded":"2024-09-15T23:55:45.041258+0000","last_fullsized":"2024-09-15T23:55:45.041258+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:21.062618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223649+0000","last_change":"2024-09-15T23:55:43.239274+0000","last_active":"2024-09-15T23:55:44.223649+0000","last_peered":"2024-09-15T23:55:44.223649+0000","last_clean":"2024-09-15T23:55:44.223649+0000","last_became_active":"2024-09-15T23:55:43.239035+0000","last_became_peered":"2024-09-15T23:55:43.239035+0000","last_unstale":"2024-09-15T23:55:44.223649+0000","last_undegraded":"2024-09-15T23:55:44.223649+0000","last_fullsized":"2024-09-15T23:55:44.223649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:34.132641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040409+0000","last_change":"2024-09-15T23:55:43.235446+0000","last_active":"2024-09-15T23:55:45.040409+0000","last_peered":"2024-09-15T23:55:45.040409+0000","last_clean":"2024-09-15T23:55:45.040409+0000","last_became_active":"2024-09-15T23:55:43.233175+0000","last_became_peered":"2024-09-15T23:55:43.233175+0000","last_unstale":"2024-09-15T23:55:45.040409+0000","last_undegraded":"2024-09-15T23:55:45.040409+0000","last_fullsized":"2024-09-15T23:55:45.040409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:40.312581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040197+0000","last_change":"2024-09-15T23:55:43.241527+0000","last_active":"2024-09-15T23:55:45.040197+0000","last_peered":"2024-09-15T23:55:45.040197+0000","last_clean":"2024-09-15T23:55:45.040197+0000","last_became_active":"2024-09-15T23:55:43.240679+0000","last_became_peered":"2024-09-15T23:55:43.240679+0000","last_unstale":"2024-09-15T23:55:45.040197+0000","last_undegraded":"2024-09-15T23:55:45.040197+0000","last_fullsized":"2024-09-15T23:55:45.040197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:51.362953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.225232+0000","last_change":"2024-09-15T23:55:43.245720+0000","last_active":"2024-09-15T23:55:44.225232+0000","last_peered":"2024-09-15T23:55:44.225232+0000","last_clean":"2024-09-15T23:55:44.225232+0000","last_became_active":"2024-09-15T23:55:43.245024+0000","last_became_peered":"2024-09-15T23:55:43.245024+0000","last_unstale":"2024-09-15T23:55:44.225232+0000","last_undegraded":"2024-09-15T23:55:44.225232+0000","last_fullsized":"2024-09-15T23:55:44.225232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:52.168283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224206+0000","last_change":"2024-09-15T23:55:43.245383+0000","last_active":"2024-09-15T23:55:44.224206+0000","last_peered":"2024-09-15T23:55:44.224206+0000","last_clean":"2024-09-15T23:55:44.224206+0000","last_became_active":"2024-09-15T23:55:43.245083+0000","last_became_peered":"2024-09-15T23:55:43.245083+0000","last_unstale":"2024-09-15T23:55:44.224206+0000","last_undegraded":"2024-09-15T23:55:44.224206+0000","last_fullsized":"2024-09-15T23:55:44.224206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:44.360250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211374+0000","last_change":"2024-09-15T23:55:43.237533+0000","last_active":"2024-09-15T23:55:45.211374+0000","last_peered":"2024-09-15T23:55:45.211374+0000","last_clean":"2024-09-15T23:55:45.211374+0000","last_became_active":"2024-09-15T23:55:43.237283+0000","last_became_peered":"2024-09-15T23:55:43.237283+0000","last_unstale":"2024-09-15T23:55:45.211374+0000","last_undegraded":"2024-09-15T23:55:45.211374+0000","last_fullsized":"2024-09-15T23:55:45.211374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:28.779045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224263+0000","last_change":"2024-09-15T23:55:43.232864+0000","last_active":"2024-09-15T23:55:44.224263+0000","last_peered":"2024-09-15T23:55:44.224263+0000","last_clean":"2024-09-15T23:55:44.224263+0000","last_became_active":"2024-09-15T23:55:43.232519+0000","last_became_peered":"2024-09-15T23:55:43.232519+0000","last_unstale":"2024-09-15T23:55:44.224263+0000","last_undegraded":"2024-09-15T23:55:44.224263+0000","last_fullsized":"2024-09-15T23:55:44.224263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:44:54.578993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040395+0000","last_change":"2024-09-15T23:55:43.239873+0000","last_active":"2024-09-15T23:55:45.040395+0000","last_peered":"2024-09-15T23:55:45.040395+0000","last_clean":"2024-09-15T23:55:45.040395+0000","last_became_active":"2024-09-15T23:55:43.239470+0000","last_became_peered":"2024-09-15T23:55:43.239470+0000","last_unstale":"2024-09-15T23:55:45.040395+0000","last_undegraded":"2024-09-15T23:55:45.040395+0000","last_fullsized":"2024-09-15T23:55:45.040395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:37.900325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.210952+0000","last_change":"2024-09-15T23:55:43.236088+0000","last_active":"2024-09-15T23:55:45.210952+0000","last_peered":"2024-09-15T23:55:45.210952+0000","last_clean":"2024-09-15T23:55:45.210952+0000","last_became_active":"2024-09-15T23:55:43.235847+0000","last_became_peered":"2024-09-15T23:55:43.235847+0000","last_unstale":"2024-09-15T23:55:45.210952+0000","last_undegraded":"2024-09-15T23:55:45.210952+0000","last_fullsized":"2024-09-15T23:55:45.210952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:16.223611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211169+0000","last_change":"2024-09-15T23:55:43.225542+0000","last_active":"2024-09-15T23:55:45.211169+0000","last_peered":"2024-09-15T23:55:45.211169+0000","last_clean":"2024-09-15T23:55:45.211169+0000","last_became_active":"2024-09-15T23:55:43.225263+0000","last_became_peered":"2024-09-15T23:55:43.225263+0000","last_unstale":"2024-09-15T23:55:45.211169+0000","last_undegraded":"2024-09-15T23:55:45.211169+0000","last_fullsized":"2024-09-15T23:55:45.211169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:48.620700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.210856+0000","last_change":"2024-09-15T23:55:43.220905+0000","last_active":"2024-09-15T23:55:45.210856+0000","last_peered":"2024-09-15T23:55:45.210856+0000","last_clean":"2024-09-15T23:55:45.210856+0000","last_became_active":"2024-09-15T23:55:43.220619+0000","last_became_peered":"2024-09-15T23:55:43.220619+0000","last_unstale":"2024-09-15T23:55:45.210856+0000","last_undegraded":"2024-09-15T23:55:45.210856+0000","last_fullsized":"2024-09-15T23:55:45.210856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:39.146144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211904+0000","last_change":"2024-09-15T23:55:43.220383+0000","last_active":"2024-09-15T23:55:45.211904+0000","last_peered":"2024-09-15T23:55:45.211904+0000","last_clean":"2024-09-15T23:55:45.211904+0000","last_became_active":"2024-09-15T23:55:43.220122+0000","last_became_peered":"2024-09-15T23:55:43.220122+0000","last_unstale":"2024-09-15T23:55:45.211904+0000","last_undegraded":"2024-09-15T23:55:45.211904+0000","last_fullsized":"2024-09-15T23:55:45.211904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.344948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211664+0000","last_change":"2024-09-15T23:55:43.232746+0000","last_active":"2024-09-15T23:55:45.211664+0000","last_peered":"2024-09-15T23:55:45.211664+0000","last_clean":"2024-09-15T23:55:45.211664+0000","last_became_active":"2024-09-15T23:55:43.232387+0000","last_became_peered":"2024-09-15T23:55:43.232387+0000","last_unstale":"2024-09-15T23:55:45.211664+0000","last_undegraded":"2024-09-15T23:55:45.211664+0000","last_fullsized":"2024-09-15T23:55:45.211664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:56.397958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211418+0000","last_change":"2024-09-15T23:55:43.237257+0000","last_active":"2024-09-15T23:55:45.211418+0000","last_peered":"2024-09-15T23:55:45.211418+0000","last_clean":"2024-09-15T23:55:45.211418+0000","last_became_active":"2024-09-15T23:55:43.236958+0000","last_became_peered":"2024-09-15T23:55:43.236958+0000","last_unstale":"2024-09-15T23:55:45.211418+0000","last_undegraded":"2024-09-15T23:55:45.211418+0000","last_fullsized":"2024-09-15T23:55:45.211418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:31.928787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041105+0000","last_change":"2024-09-15T23:55:43.229004+0000","last_active":"2024-09-15T23:55:45.041105+0000","last_peered":"2024-09-15T23:55:45.041105+0000","last_clean":"2024-09-15T23:55:45.041105+0000","last_became_active":"2024-09-15T23:55:43.228763+0000","last_became_peered":"2024-09-15T23:55:43.228763+0000","last_unstale":"2024-09-15T23:55:45.041105+0000","last_undegraded":"2024-09-15T23:55:45.041105+0000","last_fullsized":"2024-09-15T23:55:45.041105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:52.644223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211620+0000","last_change":"2024-09-15T23:55:43.235817+0000","last_active":"2024-09-15T23:55:45.211620+0000","last_peered":"2024-09-15T23:55:45.211620+0000","last_clean":"2024-09-15T23:55:45.211620+0000","last_became_active":"2024-09-15T23:55:43.235126+0000","last_became_peered":"2024-09-15T23:55:43.235126+0000","last_unstale":"2024-09-15T23:55:45.211620+0000","last_undegraded":"2024-09-15T23:55:45.211620+0000","last_fullsized":"2024-09-15T23:55:45.211620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:39.086499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040520+0000","last_change":"2024-09-15T23:55:43.242652+0000","last_active":"2024-09-15T23:55:45.040520+0000","last_peered":"2024-09-15T23:55:45.040520+0000","last_clean":"2024-09-15T23:55:45.040520+0000","last_became_active":"2024-09-15T23:55:43.242402+0000","last_became_peered":"2024-09-15T23:55:43.242402+0000","last_unstale":"2024-09-15T23:55:45.040520+0000","last_undegraded":"2024-09-15T23:55:45.040520+0000","last_fullsized":"2024-09-15T23:55:45.040520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:37.953828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211243+0000","last_change":"2024-09-15T23:55:43.232440+0000","last_active":"2024-09-15T23:55:45.211243+0000","last_peered":"2024-09-15T23:55:45.211243+0000","last_clean":"2024-09-15T23:55:45.211243+0000","last_became_active":"2024-09-15T23:55:43.232038+0000","last_became_peered":"2024-09-15T23:55:43.232038+0000","last_unstale":"2024-09-15T23:55:45.211243+0000","last_undegraded":"2024-09-15T23:55:45.211243+0000","last_fullsized":"2024-09-15T23:55:45.211243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:52.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040222+0000","last_change":"2024-09-15T23:55:43.240921+0000","last_active":"2024-09-15T23:55:45.040222+0000","last_peered":"2024-09-15T23:55:45.040222+0000","last_clean":"2024-09-15T23:55:45.040222+0000","last_became_active":"2024-09-15T23:55:43.239694+0000","last_became_peered":"2024-09-15T23:55:43.239694+0000","last_unstale":"2024-09-15T23:55:45.040222+0000","last_undegraded":"2024-09-15T23:55:45.040222+0000","last_fullsized":"2024-09-15T23:55:45.040222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:07.284574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.225106+0000","last_change":"2024-09-15T23:55:43.246446+0000","last_active":"2024-09-15T23:55:44.225106+0000","last_peered":"2024-09-15T23:55:44.225106+0000","last_clean":"2024-09-15T23:55:44.225106+0000","last_became_active":"2024-09-15T23:55:43.246150+0000","last_became_peered":"2024-09-15T23:55:43.246150+0000","last_unstale":"2024-09-15T23:55:44.225106+0000","last_undegraded":"2024-09-15T23:55:44.225106+0000","last_fullsized":"2024-09-15T23:55:44.225106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:11.769906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224339+0000","last_change":"2024-09-15T23:55:43.231220+0000","last_active":"2024-09-15T23:55:44.224339+0000","last_peered":"2024-09-15T23:55:44.224339+0000","last_clean":"2024-09-15T23:55:44.224339+0000","last_became_active":"2024-09-15T23:55:43.230707+0000","last_became_peered":"2024-09-15T23:55:43.230707+0000","last_unstale":"2024-09-15T23:55:44.224339+0000","last_undegraded":"2024-09-15T23:55:44.224339+0000","last_fullsized":"2024-09-15T23:55:44.224339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:49.358761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224270+0000","last_change":"2024-09-15T23:55:43.247380+0000","last_active":"2024-09-15T23:55:44.224270+0000","last_peered":"2024-09-15T23:55:44.224270+0000","last_clean":"2024-09-15T23:55:44.224270+0000","last_became_active":"2024-09-15T23:55:43.247101+0000","last_became_peered":"2024-09-15T23:55:43.247101+0000","last_unstale":"2024-09-15T23:55:44.224270+0000","last_undegraded":"2024-09-15T23:55:44.224270+0000","last_fullsized":"2024-09-15T23:55:44.224270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:53.161641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041118+0000","last_change":"2024-09-15T23:55:43.229916+0000","last_active":"2024-09-15T23:55:45.041118+0000","last_peered":"2024-09-15T23:55:45.041118+0000","last_clean":"2024-09-15T23:55:45.041118+0000","last_became_active":"2024-09-15T23:55:43.229625+0000","last_became_peered":"2024-09-15T23:55:43.229625+0000","last_unstale":"2024-09-15T23:55:45.041118+0000","last_undegraded":"2024-09-15T23:55:45.041118+0000","last_fullsized":"2024-09-15T23:55:45.041118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:47.794881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211227+0000","last_change":"2024-09-15T23:55:43.236183+0000","last_active":"2024-09-15T23:55:45.211227+0000","last_peered":"2024-09-15T23:55:45.211227+0000","last_clean":"2024-09-15T23:55:45.211227+0000","last_became_active":"2024-09-15T23:55:43.235962+0000","last_became_peered":"2024-09-15T23:55:43.235962+0000","last_unstale":"2024-09-15T23:55:45.211227+0000","last_undegraded":"2024-09-15T23:55:45.211227+0000","last_fullsized":"2024-09-15T23:55:45.211227+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:49.038336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211018+0000","last_change":"2024-09-15T23:55:43.235512+0000","last_active":"2024-09-15T23:55:45.211018+0000","last_peered":"2024-09-15T23:55:45.211018+0000","last_clean":"2024-09-15T23:55:45.211018+0000","last_became_active":"2024-09-15T23:55:43.235258+0000","last_became_peered":"2024-09-15T23:55:43.235258+0000","last_unstale":"2024-09-15T23:55:45.211018+0000","last_undegraded":"2024-09-15T23:55:45.211018+0000","last_fullsized":"2024-09-15T23:55:45.211018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:43.374407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040280+0000","last_change":"2024-09-15T23:55:43.228937+0000","last_active":"2024-09-15T23:55:45.040280+0000","last_peered":"2024-09-15T23:55:45.040280+0000","last_clean":"2024-09-15T23:55:45.040280+0000","last_became_active":"2024-09-15T23:55:43.228679+0000","last_became_peered":"2024-09-15T23:55:43.228679+0000","last_unstale":"2024-09-15T23:55:45.040280+0000","last_undegraded":"2024-09-15T23:55:45.040280+0000","last_fullsized":"2024-09-15T23:55:45.040280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:50.437228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040374+0000","last_change":"2024-09-15T23:55:43.240988+0000","last_active":"2024-09-15T23:55:45.040374+0000","last_peered":"2024-09-15T23:55:45.040374+0000","last_clean":"2024-09-15T23:55:45.040374+0000","last_became_active":"2024-09-15T23:55:43.240018+0000","last_became_peered":"2024-09-15T23:55:43.240018+0000","last_unstale":"2024-09-15T23:55:45.040374+0000","last_undegraded":"2024-09-15T23:55:45.040374+0000","last_fullsized":"2024-09-15T23:55:45.040374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:24.217467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211766+0000","last_change":"2024-09-15T23:55:43.236332+0000","last_active":"2024-09-15T23:55:45.211766+0000","last_peered":"2024-09-15T23:55:45.211766+0000","last_clean":"2024-09-15T23:55:45.211766+0000","last_became_active":"2024-09-15T23:55:43.236125+0000","last_became_peered":"2024-09-15T23:55:43.236125+0000","last_unstale":"2024-09-15T23:55:45.211766+0000","last_undegraded":"2024-09-15T23:55:45.211766+0000","last_fullsized":"2024-09-15T23:55:45.211766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:47.233924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'4","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211859+0000","last_change":"2024-09-15T23:55:42.233492+0000","last_active":"2024-09-15T23:55:45.211859+0000","last_peered":"2024-09-15T23:55:45.211859+0000","last_clean":"2024-09-15T23:55:45.211859+0000","last_became_active":"2024-09-15T23:55:42.233237+0000","last_became_peered":"2024-09-15T23:55:42.233237+0000","last_unstale":"2024-09-15T23:55:45.211859+0000","last_undegraded":"2024-09-15T23:55:45.211859+0000","last_fullsized":"2024-09-15T23:55:45.211859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:56.626370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041038+0000","last_change":"2024-09-15T23:55:43.239231+0000","last_active":"2024-09-15T23:55:45.041038+0000","last_peered":"2024-09-15T23:55:45.041038+0000","last_clean":"2024-09-15T23:55:45.041038+0000","last_became_active":"2024-09-15T23:55:43.238977+0000","last_became_peered":"2024-09-15T23:55:43.238977+0000","last_unstale":"2024-09-15T23:55:45.041038+0000","last_undegraded":"2024-09-15T23:55:45.041038+0000","last_fullsized":"2024-09-15T23:55:45.041038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:40.627684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211798+0000","last_change":"2024-09-15T23:55:42.227655+0000","last_active":"2024-09-15T23:55:45.211798+0000","last_peered":"2024-09-15T23:55:45.211798+0000","last_clean":"2024-09-15T23:55:45.211798+0000","last_became_active":"2024-09-15T23:55:42.227114+0000","last_became_peered":"2024-09-15T23:55:42.227114+0000","last_unstale":"2024-09-15T23:55:45.211798+0000","last_undegraded":"2024-09-15T23:55:45.211798+0000","last_fullsized":"2024-09-15T23:55:45.211798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:13.594338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041291+0000","last_change":"2024-09-15T23:55:43.231226+0000","last_active":"2024-09-15T23:55:45.041291+0000","last_peered":"2024-09-15T23:55:45.041291+0000","last_clean":"2024-09-15T23:55:45.041291+0000","last_became_active":"2024-09-15T23:55:43.230973+0000","last_became_peered":"2024-09-15T23:55:43.230973+0000","last_unstale":"2024-09-15T23:55:45.041291+0000","last_undegraded":"2024-09-15T23:55:45.041291+0000","last_fullsized":"2024-09-15T23:55:45.041291+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:53.137203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211764+0000","last_change":"2024-09-15T23:55:42.227590+0000","last_active":"2024-09-15T23:55:45.211764+0000","last_peered":"2024-09-15T23:55:45.211764+0000","last_clean":"2024-09-15T23:55:45.211764+0000","last_became_active":"2024-09-15T23:55:42.227300+0000","last_became_peered":"2024-09-15T23:55:42.227300+0000","last_unstale":"2024-09-15T23:55:45.211764+0000","last_undegraded":"2024-09-15T23:55:45.211764+0000","last_fullsized":"2024-09-15T23:55:45.211764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:43.356449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224390+0000","last_change":"2024-09-15T23:55:43.247525+0000","last_active":"2024-09-15T23:55:44.224390+0000","last_peered":"2024-09-15T23:55:44.224390+0000","last_clean":"2024-09-15T23:55:44.224390+0000","last_became_active":"2024-09-15T23:55:43.246994+0000","last_became_peered":"2024-09-15T23:55:43.246994+0000","last_unstale":"2024-09-15T23:55:44.224390+0000","last_undegraded":"2024-09-15T23:55:44.224390+0000","last_fullsized":"2024-09-15T23:55:44.224390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:06.999754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041251+0000","last_change":"2024-09-15T23:55:42.229229+0000","last_active":"2024-09-15T23:55:45.041251+0000","last_peered":"2024-09-15T23:55:45.041251+0000","last_clean":"2024-09-15T23:55:45.041251+0000","last_became_active":"2024-09-15T23:55:42.228892+0000","last_became_peered":"2024-09-15T23:55:42.228892+0000","last_unstale":"2024-09-15T23:55:45.041251+0000","last_undegraded":"2024-09-15T23:55:45.041251+0000","last_fullsized":"2024-09-15T23:55:45.041251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:03.730966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223892+0000","last_change":"2024-09-15T23:55:43.246848+0000","last_active":"2024-09-15T23:55:44.223892+0000","last_peered":"2024-09-15T23:55:44.223892+0000","last_clean":"2024-09-15T23:55:44.223892+0000","last_became_active":"2024-09-15T23:55:43.246602+0000","last_became_peered":"2024-09-15T23:55:43.246602+0000","last_unstale":"2024-09-15T23:55:44.223892+0000","last_undegraded":"2024-09-15T23:55:44.223892+0000","last_fullsized":"2024-09-15T23:55:44.223892+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:23.350015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041021+0000","last_change":"2024-09-15T23:55:42.228095+0000","last_active":"2024-09-15T23:55:45.041021+0000","last_peered":"2024-09-15T23:55:45.041021+0000","last_clean":"2024-09-15T23:55:45.041021+0000","last_became_active":"2024-09-15T23:55:42.227826+0000","last_became_peered":"2024-09-15T23:55:42.227826+0000","last_unstale":"2024-09-15T23:55:45.041021+0000","last_undegraded":"2024-09-15T23:55:45.041021+0000","last_fullsized":"2024-09-15T23:55:45.041021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:47:51.087587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040630+0000","last_change":"2024-09-15T23:55:43.234941+0000","last_active":"2024-09-15T23:55:45.040630+0000","last_peered":"2024-09-15T23:55:45.040630+0000","last_clean":"2024-09-15T23:55:45.040630+0000","last_became_active":"2024-09-15T23:55:43.234353+0000","last_became_peered":"2024-09-15T23:55:43.234353+0000","last_unstale":"2024-09-15T23:55:45.040630+0000","last_undegraded":"2024-09-15T23:55:45.040630+0000","last_fullsized":"2024-09-15T23:55:45.040630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:51.243440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040655+0000","last_change":"2024-09-15T23:55:42.223388+0000","last_active":"2024-09-15T23:55:45.040655+0000","last_peered":"2024-09-15T23:55:45.040655+0000","last_clean":"2024-09-15T23:55:45.040655+0000","last_became_active":"2024-09-15T23:55:42.223117+0000","last_became_peered":"2024-09-15T23:55:42.223117+0000","last_unstale":"2024-09-15T23:55:45.040655+0000","last_undegraded":"2024-09-15T23:55:45.040655+0000","last_fullsized":"2024-09-15T23:55:45.040655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.813020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223637+0000","last_change":"2024-09-15T23:55:43.247768+0000","last_active":"2024-09-15T23:55:44.223637+0000","last_peered":"2024-09-15T23:55:44.223637+0000","last_clean":"2024-09-15T23:55:44.223637+0000","last_became_active":"2024-09-15T23:55:43.247474+0000","last_became_peered":"2024-09-15T23:55:43.247474+0000","last_unstale":"2024-09-15T23:55:44.223637+0000","last_undegraded":"2024-09-15T23:55:44.223637+0000","last_fullsized":"2024-09-15T23:55:44.223637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:14.598138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211329+0000","last_change":"2024-09-15T23:55:42.218000+0000","last_active":"2024-09-15T23:55:45.211329+0000","last_peered":"2024-09-15T23:55:45.211329+0000","last_clean":"2024-09-15T23:55:45.211329+0000","last_became_active":"2024-09-15T23:55:42.217248+0000","last_became_peered":"2024-09-15T23:55:42.217248+0000","last_unstale":"2024-09-15T23:55:45.211329+0000","last_undegraded":"2024-09-15T23:55:45.211329+0000","last_fullsized":"2024-09-15T23:55:45.211329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:57.551142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223595+0000","last_change":"2024-09-15T23:55:43.234332+0000","last_active":"2024-09-15T23:55:44.223595+0000","last_peered":"2024-09-15T23:55:44.223595+0000","last_clean":"2024-09-15T23:55:44.223595+0000","last_became_active":"2024-09-15T23:55:43.230414+0000","last_became_peered":"2024-09-15T23:55:43.230414+0000","last_unstale":"2024-09-15T23:55:44.223595+0000","last_undegraded":"2024-09-15T23:55:44.223595+0000","last_fullsized":"2024-09-15T23:55:44.223595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:57.630171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040890+0000","last_change":"2024-09-15T23:55:42.230514+0000","last_active":"2024-09-15T23:55:45.040890+0000","last_peered":"2024-09-15T23:55:45.040890+0000","last_clean":"2024-09-15T23:55:45.040890+0000","last_became_active":"2024-09-15T23:55:42.228955+0000","last_became_peered":"2024-09-15T23:55:42.228955+0000","last_unstale":"2024-09-15T23:55:45.040890+0000","last_undegraded":"2024-09-15T23:55:45.040890+0000","last_fullsized":"2024-09-15T23:55:45.040890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:49.076659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224466+0000","last_change":"2024-09-15T23:55:43.231010+0000","last_active":"2024-09-15T23:55:44.224466+0000","last_peered":"2024-09-15T23:55:44.224466+0000","last_clean":"2024-09-15T23:55:44.224466+0000","last_became_active":"2024-09-15T23:55:43.230358+0000","last_became_peered":"2024-09-15T23:55:43.230358+0000","last_unstale":"2024-09-15T23:55:44.224466+0000","last_undegraded":"2024-09-15T23:55:44.224466+0000","last_fullsized":"2024-09-15T23:55:44.224466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:27.364621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.212006+0000","last_change":"2024-09-15T23:55:42.233343+0000","last_active":"2024-09-15T23:55:45.212006+0000","last_peered":"2024-09-15T23:55:45.212006+0000","last_clean":"2024-09-15T23:55:45.212006+0000","last_became_active":"2024-09-15T23:55:42.233082+0000","last_became_peered":"2024-09-15T23:55:42.233082+0000","last_unstale":"2024-09-15T23:55:45.212006+0000","last_undegraded":"2024-09-15T23:55:45.212006+0000","last_fullsized":"2024-09-15T23:55:45.212006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:33.128840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041110+0000","last_change":"2024-09-15T23:55:43.239063+0000","last_active":"2024-09-15T23:55:45.041110+0000","last_peered":"2024-09-15T23:55:45.041110+0000","last_clean":"2024-09-15T23:55:45.041110+0000","last_became_active":"2024-09-15T23:55:43.238787+0000","last_became_peered":"2024-09-15T23:55:43.238787+0000","last_unstale":"2024-09-15T23:55:45.041110+0000","last_undegraded":"2024-09-15T23:55:45.041110+0000","last_fullsized":"2024-09-15T23:55:45.041110+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:51.746387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211891+0000","last_change":"2024-09-15T23:55:42.217126+0000","last_active":"2024-09-15T23:55:45.211891+0000","last_peered":"2024-09-15T23:55:45.211891+0000","last_clean":"2024-09-15T23:55:45.211891+0000","last_became_active":"2024-09-15T23:55:42.216854+0000","last_became_peered":"2024-09-15T23:55:42.216854+0000","last_unstale":"2024-09-15T23:55:45.211891+0000","last_undegraded":"2024-09-15T23:55:45.211891+0000","last_fullsized":"2024-09-15T23:55:45.211891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:59.157869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211320+0000","last_change":"2024-09-15T23:55:43.225634+0000","last_active":"2024-09-15T23:55:45.211320+0000","last_peered":"2024-09-15T23:55:45.211320+0000","last_clean":"2024-09-15T23:55:45.211320+0000","last_became_active":"2024-09-15T23:55:43.225360+0000","last_became_peered":"2024-09-15T23:55:43.225360+0000","last_unstale":"2024-09-15T23:55:45.211320+0000","last_undegraded":"2024-09-15T23:55:45.211320+0000","last_fullsized":"2024-09-15T23:55:45.211320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:29.769626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'3","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211853+0000","last_change":"2024-09-15T23:55:42.227422+0000","last_active":"2024-09-15T23:55:45.211853+0000","last_peered":"2024-09-15T23:55:45.211853+0000","last_clean":"2024-09-15T23:55:45.211853+0000","last_became_active":"2024-09-15T23:55:42.227135+0000","last_became_peered":"2024-09-15T23:55:42.227135+0000","last_unstale":"2024-09-15T23:55:45.211853+0000","last_undegraded":"2024-09-15T23:55:45.211853+0000","last_fullsized":"2024-09-15T23:55:45.211853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:50.351234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211733+0000","last_change":"2024-09-15T23:55:43.237472+0000","last_active":"2024-09-15T23:55:45.211733+0000","last_peered":"2024-09-15T23:55:45.211733+0000","last_clean":"2024-09-15T23:55:45.211733+0000","last_became_active":"2024-09-15T23:55:43.237005+0000","last_became_peered":"2024-09-15T23:55:43.237005+0000","last_unstale":"2024-09-15T23:55:45.211733+0000","last_undegraded":"2024-09-15T23:55:45.211733+0000","last_fullsized":"2024-09-15T23:55:45.211733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:24.250030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"26'6","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224507+0000","last_change":"2024-09-15T23:55:42.232680+0000","last_active":"2024-09-15T23:55:44.224507+0000","last_peered":"2024-09-15T23:55:44.224507+0000","last_clean":"2024-09-15T23:55:44.224507+0000","last_became_active":"2024-09-15T23:55:42.232415+0000","last_became_peered":"2024-09-15T23:55:42.232415+0000","last_unstale":"2024-09-15T23:55:44.224507+0000","last_undegraded":"2024-09-15T23:55:44.224507+0000","last_fullsized":"2024-09-15T23:55:44.224507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:58.798413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223792+0000","last_change":"2024-09-15T23:55:43.234108+0000","last_active":"2024-09-15T23:55:44.223792+0000","last_peered":"2024-09-15T23:55:44.223792+0000","last_clean":"2024-09-15T23:55:44.223792+0000","last_became_active":"2024-09-15T23:55:43.233844+0000","last_became_peered":"2024-09-15T23:55:43.233844+0000","last_unstale":"2024-09-15T23:55:44.223792+0000","last_undegraded":"2024-09-15T23:55:44.223792+0000","last_fullsized":"2024-09-15T23:55:44.223792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:00.161670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041197+0000","last_change":"2024-09-15T23:55:42.229038+0000","last_active":"2024-09-15T23:55:45.041197+0000","last_peered":"2024-09-15T23:55:45.041197+0000","last_clean":"2024-09-15T23:55:45.041197+0000","last_became_active":"2024-09-15T23:55:42.228474+0000","last_became_peered":"2024-09-15T23:55:42.228474+0000","last_unstale":"2024-09-15T23:55:45.041197+0000","last_undegraded":"2024-09-15T23:55:45.041197+0000","last_fullsized":"2024-09-15T23:55:45.041197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:44.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224838+0000","last_change":"2024-09-15T23:55:43.243953+0000","last_active":"2024-09-15T23:55:44.224838+0000","last_peered":"2024-09-15T23:55:44.224838+0000","last_clean":"2024-09-15T23:55:44.224838+0000","last_became_active":"2024-09-15T23:55:43.243658+0000","last_became_peered":"2024-09-15T23:55:43.243658+0000","last_unstale":"2024-09-15T23:55:44.224838+0000","last_undegraded":"2024-09-15T23:55:44.224838+0000","last_fullsized":"2024-09-15T23:55:44.224838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:33.037035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223892+0000","last_change":"2024-09-15T23:55:42.226400+0000","last_active":"2024-09-15T23:55:44.223892+0000","last_peered":"2024-09-15T23:55:44.223892+0000","last_clean":"2024-09-15T23:55:44.223892+0000","last_became_active":"2024-09-15T23:55:42.226109+0000","last_became_peered":"2024-09-15T23:55:42.226109+0000","last_unstale":"2024-09-15T23:55:44.223892+0000","last_undegraded":"2024-09-15T23:55:44.223892+0000","last_fullsized":"2024-09-15T23:55:44.223892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:07.226298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040409+0000","last_change":"2024-09-15T23:55:43.241204+0000","last_active":"2024-09-15T23:55:45.040409+0000","last_peered":"2024-09-15T23:55:45.040409+0000","last_clean":"2024-09-15T23:55:45.040409+0000","last_became_active":"2024-09-15T23:55:43.240331+0000","last_became_peered":"2024-09-15T23:55:43.240331+0000","last_unstale":"2024-09-15T23:55:45.040409+0000","last_undegraded":"2024-09-15T23:55:45.040409+0000","last_fullsized":"2024-09-15T23:55:45.040409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:50.785113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040387+0000","last_change":"2024-09-15T23:55:42.220273+0000","last_active":"2024-09-15T23:55:45.040387+0000","last_peered":"2024-09-15T23:55:45.040387+0000","last_clean":"2024-09-15T23:55:45.040387+0000","last_became_active":"2024-09-15T23:55:42.219755+0000","last_became_peered":"2024-09-15T23:55:42.219755+0000","last_unstale":"2024-09-15T23:55:45.040387+0000","last_undegraded":"2024-09-15T23:55:45.040387+0000","last_fullsized":"2024-09-15T23:55:45.040387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:30.864065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224876+0000","last_change":"2024-09-15T23:55:43.231154+0000","last_active":"2024-09-15T23:55:44.224876+0000","last_peered":"2024-09-15T23:55:44.224876+0000","last_clean":"2024-09-15T23:55:44.224876+0000","last_became_active":"2024-09-15T23:55:43.230284+0000","last_became_peered":"2024-09-15T23:55:43.230284+0000","last_unstale":"2024-09-15T23:55:44.224876+0000","last_undegraded":"2024-09-15T23:55:44.224876+0000","last_fullsized":"2024-09-15T23:55:44.224876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:58.295987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"26'8","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223649+0000","last_change":"2024-09-15T23:55:42.233298+0000","last_active":"2024-09-15T23:55:44.223649+0000","last_peered":"2024-09-15T23:55:44.223649+0000","last_clean":"2024-09-15T23:55:44.223649+0000","last_became_active":"2024-09-15T23:55:42.233077+0000","last_became_peered":"2024-09-15T23:55:42.233077+0000","last_unstale":"2024-09-15T23:55:44.223649+0000","last_undegraded":"2024-09-15T23:55:44.223649+0000","last_fullsized":"2024-09-15T23:55:44.223649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:51.748983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040946+0000","last_change":"2024-09-15T23:55:43.245361+0000","last_active":"2024-09-15T23:55:45.040946+0000","last_peered":"2024-09-15T23:55:45.040946+0000","last_clean":"2024-09-15T23:55:45.040946+0000","last_became_active":"2024-09-15T23:55:43.245184+0000","last_became_peered":"2024-09-15T23:55:43.245184+0000","last_unstale":"2024-09-15T23:55:45.040946+0000","last_undegraded":"2024-09-15T23:55:45.040946+0000","last_fullsized":"2024-09-15T23:55:45.040946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:20.348095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.225219+0000","last_change":"2024-09-15T23:55:42.226711+0000","last_active":"2024-09-15T23:55:44.225219+0000","last_peered":"2024-09-15T23:55:44.225219+0000","last_clean":"2024-09-15T23:55:44.225219+0000","last_became_active":"2024-09-15T23:55:42.226436+0000","last_became_peered":"2024-09-15T23:55:42.226436+0000","last_unstale":"2024-09-15T23:55:44.225219+0000","last_undegraded":"2024-09-15T23:55:44.225219+0000","last_fullsized":"2024-09-15T23:55:44.225219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:08.294016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.225141+0000","last_change":"2024-09-15T23:55:43.247639+0000","last_active":"2024-09-15T23:55:44.225141+0000","last_peered":"2024-09-15T23:55:44.225141+0000","last_clean":"2024-09-15T23:55:44.225141+0000","last_became_active":"2024-09-15T23:55:43.247268+0000","last_became_peered":"2024-09-15T23:55:43.247268+0000","last_unstale":"2024-09-15T23:55:44.225141+0000","last_undegraded":"2024-09-15T23:55:44.225141+0000","last_fullsized":"2024-09-15T23:55:44.225141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:51.323608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041238+0000","last_change":"2024-09-15T23:55:42.229093+0000","last_active":"2024-09-15T23:55:45.041238+0000","last_peered":"2024-09-15T23:55:45.041238+0000","last_clean":"2024-09-15T23:55:45.041238+0000","last_became_active":"2024-09-15T23:55:42.228543+0000","last_became_peered":"2024-09-15T23:55:42.228543+0000","last_unstale":"2024-09-15T23:55:45.041238+0000","last_undegraded":"2024-09-15T23:55:45.041238+0000","last_fullsized":"2024-09-15T23:55:45.041238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:14.051803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224388+0000","last_change":"2024-09-15T23:55:43.246335+0000","last_active":"2024-09-15T23:55:44.224388+0000","last_peered":"2024-09-15T23:55:44.224388+0000","last_clean":"2024-09-15T23:55:44.224388+0000","last_became_active":"2024-09-15T23:55:43.246062+0000","last_became_peered":"2024-09-15T23:55:43.246062+0000","last_unstale":"2024-09-15T23:55:44.224388+0000","last_undegraded":"2024-09-15T23:55:44.224388+0000","last_fullsized":"2024-09-15T23:55:44.224388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:55.536532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"26'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224733+0000","last_change":"2024-09-15T23:55:42.231292+0000","last_active":"2024-09-15T23:55:44.224733+0000","last_peered":"2024-09-15T23:55:44.224733+0000","last_clean":"2024-09-15T23:55:44.224733+0000","last_became_active":"2024-09-15T23:55:42.230815+0000","last_became_peered":"2024-09-15T23:55:42.230815+0000","last_unstale":"2024-09-15T23:55:44.224733+0000","last_undegraded":"2024-09-15T23:55:44.224733+0000","last_fullsized":"2024-09-15T23:55:44.224733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:02.207483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041222+0000","last_change":"2024-09-15T23:55:43.228361+0000","last_active":"2024-09-15T23:55:45.041222+0000","last_peered":"2024-09-15T23:55:45.041222+0000","last_clean":"2024-09-15T23:55:45.041222+0000","last_became_active":"2024-09-15T23:55:43.228093+0000","last_became_peered":"2024-09-15T23:55:43.228093+0000","last_unstale":"2024-09-15T23:55:45.041222+0000","last_undegraded":"2024-09-15T23:55:45.041222+0000","last_fullsized":"2024-09-15T23:55:45.041222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:49.533670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211450+0000","last_change":"2024-09-15T23:55:42.227704+0000","last_active":"2024-09-15T23:55:45.211450+0000","last_peered":"2024-09-15T23:55:45.211450+0000","last_clean":"2024-09-15T23:55:45.211450+0000","last_became_active":"2024-09-15T23:55:42.226981+0000","last_became_peered":"2024-09-15T23:55:42.226981+0000","last_unstale":"2024-09-15T23:55:45.211450+0000","last_undegraded":"2024-09-15T23:55:45.211450+0000","last_fullsized":"2024-09-15T23:55:45.211450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:03.042643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040775+0000","last_change":"2024-09-15T23:55:43.245338+0000","last_active":"2024-09-15T23:55:45.040775+0000","last_peered":"2024-09-15T23:55:45.040775+0000","last_clean":"2024-09-15T23:55:45.040775+0000","last_became_active":"2024-09-15T23:55:43.245128+0000","last_became_peered":"2024-09-15T23:55:43.245128+0000","last_unstale":"2024-09-15T23:55:45.040775+0000","last_undegraded":"2024-09-15T23:55:45.040775+0000","last_fullsized":"2024-09-15T23:55:45.040775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:14.149843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211442+0000","last_change":"2024-09-15T23:55:42.228234+0000","last_active":"2024-09-15T23:55:45.211442+0000","last_peered":"2024-09-15T23:55:45.211442+0000","last_clean":"2024-09-15T23:55:45.211442+0000","last_became_active":"2024-09-15T23:55:42.228025+0000","last_became_peered":"2024-09-15T23:55:42.228025+0000","last_unstale":"2024-09-15T23:55:45.211442+0000","last_undegraded":"2024-09-15T23:55:45.211442+0000","last_fullsized":"2024-09-15T23:55:45.211442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:22.346215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040709+0000","last_change":"2024-09-15T23:55:43.235159+0000","last_active":"2024-09-15T23:55:45.040709+0000","last_peered":"2024-09-15T23:55:45.040709+0000","last_clean":"2024-09-15T23:55:45.040709+0000","last_became_active":"2024-09-15T23:55:43.234683+0000","last_became_peered":"2024-09-15T23:55:43.234683+0000","last_unstale":"2024-09-15T23:55:45.040709+0000","last_undegraded":"2024-09-15T23:55:45.040709+0000","last_fullsized":"2024-09-15T23:55:45.040709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:04.931870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040771+0000","last_change":"2024-09-15T23:55:42.230626+0000","last_active":"2024-09-15T23:55:45.040771+0000","last_peered":"2024-09-15T23:55:45.040771+0000","last_clean":"2024-09-15T23:55:45.040771+0000","last_became_active":"2024-09-15T23:55:42.229558+0000","last_became_peered":"2024-09-15T23:55:42.229558+0000","last_unstale":"2024-09-15T23:55:45.040771+0000","last_undegraded":"2024-09-15T23:55:45.040771+0000","last_fullsized":"2024-09-15T23:55:45.040771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:41.545133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040818+0000","last_change":"2024-09-15T23:55:43.231968+0000","last_active":"2024-09-15T23:55:45.040818+0000","last_peered":"2024-09-15T23:55:45.040818+0000","last_clean":"2024-09-15T23:55:45.040818+0000","last_became_active":"2024-09-15T23:55:43.231713+0000","last_became_peered":"2024-09-15T23:55:43.231713+0000","last_unstale":"2024-09-15T23:55:45.040818+0000","last_undegraded":"2024-09-15T23:55:45.040818+0000","last_fullsized":"2024-09-15T23:55:45.040818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:53.099392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224008+0000","last_change":"2024-09-15T23:55:42.232416+0000","last_active":"2024-09-15T23:55:44.224008+0000","last_peered":"2024-09-15T23:55:44.224008+0000","last_clean":"2024-09-15T23:55:44.224008+0000","last_became_active":"2024-09-15T23:55:42.232148+0000","last_became_peered":"2024-09-15T23:55:42.232148+0000","last_unstale":"2024-09-15T23:55:44.224008+0000","last_undegraded":"2024-09-15T23:55:44.224008+0000","last_fullsized":"2024-09-15T23:55:44.224008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:16.774987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223782+0000","last_change":"2024-09-15T23:55:43.244578+0000","last_active":"2024-09-15T23:55:44.223782+0000","last_peered":"2024-09-15T23:55:44.223782+0000","last_clean":"2024-09-15T23:55:44.223782+0000","last_became_active":"2024-09-15T23:55:43.244274+0000","last_became_peered":"2024-09-15T23:55:43.244274+0000","last_unstale":"2024-09-15T23:55:44.223782+0000","last_undegraded":"2024-09-15T23:55:44.223782+0000","last_fullsized":"2024-09-15T23:55:44.223782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:51.355035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223760+0000","last_change":"2024-09-15T23:55:42.229509+0000","last_active":"2024-09-15T23:55:44.223760+0000","last_peered":"2024-09-15T23:55:44.223760+0000","last_clean":"2024-09-15T23:55:44.223760+0000","last_became_active":"2024-09-15T23:55:42.229201+0000","last_became_peered":"2024-09-15T23:55:42.229201+0000","last_unstale":"2024-09-15T23:55:44.223760+0000","last_undegraded":"2024-09-15T23:55:44.223760+0000","last_fullsized":"2024-09-15T23:55:44.223760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:34.922133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.041161+0000","last_change":"2024-09-15T23:55:43.245258+0000","last_active":"2024-09-15T23:55:45.041161+0000","last_peered":"2024-09-15T23:55:45.041161+0000","last_clean":"2024-09-15T23:55:45.041161+0000","last_became_active":"2024-09-15T23:55:43.244929+0000","last_became_peered":"2024-09-15T23:55:43.244929+0000","last_unstale":"2024-09-15T23:55:45.041161+0000","last_undegraded":"2024-09-15T23:55:45.041161+0000","last_fullsized":"2024-09-15T23:55:45.041161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:52.624713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.225269+0000","last_change":"2024-09-15T23:55:42.232445+0000","last_active":"2024-09-15T23:55:44.225269+0000","last_peered":"2024-09-15T23:55:44.225269+0000","last_clean":"2024-09-15T23:55:44.225269+0000","last_became_active":"2024-09-15T23:55:42.232171+0000","last_became_peered":"2024-09-15T23:55:42.232171+0000","last_unstale":"2024-09-15T23:55:44.225269+0000","last_undegraded":"2024-09-15T23:55:44.225269+0000","last_fullsized":"2024-09-15T23:55:44.225269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:01:54.837033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211742+0000","last_change":"2024-09-15T23:55:43.240586+0000","last_active":"2024-09-15T23:55:45.211742+0000","last_peered":"2024-09-15T23:55:45.211742+0000","last_clean":"2024-09-15T23:55:45.211742+0000","last_became_active":"2024-09-15T23:55:43.238442+0000","last_became_peered":"2024-09-15T23:55:43.238442+0000","last_unstale":"2024-09-15T23:55:45.211742+0000","last_undegraded":"2024-09-15T23:55:45.211742+0000","last_fullsized":"2024-09-15T23:55:45.211742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:17.527742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"27'1","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211939+0000","last_change":"2024-09-15T23:55:42.227428+0000","last_active":"2024-09-15T23:55:45.211939+0000","last_peered":"2024-09-15T23:55:45.211939+0000","last_clean":"2024-09-15T23:55:45.211939+0000","last_became_active":"2024-09-15T23:55:42.227111+0000","last_became_peered":"2024-09-15T23:55:42.227111+0000","last_unstale":"2024-09-15T23:55:45.211939+0000","last_undegraded":"2024-09-15T23:55:45.211939+0000","last_fullsized":"2024-09-15T23:55:45.211939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:17.447961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211658+0000","last_change":"2024-09-15T23:55:43.235092+0000","last_active":"2024-09-15T23:55:45.211658+0000","last_peered":"2024-09-15T23:55:45.211658+0000","last_clean":"2024-09-15T23:55:45.211658+0000","last_became_active":"2024-09-15T23:55:43.234853+0000","last_became_peered":"2024-09-15T23:55:43.234853+0000","last_unstale":"2024-09-15T23:55:45.211658+0000","last_undegraded":"2024-09-15T23:55:45.211658+0000","last_fullsized":"2024-09-15T23:55:45.211658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:12:54.492411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224595+0000","last_change":"2024-09-15T23:55:42.223960+0000","last_active":"2024-09-15T23:55:44.224595+0000","last_peered":"2024-09-15T23:55:44.224595+0000","last_clean":"2024-09-15T23:55:44.224595+0000","last_became_active":"2024-09-15T23:55:42.223701+0000","last_became_peered":"2024-09-15T23:55:42.223701+0000","last_unstale":"2024-09-15T23:55:44.224595+0000","last_undegraded":"2024-09-15T23:55:44.224595+0000","last_fullsized":"2024-09-15T23:55:44.224595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:14.452432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211121+0000","last_change":"2024-09-15T23:55:43.240985+0000","last_active":"2024-09-15T23:55:45.211121+0000","last_peered":"2024-09-15T23:55:45.211121+0000","last_clean":"2024-09-15T23:55:45.211121+0000","last_became_active":"2024-09-15T23:55:43.240559+0000","last_became_peered":"2024-09-15T23:55:43.240559+0000","last_unstale":"2024-09-15T23:55:45.211121+0000","last_undegraded":"2024-09-15T23:55:45.211121+0000","last_fullsized":"2024-09-15T23:55:45.211121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:31.077715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211616+0000","last_change":"2024-09-15T23:55:42.216705+0000","last_active":"2024-09-15T23:55:45.211616+0000","last_peered":"2024-09-15T23:55:45.211616+0000","last_clean":"2024-09-15T23:55:45.211616+0000","last_became_active":"2024-09-15T23:55:42.216416+0000","last_became_peered":"2024-09-15T23:55:42.216416+0000","last_unstale":"2024-09-15T23:55:45.211616+0000","last_undegraded":"2024-09-15T23:55:45.211616+0000","last_fullsized":"2024-09-15T23:55:45.211616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:12.797634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211467+0000","last_change":"2024-09-15T23:55:43.235614+0000","last_active":"2024-09-15T23:55:45.211467+0000","last_peered":"2024-09-15T23:55:45.211467+0000","last_clean":"2024-09-15T23:55:45.211467+0000","last_became_active":"2024-09-15T23:55:43.234788+0000","last_became_peered":"2024-09-15T23:55:43.234788+0000","last_unstale":"2024-09-15T23:55:45.211467+0000","last_undegraded":"2024-09-15T23:55:45.211467+0000","last_fullsized":"2024-09-15T23:55:45.211467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:49:41.156949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223988+0000","last_change":"2024-09-15T23:55:42.232517+0000","last_active":"2024-09-15T23:55:44.223988+0000","last_peered":"2024-09-15T23:55:44.223988+0000","last_clean":"2024-09-15T23:55:44.223988+0000","last_became_active":"2024-09-15T23:55:42.232227+0000","last_became_peered":"2024-09-15T23:55:42.232227+0000","last_unstale":"2024-09-15T23:55:44.223988+0000","last_undegraded":"2024-09-15T23:55:44.223988+0000","last_fullsized":"2024-09-15T23:55:44.223988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:49.949166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040783+0000","last_change":"2024-09-15T23:55:43.241417+0000","last_active":"2024-09-15T23:55:45.040783+0000","last_peered":"2024-09-15T23:55:45.040783+0000","last_clean":"2024-09-15T23:55:45.040783+0000","last_became_active":"2024-09-15T23:55:43.240660+0000","last_became_peered":"2024-09-15T23:55:43.240660+0000","last_unstale":"2024-09-15T23:55:45.040783+0000","last_undegraded":"2024-09-15T23:55:45.040783+0000","last_fullsized":"2024-09-15T23:55:45.040783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:39.805907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.040500+0000","last_change":"2024-09-15T23:55:42.220495+0000","last_active":"2024-09-15T23:55:45.040500+0000","last_peered":"2024-09-15T23:55:45.040500+0000","last_clean":"2024-09-15T23:55:45.040500+0000","last_became_active":"2024-09-15T23:55:42.219865+0000","last_became_peered":"2024-09-15T23:55:42.219865+0000","last_unstale":"2024-09-15T23:55:45.040500+0000","last_undegraded":"2024-09-15T23:55:45.040500+0000","last_fullsized":"2024-09-15T23:55:45.040500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:23.866845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223922+0000","last_change":"2024-09-15T23:55:43.243967+0000","last_active":"2024-09-15T23:55:44.223922+0000","last_peered":"2024-09-15T23:55:44.223922+0000","last_clean":"2024-09-15T23:55:44.223922+0000","last_became_active":"2024-09-15T23:55:43.243696+0000","last_became_peered":"2024-09-15T23:55:43.243696+0000","last_unstale":"2024-09-15T23:55:44.223922+0000","last_undegraded":"2024-09-15T23:55:44.223922+0000","last_fullsized":"2024-09-15T23:55:44.223922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:18.451762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.210684+0000","last_change":"2024-09-15T23:55:42.227968+0000","last_active":"2024-09-15T23:55:45.210684+0000","last_peered":"2024-09-15T23:55:45.210684+0000","last_clean":"2024-09-15T23:55:45.210684+0000","last_became_active":"2024-09-15T23:55:42.227688+0000","last_became_peered":"2024-09-15T23:55:42.227688+0000","last_unstale":"2024-09-15T23:55:45.210684+0000","last_undegraded":"2024-09-15T23:55:45.210684+0000","last_fullsized":"2024-09-15T23:55:45.210684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:23.371206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:45.211426+0000","last_change":"2024-09-15T23:55:43.225643+0000","last_active":"2024-09-15T23:55:45.211426+0000","last_peered":"2024-09-15T23:55:45.211426+0000","last_clean":"2024-09-15T23:55:45.211426+0000","last_became_active":"2024-09-15T23:55:43.225169+0000","last_became_peered":"2024-09-15T23:55:43.225169+0000","last_unstale":"2024-09-15T23:55:45.211426+0000","last_undegraded":"2024-09-15T23:55:45.211426+0000","last_fullsized":"2024-09-15T23:55:45.211426+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:42.201069+0000","last_clean_scrub_stamp":"2024-09-15T23:55:42.201069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:20.638701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.224827+0000","last_change":"2024-09-15T23:55:42.224100+0000","last_active":"2024-09-15T23:55:44.224827+0000","last_peered":"2024-09-15T23:55:44.224827+0000","last_clean":"2024-09-15T23:55:44.224827+0000","last_became_active":"2024-09-15T23:55:42.223829+0000","last_became_peered":"2024-09-15T23:55:42.223829+0000","last_unstale":"2024-09-15T23:55:44.224827+0000","last_undegraded":"2024-09-15T23:55:44.224827+0000","last_fullsized":"2024-09-15T23:55:44.224827+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:41.197269+0000","last_clean_scrub_stamp":"2024-09-15T23:55:41.197269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:31:17.324500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T23:55:44.223765+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:55:44.223765+0000","last_peered":"2024-09-15T23:55:44.223765+0000","last_clean":"2024-09-15T23:55:44.223765+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:55:44.223765+0000","last_undegraded":"2024-09-15T23:55:44.223765+0000","last_fullsized":"2024-09-15T23:55:44.223765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705676,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":249856,"data_stored":80483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705676,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":864256,"data_stored":673135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":673009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:55:50.813 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:55:50.813 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:55:50.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2e79f640 1 Processor -- start 2024-09-15T23:55:50.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2e79f640 1 -- start start 2024-09-15T23:55:50.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2e79f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7e280a33e0 0x7f7e28132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2e79f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e280a13d0 con 0x7f7e28133210 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2e79f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7e280a37c0 con 0x7f7e280a33e0 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2d79d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7e280a33e0 0x7f7e28132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2cf9c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7e28133210 0x7f7e28135e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35590/0 (socket says 172.21.15.121:35590) 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.951+0000 7f7e2cf9c640 1 -- 172.21.15.121:0/2010401816 learned_addr learned my addr 172.21.15.121:0/2010401816 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.952+0000 7f7e2d79d640 1 -- 172.21.15.121:0/2010401816 >> v1:172.21.15.121:6789/0 conn(0x7f7e28133210 legacy=0x7f7e28135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.952+0000 7f7e2d79d640 1 -- 172.21.15.121:0/2010401816 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280a0810 con 0x7f7e280a33e0 2024-09-15T23:55:50.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.952+0000 7f7e2d79d640 1 --2- 172.21.15.121:0/2010401816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e28132cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400a8c0 tx=0x7f7e2402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4c1e9b75ac353e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.952+0000 7f7e1ffff640 1 -- 172.21.15.121:0/2010401816 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e2400b040 con 0x7f7e280a33e0 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e1ffff640 1 -- 172.21.15.121:0/2010401816 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24030640 con 0x7f7e280a33e0 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e1ffff640 1 -- 172.21.15.121:0/2010401816 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e24030940 con 0x7f7e280a33e0 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2010401816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 msgr2=0x7f7e28132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2010401816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e28132cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400a8c0 tx=0x7f7e2402b4d0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2010401816 shutdown_connections 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2010401816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e28132cd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2010401816 >> 172.21.15.121:0/2010401816 conn(0x7f7e280a8150 msgr2=0x7f7e280a8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2010401816 shutdown_connections 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.953+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2010401816 wait complete. 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.954+0000 7f7e2e79f640 1 Processor -- start 2024-09-15T23:55:50.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.954+0000 7f7e2e79f640 1 -- start start 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.954+0000 7f7e2e79f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.954+0000 7f7e2e79f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280a4050 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2d79d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2d79d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36592/0 (socket says 172.21.15.121:36592) 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2d79d640 1 -- 172.21.15.121:0/2881247454 learned_addr learned my addr 172.21.15.121:0/2881247454 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2d79d640 1 -- 172.21.15.121:0/2881247454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280701c0 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2d79d640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e24030610 tx=0x7f7e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e2403f070 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24033b20 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2806fee0 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e24033e20 con 0x7f7e280a33e0 2024-09-15T23:55:50.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.955+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e28072050 con 0x7f7e280a33e0 2024-09-15T23:55:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.956+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7e24042070 con 0x7f7e280a33e0 2024-09-15T23:55:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.956+0000 7f7e1dffb640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 0x7f7e0c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.956+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e28133660 con 0x7f7e280a33e0 2024-09-15T23:55:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.956+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f7e2406c110 con 0x7f7e280a33e0 2024-09-15T23:55:50.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.956+0000 7f7e2cf9c640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 0x7f7e0c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:50.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.957+0000 7f7e2cf9c640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 0x7f7e0c03a760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:50.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:50.961+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e240319c0 con 0x7f7e280a33e0 2024-09-15T23:55:51.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.189+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7e28072c10 con 0x7f7e280a33e0 2024-09-15T23:55:51.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.190+0000 7f7e1dffb640 1 -- 172.21.15.121:0/2881247454 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f7e24031c20 con 0x7f7e280a33e0 2024-09-15T23:55:51.191 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-15T23:55:51.191 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg== 2024-09-15T23:55:51.192 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-15T23:55:51.192 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-15T23:55:51.192 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:55:51.192 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 msgr2=0x7f7e0c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 0x7f7e0c03a760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18007ac0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 msgr2=0x7f7e2812f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e24030610 tx=0x7f7e240046c0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 shutdown_connections 2024-09-15T23:55:51.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f7e0c0382a0 0x7f7e0c03a760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 --2- 172.21.15.121:0/2881247454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7e280a33e0 0x7f7e2812f7e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 >> 172.21.15.121:0/2881247454 conn(0x7f7e280a8150 msgr2=0x7f7e2809f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 shutdown_connections 2024-09-15T23:55:51.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.192+0000 7f7e2e79f640 1 -- 172.21.15.121:0/2881247454 wait complete. 2024-09-15T23:55:51.205 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f21665ed640 1 Processor -- start 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f21665ed640 1 -- start start 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f21665ed640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f216009ee30 0x7f216013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f21665ed640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21600a2280 con 0x7f21600a39c0 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f21665ed640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f216009e6e0 con 0x7f216009ee30 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f215f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f216009ee30 0x7f216013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f215ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f21600a39c0 0x7f21600a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35592/0 (socket says 172.21.15.121:35592) 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.305+0000 7f215ffff640 1 -- 172.21.15.121:0/3946447440 learned_addr learned my addr 172.21.15.121:0/3946447440 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.306+0000 7f215f7fe640 1 -- 172.21.15.121:0/3946447440 >> v1:172.21.15.121:6789/0 conn(0x7f21600a39c0 legacy=0x7f21600a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.306+0000 7f215f7fe640 1 -- 172.21.15.121:0/3946447440 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216009e3d0 con 0x7f216009ee30 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.306+0000 7f215f7fe640 1 --2- 172.21.15.121:0/3946447440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f216013ced0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2154009720 tx=0x7f215402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f094a2d29a4c9142 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.306+0000 7f215effd640 1 -- 172.21.15.121:0/3946447440 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2154037070 con 0x7f216009ee30 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f215effd640 1 -- 172.21.15.121:0/3946447440 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215402ad90 con 0x7f216009ee30 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f215effd640 1 -- 172.21.15.121:0/3946447440 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2154032590 con 0x7f216009ee30 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 -- 172.21.15.121:0/3946447440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 msgr2=0x7f216013ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 --2- 172.21.15.121:0/3946447440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f216013ced0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2154009720 tx=0x7f215402a110 comp rx=0 tx=0).stop 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 -- 172.21.15.121:0/3946447440 shutdown_connections 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 --2- 172.21.15.121:0/3946447440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f216013ced0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 -- 172.21.15.121:0/3946447440 >> 172.21.15.121:0/3946447440 conn(0x7f21600a85e0 msgr2=0x7f21600a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 -- 172.21.15.121:0/3946447440 shutdown_connections 2024-09-15T23:55:51.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.307+0000 7f21665ed640 1 -- 172.21.15.121:0/3946447440 wait complete. 2024-09-15T23:55:51.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.308+0000 7f21665ed640 1 Processor -- start 2024-09-15T23:55:51.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.308+0000 7f21665ed640 1 -- start start 2024-09-15T23:55:51.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.308+0000 7f21665ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f21665ed640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f21600a1ed0 con 0x7f216009ee30 2024-09-15T23:55:51.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36614/0 (socket says 172.21.15.121:36614) 2024-09-15T23:55:51.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215ffff640 1 -- 172.21.15.121:0/868748987 learned_addr learned my addr 172.21.15.121:0/868748987 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215ffff640 1 -- 172.21.15.121:0/868748987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216011fde0 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215ffff640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f215000c4a0 tx=0x7f215000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150017070 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150005c10 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2150007070 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216011ece0 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.309+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21601200a0 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.310+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f215001a070 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.310+0000 7f215cff9640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 0x7f214c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.310+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f215004a510 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.310+0000 7f215f7fe640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 0x7f214c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.310+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2160120d50 con 0x7f216009ee30 2024-09-15T23:55:51.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.311+0000 7f215f7fe640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 0x7f214c03a710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2154034000 tx=0x7f215402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.315+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f215001b400 con 0x7f216009ee30 2024-09-15T23:55:51.514 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.514+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f216006bde0 con 0x7f216009ee30 2024-09-15T23:55:51.515 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.514+0000 7f215cff9640 1 -- 172.21.15.121:0/868748987 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7f2150010c00 con 0x7f216009ee30 2024-09-15T23:55:51.515 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:55:51.515 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:55:51.515 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:55:51.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 msgr2=0x7f214c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 0x7f214c03a710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2154034000 tx=0x7f215402e000 comp rx=0 tx=0).stop 2024-09-15T23:55:51.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 msgr2=0x7f2160120810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f215000c4a0 tx=0x7f215000c960 comp rx=0 tx=0).stop 2024-09-15T23:55:51.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 shutdown_connections 2024-09-15T23:55:51.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f214c038250 0x7f214c03a710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 --2- 172.21.15.121:0/868748987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f216009ee30 0x7f2160120810 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 >> 172.21.15.121:0/868748987 conn(0x7f21600a85e0 msgr2=0x7f21600a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 shutdown_connections 2024-09-15T23:55:51.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.516+0000 7f21665ed640 1 -- 172.21.15.121:0/868748987 wait complete. 2024-09-15T23:55:51.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:55:42.553611+0000', 'modified': '2024-09-15T23:55:44.540268+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4330}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4330': {'gid': 4330, 'name': 'b', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6829/3125597125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6827', 'nonce': 3125597125}, {'type': 'v1', 'addr': '172.21.15.121:6829', 'nonce': 3125597125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4330, 'qdb_cluster': [4330]} 2024-09-15T23:55:51.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:55:51.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T23:55:51.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.829+0000 7f174945e640 1 Processor -- start 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.829+0000 7f174945e640 1 -- start start 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.829+0000 7f174945e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f17440a1c80 0x7f174413a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.829+0000 7f174945e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174409f2f0 con 0x7f174413a220 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.829+0000 7f174945e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f17440a07d0 con 0x7f17440a1c80 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f173bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f17440a1c80 0x7f174413a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f1742ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f174413a220 0x7f1744136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35596/0 (socket says 172.21.15.121:35596) 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f1742ffd640 1 -- 172.21.15.121:0/764554793 learned_addr learned my addr 172.21.15.121:0/764554793 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f173bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f17440a1c80 0x7f174413a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36626/0 (socket says 172.21.15.121:36626) 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f173bfff640 1 -- 172.21.15.121:0/764554793 >> v1:172.21.15.121:6789/0 conn(0x7f174413a220 legacy=0x7f1744136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.830+0000 7f173bfff640 1 -- 172.21.15.121:0/764554793 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1744139dd0 con 0x7f17440a1c80 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f173bfff640 1 --2- 172.21.15.121:0/764554793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f174413a600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f172c009720 tx=0x7f172c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285478ea624b9ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f17427fc640 1 -- 172.21.15.121:0/764554793 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172c037070 con 0x7f17440a1c80 2024-09-15T23:55:51.833 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f17427fc640 1 -- 172.21.15.121:0/764554793 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c02ad90 con 0x7f17440a1c80 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f17427fc640 1 -- 172.21.15.121:0/764554793 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f172c032590 con 0x7f17440a1c80 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 -- 172.21.15.121:0/764554793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 msgr2=0x7f174413a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 --2- 172.21.15.121:0/764554793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f174413a600 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f172c009720 tx=0x7f172c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 -- 172.21.15.121:0/764554793 shutdown_connections 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 --2- 172.21.15.121:0/764554793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f174413a600 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 -- 172.21.15.121:0/764554793 >> 172.21.15.121:0/764554793 conn(0x7f174406d820 msgr2=0x7f174406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 -- 172.21.15.121:0/764554793 shutdown_connections 2024-09-15T23:55:51.834 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.831+0000 7f174945e640 1 -- 172.21.15.121:0/764554793 wait complete. 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.832+0000 7f174945e640 1 Processor -- start 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.832+0000 7f174945e640 1 -- start start 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f174945e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f174945e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1744139a20 con 0x7f17440a1c80 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.836 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36628/0 (socket says 172.21.15.121:36628) 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f1742ffd640 1 -- 172.21.15.121:0/4128527271 learned_addr learned my addr 172.21.15.121:0/4128527271 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f1742ffd640 1 -- 172.21.15.121:0/4128527271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17440aa390 con 0x7f17440a1c80 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f1742ffd640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f173400c4a0 tx=0x7f173400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f173b7fe640 1 -- 172.21.15.121:0/4128527271 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734017070 con 0x7f17440a1c80 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f173b7fe640 1 -- 172.21.15.121:0/4128527271 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734005c10 con 0x7f17440a1c80 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f173b7fe640 1 -- 172.21.15.121:0/4128527271 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734007070 con 0x7f17440a1c80 2024-09-15T23:55:51.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17440a97d0 con 0x7f17440a1c80 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.833+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17440a94c0 con 0x7f17440a1c80 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.834+0000 7f173b7fe640 1 -- 172.21.15.121:0/4128527271 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f173401a070 con 0x7f17440a1c80 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.834+0000 7f173b7fe640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 0x7f172403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.835+0000 7f173b7fe640 1 -- 172.21.15.121:0/4128527271 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f173404a4c0 con 0x7f17440a1c80 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.835+0000 7f173bfff640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 0x7f172403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.835+0000 7f173bfff640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 0x7f172403a760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f17440a20c0 tx=0x7f172c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.836+0000 7f174c1fe740 1 Processor -- start 2024-09-15T23:55:51.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.836+0000 7f174c1fe740 1 -- start start 2024-09-15T23:55:51.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.836+0000 7f174c1fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f174c1fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556796036520 con 0x5567960f44e0 2024-09-15T23:55:51.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36634/0 (socket says 172.21.15.121:36634) 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1742ffd640 1 -- 172.21.15.121:0/1788624311 learned_addr learned my addr 172.21.15.121:0/1788624311 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1742ffd640 1 -- 172.21.15.121:0/1788624311 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556795ff92f0 con 0x5567960f44e0 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1742ffd640 1 --2- 172.21.15.121:0/1788624311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f173401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b8a9cb3046ade2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1738ff9640 1 -- 172.21.15.121:0/1788624311 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734041020 con 0x5567960f44e0 2024-09-15T23:55:51.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1738ff9640 1 -- 172.21.15.121:0/1788624311 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734011e40 con 0x5567960f44e0 2024-09-15T23:55:51.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.837+0000 7f1738ff9640 1 -- 172.21.15.121:0/1788624311 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734011510 con 0x5567960f44e0 2024-09-15T23:55:51.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- 172.21.15.121:0/1788624311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 msgr2=0x5567960eef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 --2- 172.21.15.121:0/1788624311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f173401ad80 comp rx=0 tx=0).stop 2024-09-15T23:55:51.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- 172.21.15.121:0/1788624311 shutdown_connections 2024-09-15T23:55:51.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 --2- 172.21.15.121:0/1788624311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eef10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- 172.21.15.121:0/1788624311 >> 172.21.15.121:0/1788624311 conn(0x5567960d11d0 msgr2=0x5567960d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- 172.21.15.121:0/1788624311 shutdown_connections 2024-09-15T23:55:51.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- 172.21.15.121:0/1788624311 wait complete. 2024-09-15T23:55:51.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 -- start start 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.838+0000 7f174c1fe740 1 Processor -- start 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5567960324e0 con 0x5567960f44e0 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 10 client.0 _ll_register_callbacks cb 0x556795d48ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36650/0 (socket says 172.21.15.121:36650) 2024-09-15T23:55:51.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1742ffd640 1 -- 172.21.15.121:0/2669260096 learned_addr learned my addr 172.21.15.121:0/2669260096 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1742ffd640 1 -- 172.21.15.121:0/2669260096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556795d492d0 con 0x5567960f44e0 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1742ffd640 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1734040040 tx=0x7f1734012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a427c08dcf1d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734011630 con 0x5567960f44e0 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f17340117d0 con 0x5567960f44e0 2024-09-15T23:55:51.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556796043c50 con 0x5567960f44e0 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f1734007210 con 0x5567960f44e0 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 10 client.4413 fetch_fsmap learned FSMap version 12 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.839+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x556795e136b0 con 0x5567960f44e0 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556796043c50 con 0x5567960f44e0 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 12) ==== 2292+0+0 (secure 0 0 0) 0x7f1734007470 con 0x5567960f44e0 2024-09-15T23:55:51.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 10 client.4413 fetch_fsmap finished waiting for FSMap version 12 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 10 client.4413 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 20 client.4413 populate_metadata read hostname 'smithi121' 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567961034f0 0x556796103950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 4 client.4413 mds_command: new command op to 4330 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 --> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55679603dfa0 con 0x5567961034f0 2024-09-15T23:55:51.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f173bfff640 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567961034f0 0x556796103950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f1721ffb640 10 client.4413 ms_handle_connect on v2:172.21.15.121:6827/3125597125 2024-09-15T23:55:51.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.840+0000 7f173bfff640 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567961034f0 0x556796103950 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfaa7384c065974d server_cookie=5cded61e5ffce62d in_seq=0 out_seq=0 2024-09-15T23:55:51.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f1721ffb640 1 -- 172.21.15.121:0/2669260096 <== mds.0 v2:172.21.15.121:6827/3125597125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55679603dfa0 con 0x5567961034f0 2024-09-15T23:55:51.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f1721ffb640 10 client.4413 handle_command_reply: tid=0 2024-09-15T23:55:51.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 client.4413 shutdown 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 msgr2=0x5567960f9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1734040040 tx=0x7f1734012f60 comp rx=0 tx=0).stop 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 shutdown_connections 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567961034f0 0x556796103950 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 --2- 172.21.15.121:0/2669260096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960f9e50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f1721ffb640 0 client.4413 ms_handle_reset on v2:172.21.15.121:6827/3125597125 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 >> 172.21.15.121:0/2669260096 conn(0x5567960d11d0 msgr2=0x5567960eeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 shutdown_connections 2024-09-15T23:55:51.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 1 -- 172.21.15.121:0/2669260096 wait complete. 2024-09-15T23:55:51.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.841+0000 7f174c1fe740 20 client.4413 trim_cache size 0 max 16384 2024-09-15T23:55:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f174c1fe740 1 Processor -- start 2024-09-15T23:55:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f174c1fe740 1 -- start start 2024-09-15T23:55:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f174c1fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f174c1fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5567960f7fe0 con 0x5567960f44e0 2024-09-15T23:55:51.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36654/0 (socket says 172.21.15.121:36654) 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f1742ffd640 1 -- 172.21.15.121:0/3422250048 learned_addr learned my addr 172.21.15.121:0/3422250048 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.859+0000 7f1742ffd640 1 -- 172.21.15.121:0/3422250048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567960ca6c0 con 0x5567960f44e0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f1742ffd640 1 --2- 172.21.15.121:0/3422250048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f1734038040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f9eec1536d6946 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f1723fff640 1 -- 172.21.15.121:0/3422250048 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734041070 con 0x5567960f44e0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f1723fff640 1 -- 172.21.15.121:0/3422250048 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734012400 con 0x5567960f44e0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f1723fff640 1 -- 172.21.15.121:0/3422250048 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734011760 con 0x5567960f44e0 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 -- 172.21.15.121:0/3422250048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 msgr2=0x5567960eed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 --2- 172.21.15.121:0/3422250048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f1734038040 comp rx=0 tx=0).stop 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 -- 172.21.15.121:0/3422250048 shutdown_connections 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 --2- 172.21.15.121:0/3422250048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960eed50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 -- 172.21.15.121:0/3422250048 >> 172.21.15.121:0/3422250048 conn(0x5567960d11d0 msgr2=0x5567960d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 -- 172.21.15.121:0/3422250048 shutdown_connections 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.860+0000 7f174c1fe740 1 -- 172.21.15.121:0/3422250048 wait complete. 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f174c1fe740 1 -- start start 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f174c1fe740 1 Processor -- start 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f174c1fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f174c1fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f17440a6860 con 0x5567960f44e0 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f174c1fe740 10 client.0 _ll_register_callbacks cb 0x7f173401ac10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f1742ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36668/0 (socket says 172.21.15.121:36668) 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f1742ffd640 1 -- 172.21.15.121:0/131689660 learned_addr learned my addr 172.21.15.121:0/131689660 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.861+0000 7f1742ffd640 1 -- 172.21.15.121:0/131689660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567960f7ad0 con 0x5567960f44e0 2024-09-15T23:55:51.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1742ffd640 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f17340105e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6d660646d84606 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1734041040 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7f173404f030 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1734012400 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f1734061050 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 10 client.4415 fetch_fsmap learned FSMap version 12 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5567960f7ad0 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1734012400 con 0x5567960f44e0 2024-09-15T23:55:51.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 12) ==== 2292+0+0 (secure 0 0 0) 0x7f173403c660 con 0x5567960f44e0 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 10 client.4415 fetch_fsmap finished waiting for FSMap version 12 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 10 client.4415 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 20 client.4415 populate_metadata read hostname 'smithi121' 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567960edeb0 0x5567960ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 4 client.4415 mds_command: new command op to 4330 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:55:51.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 --> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] -- command(tid 0: {"prefix": "status"}) -- 0x556795fbab80 con 0x5567960edeb0 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f173bfff640 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567960edeb0 0x5567960ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.862+0000 7f1721ffb640 10 client.4415 ms_handle_connect on v2:172.21.15.121:6827/3125597125 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f173bfff640 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567960edeb0 0x5567960ee2d0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9150a64f466d2215 server_cookie=83ecec315f5bac07 in_seq=0 out_seq=0 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f1721ffb640 1 -- 172.21.15.121:0/131689660 <== mds.0 v2:172.21.15.121:6827/3125597125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556795fbab80 con 0x5567960edeb0 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f1721ffb640 10 client.4415 handle_command_reply: tid=0 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 client.4415 shutdown 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 msgr2=0x5567960ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f173400cf00 tx=0x7f17340105e0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 shutdown_connections 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:6827/3125597125,v1:172.21.15.121:6829/3125597125] conn(0x5567960edeb0 0x5567960ee2d0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 --2- 172.21.15.121:0/131689660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5567960f44e0 0x5567960ed900 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 >> 172.21.15.121:0/131689660 conn(0x5567960d11d0 msgr2=0x5567961038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f1721ffb640 0 client.4415 ms_handle_reset on v2:172.21.15.121:6827/3125597125 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 shutdown_connections 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 1 -- 172.21.15.121:0/131689660 wait complete. 2024-09-15T23:55:51.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174c1fe740 20 client.4415 trim_cache size 0 max 16384 2024-09-15T23:55:51.873 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:51.873 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "822f5905-71ec-4c9e-8017-14fcc3976ad1", 2024-09-15T23:55:51.873 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-15T23:55:51.873 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4330, 2024-09-15T23:55:51.873 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 8.6588460840000003, 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12, 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 27, 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 27, 2024-09-15T23:55:51.874 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 15.667303534 2024-09-15T23:55:51.875 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 msgr2=0x7f172403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 0x7f172403a760 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f17440a20c0 tx=0x7f172c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 msgr2=0x7f17440a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f173400c4a0 tx=0x7f173400c960 comp rx=0 tx=0).stop 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 shutdown_connections 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7f17240382a0 0x7f172403a760 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 --2- 172.21.15.121:0/4128527271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17440a1c80 0x7f17440a5e50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.863+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 >> 172.21.15.121:0/4128527271 conn(0x7f174406d820 msgr2=0x7f17441362e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.864+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 shutdown_connections 2024-09-15T23:55:51.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.864+0000 7f174945e640 1 -- 172.21.15.121:0/4128527271 wait complete. 2024-09-15T23:55:51.878 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa21db52640 1 Processor -- start 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa21db52640 1 -- start start 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa21db52640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa218135f30 0x7fa21813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa21db52640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2180a08c0 con 0x7fa218135b50 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa21db52640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa21809b310 con 0x7fa218135f30 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa216ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa218135f30 0x7fa21813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.978 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa2177fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa218135b50 0x7fa21809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:35608/0 (socket says 172.21.15.121:35608) 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa216ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa218135f30 0x7fa21813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36672/0 (socket says 172.21.15.121:36672) 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.975+0000 7fa2177fe640 1 -- 172.21.15.121:0/3525490477 learned_addr learned my addr 172.21.15.121:0/3525490477 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa216ffd640 1 -- 172.21.15.121:0/3525490477 >> v1:172.21.15.121:6789/0 conn(0x7fa218135b50 legacy=0x7fa21809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa216ffd640 1 -- 172.21.15.121:0/3525490477 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2180a2270 con 0x7fa218135f30 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa2167fc640 1 -- 172.21.15.121:0/3525490477 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67808107 0 0) 0x7fa2180a08c0 con 0x7fa218135b50 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa216ffd640 1 --2- 172.21.15.121:0/3525490477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135f30 0x7fa21813bb80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b9c0 tx=0x7fa20c02c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a0a4f722dcc65a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa2167fc640 1 -- 172.21.15.121:0/3525490477 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa20c032570 con 0x7fa218135f30 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa2167fc640 1 -- 172.21.15.121:0/3525490477 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20c038070 con 0x7fa218135f30 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.976+0000 7fa2167fc640 1 -- 172.21.15.121:0/3525490477 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa20c032860 con 0x7fa218135f30 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 -- 172.21.15.121:0/3525490477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135f30 msgr2=0x7fa21813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:51.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 --2- 172.21.15.121:0/3525490477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135f30 0x7fa21813bb80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00b9c0 tx=0x7fa20c02c870 comp rx=0 tx=0).stop 2024-09-15T23:55:51.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 -- 172.21.15.121:0/3525490477 shutdown_connections 2024-09-15T23:55:51.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 --2- 172.21.15.121:0/3525490477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135f30 0x7fa21813bb80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:51.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 -- 172.21.15.121:0/3525490477 >> 172.21.15.121:0/3525490477 conn(0x7fa2180a85e0 msgr2=0x7fa2180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:51.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 -- 172.21.15.121:0/3525490477 shutdown_connections 2024-09-15T23:55:51.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.977+0000 7fa21db52640 1 -- 172.21.15.121:0/3525490477 wait complete. 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.978+0000 7fa21db52640 1 Processor -- start 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.978+0000 7fa21db52640 1 -- start start 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa21db52640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa21db52640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa218136350 con 0x7fa218135b50 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa2177fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa2177fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36678/0 (socket says 172.21.15.121:36678) 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa2177fe640 1 -- 172.21.15.121:0/3081696047 learned_addr learned my addr 172.21.15.121:0/3081696047 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa2177fe640 1 -- 172.21.15.121:0/3081696047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2181262d0 con 0x7fa218135b50 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa2177fe640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c420 tx=0x7fa20800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa208018070 con 0x7fa218135b50 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2080074d0 con 0x7fa218135b50 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa208004950 con 0x7fa218135b50 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa218125740 con 0x7fa218135b50 2024-09-15T23:55:51.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.979+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa218123900 con 0x7fa218135b50 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.980+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa20801b070 con 0x7fa218135b50 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.980+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa218123be0 con 0x7fa218135b50 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.980+0000 7fa1fffff640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 0x7fa20403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.980+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fa20804a560 con 0x7fa218135b50 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.980+0000 7fa216ffd640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 0x7fa20403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:51.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.981+0000 7fa216ffd640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 0x7fa20403a760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa20c037000 tx=0x7fa20c032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:51.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:51.985+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa208011980 con 0x7fa218135b50 2024-09-15T23:55:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.186+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa21809aae0 con 0x7fa218135b50 2024-09-15T23:55:52.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.187+0000 7fa1fffff640 1 -- 172.21.15.121:0/3081696047 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+73 (secure 0 0 0) 0x7fa20801c3b0 con 0x7fa218135b50 2024-09-15T23:55:52.188 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 msgr2=0x7fa20403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 0x7fa20403a760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa20c037000 tx=0x7fa20c032000 comp rx=0 tx=0).stop 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 msgr2=0x7fa218121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c420 tx=0x7fa20800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 shutdown_connections 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fa2040382a0 0x7fa20403a760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 --2- 172.21.15.121:0/3081696047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa218135b50 0x7fa218121c60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 >> 172.21.15.121:0/3081696047 conn(0x7fa2180a85e0 msgr2=0x7fa2180a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 shutdown_connections 2024-09-15T23:55:52.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52.189+0000 7fa21db52640 1 -- 172.21.15.121:0/3081696047 wait complete. 2024-09-15T23:55:52.200 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:55:52.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:55:52.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:52.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.201 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:52.217 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:55:52.218 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:55:52.219 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:52.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.220 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:55:52.281 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:55:52.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.283 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:55:52.339 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:55:52.339 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:55:52.339 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:55:52.339 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:55:52.339 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:55:52.339 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:52.340 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:52.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:55:52.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:55:52.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:55:52.340 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:52.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:52.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:52.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.464 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:55:52.480 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:55:52.480 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:55:52.480 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:52.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-15T23:55:52.545 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:55:52.545 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:52.545 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:52.601 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:55:52.601 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:52.601 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:52.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:52.722 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:52.778 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:52.779 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:52.780 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:52.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.781 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:52.833 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:55:52.833 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:55:52.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:52.900 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:52.956 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:52.957 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:52.958 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:52.959 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:52.960 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:52.960 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:52.960 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:52.960 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:52.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:52.960 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:52.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-09-15T23:55:52.957+0000 7f69187e6480 -1 init, newargv = 0x5588cf46bff0 newargc=15 2024-09-15T23:55:52.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[44826]: starting ceph client 2024-09-15T23:55:52.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[44826]: starting fuse 2024-09-15T23:55:52.975 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:52.976 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:55:52.976 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:55:52.977 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:55:52.978 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:52.978 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:52.978 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:55:52.978 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:55:53.094 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:55:53.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:53.104 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:55:53.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.105 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok status 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-15T23:55:53.238 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "44826", 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:55:53.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:53.240 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 192.168.0.1:0/2317194972", 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/2317194972", 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 12, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 27, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:55:53.241 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:53.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.248 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:55:53.248 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:53.264 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:55:53.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:53.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:53.330 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:55:53.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f899f640 1 Processor -- start 2024-09-15T23:55:53.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f899f640 1 -- start start 2024-09-15T23:55:53.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f899f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb5f40a19c0 0x7fb5f413ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f899f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f409f510 con 0x7fb5f4139f40 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f899f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f40a20b0 con 0x7fb5f40a19c0 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5ebfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb5f40a19c0 0x7fb5f413ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb5f4139f40 0x7fb5f413a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:54108/0 (socket says 172.21.15.121:54108) 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.470+0000 7fb5f37fe640 1 -- 172.21.15.121:0/2903463800 learned_addr learned my addr 172.21.15.121:0/2903463800 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5ebfff640 1 -- 172.21.15.121:0/2903463800 >> v1:172.21.15.121:6789/0 conn(0x7fb5f4139f40 legacy=0x7fb5f413a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5ebfff640 1 -- 172.21.15.121:0/2903463800 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f40a0f60 con 0x7fb5f40a19c0 2024-09-15T23:55:53.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5f2ffd640 1 -- 172.21.15.121:0/2903463800 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542598956 0 0) 0x7fb5f409f510 con 0x7fb5f4139f40 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5ebfff640 1 --2- 172.21.15.121:0/2903463800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f413ed30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009720 tx=0x7fb5dc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03bee3a1c3e5352 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5f2ffd640 1 -- 172.21.15.121:0/2903463800 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc037070 con 0x7fb5f40a19c0 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5f2ffd640 1 -- 172.21.15.121:0/2903463800 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5dc02ad90 con 0x7fb5f40a19c0 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.471+0000 7fb5f2ffd640 1 -- 172.21.15.121:0/2903463800 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5dc032590 con 0x7fb5f40a19c0 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 -- 172.21.15.121:0/2903463800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 msgr2=0x7fb5f413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 --2- 172.21.15.121:0/2903463800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f413ed30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009720 tx=0x7fb5dc02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 -- 172.21.15.121:0/2903463800 shutdown_connections 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 --2- 172.21.15.121:0/2903463800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f413ed30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 -- 172.21.15.121:0/2903463800 >> 172.21.15.121:0/2903463800 conn(0x7fb5f406d430 msgr2=0x7fb5f406d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 -- 172.21.15.121:0/2903463800 shutdown_connections 2024-09-15T23:55:53.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.472+0000 7fb5f899f640 1 -- 172.21.15.121:0/2903463800 wait complete. 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.473+0000 7fb5f899f640 1 Processor -- start 2024-09-15T23:55:53.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.473+0000 7fb5f899f640 1 -- start start 2024-09-15T23:55:53.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.473+0000 7fb5f899f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.473+0000 7fb5f899f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f40a0000 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46742/0 (socket says 172.21.15.121:46742) 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f37fe640 1 -- 172.21.15.121:0/1651322522 learned_addr learned my addr 172.21.15.121:0/1651322522 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f37fe640 1 -- 172.21.15.121:0/1651322522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f40aa330 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f37fe640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c420 tx=0x7fb5e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4018070 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e40074d0 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f4122c80 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4004950 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.474+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f40aac10 con 0x7fb5f40a19c0 2024-09-15T23:55:53.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.475+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb5e401b070 con 0x7fb5f40a19c0 2024-09-15T23:55:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.475+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f40a0620 con 0x7fb5f40a19c0 2024-09-15T23:55:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.475+0000 7fb5f0ff9640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 0x7fb5d403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.475+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fb5e404a650 con 0x7fb5f40a19c0 2024-09-15T23:55:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.475+0000 7fb5ebfff640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 0x7fb5d403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.476+0000 7fb5ebfff640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 0x7fb5d403a760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009720 tx=0x7fb5dc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:53.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.480+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e4011980 con 0x7fb5f40a19c0 2024-09-15T23:55:53.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.678+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb5f40ab4f0 con 0x7fb5f40a19c0 2024-09-15T23:55:53.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.678+0000 7fb5f0ff9640 1 -- 172.21.15.121:0/1651322522 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+73 (secure 0 0 0) 0x7fb5e4011be0 con 0x7fb5f40a19c0 2024-09-15T23:55:53.679 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:55:53.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 msgr2=0x7fb5d403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 0x7fb5d403a760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009720 tx=0x7fb5dc02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:53.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 msgr2=0x7fb5f4123e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:53.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c420 tx=0x7fb5e400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 shutdown_connections 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fb5d40382a0 0x7fb5d403a760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 --2- 172.21.15.121:0/1651322522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f40a19c0 0x7fb5f4123e00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 >> 172.21.15.121:0/1651322522 conn(0x7fb5f406d430 msgr2=0x7fb5f409c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 shutdown_connections 2024-09-15T23:55:53.682 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53.680+0000 7fb5f899f640 1 -- 172.21.15.121:0/1651322522 wait complete. 2024-09-15T23:55:53.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:55:53.691 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:55:53.691 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:55:53.691 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:55:53.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:53.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:55:53.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:55:53.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:55:53.692 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:55:53.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.692 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.708 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42779sec preferred_lft 42779sec 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.709 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:55:53.710 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.711 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:55:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:55:53.711 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:55:53.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.711 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:55:53.772 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:55:53.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.774 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:55:53.831 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:55:53.831 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:55:53.831 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:55:53.831 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:55:53.831 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:55:53.832 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:55:53.919 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:55:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:53.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.957 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:55:53.972 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:55:53.972 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:55:53.973 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:55:53.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:53.973 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:55:54.038 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:55:54.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:54.038 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:54.093 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:55:54.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:55:54.094 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:54.149 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:54.214 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:54.271 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:54.272 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:54.273 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:54.274 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:54.274 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:54.274 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:54.274 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:54.274 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:54.275 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:54.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:54.276 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:54.327 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:54.327 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:55:54.327 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:55:54.370 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:55:54.394 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:55:54.451 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:55:54.452 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:55:54.453 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:54.454 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:55:54.455 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:55:54.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:54.455 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:55:54.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:55:54.450+0000 7f9fa19f9480 -1 init, newargv = 0x55db629d6d80 newargc=15 2024-09-15T23:55:54.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[45243]: starting ceph client 2024-09-15T23:55:54.456 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[45243]: starting fuse 2024-09-15T23:55:54.471 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:55:54.471 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:55:54.471 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:55:54.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:54.471 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:55:54.471 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:55:54.471 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:55:54.471 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:54.472 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:55:54.588 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.45243.asok 2024-09-15T23:55:54.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:54.598 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45243.asok 2024-09-15T23:55:54.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:54.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45243.asok status 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:55:54.732 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "45243", 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4427, 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4427 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:54.733 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2316251358 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2316251358 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4427 192.168.0.2:0/2316251358", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/2316251358", 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:55:54.734 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 12, 2024-09-15T23:55:54.735 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 27, 2024-09-15T23:55:54.735 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:55:54.735 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:55:54.735 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:55:54.735 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:55:54.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:54.740 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:55:54.740 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:54.756 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:55:54.756 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:54.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:54.757 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:55:54.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-15T23:55:54.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.960+0000 7fd31e4fa640 1 Processor -- start 2024-09-15T23:55:54.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.960+0000 7fd31e4fa640 1 -- start start 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd31e4fa640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd3180a4ab0 0x7fd31813eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd31e4fa640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180a6d10 con 0x7fd3180a7140 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd31e4fa640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd31806e230 con 0x7fd3180a4ab0 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd317fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd3180a7140 0x7fd3180a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:54116/0 (socket says 172.21.15.121:54116) 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd317fff640 1 -- 172.21.15.121:0/3329986901 learned_addr learned my addr 172.21.15.121:0/3329986901 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd3177fe640 1 --2- 172.21.15.121:0/3329986901 >> v2:172.21.15.121:3300/0 conn(0x7fd3180a4ab0 0x7fd31813eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd316ffd640 1 -- 172.21.15.121:0/3329986901 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321818416 0 0) 0x7fd3180a6d10 con 0x7fd3180a7140 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd316ffd640 1 -- 172.21.15.121:0/3329986901 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd300003520 con 0x7fd3180a7140 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd3177fe640 1 -- 172.21.15.121:0/3329986901 >> v1:172.21.15.121:6789/0 conn(0x7fd3180a7140 legacy=0x7fd3180a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.961+0000 7fd3177fe640 1 -- 172.21.15.121:0/3329986901 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180a3ae0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd3177fe640 1 --2- 172.21.15.121:0/3329986901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd31813eef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009720 tx=0x7fd30c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773dee67a8e7e49f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd316ffd640 1 -- 172.21.15.121:0/3329986901 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c037070 con 0x7fd3180a4ab0 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd316ffd640 1 -- 172.21.15.121:0/3329986901 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c02ad90 con 0x7fd3180a4ab0 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd316ffd640 1 -- 172.21.15.121:0/3329986901 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30c032590 con 0x7fd3180a4ab0 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd31e4fa640 1 -- 172.21.15.121:0/3329986901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 msgr2=0x7fd31813eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.962+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/3329986901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd31813eef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009720 tx=0x7fd30c02a110 comp rx=0 tx=0).stop 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 -- 172.21.15.121:0/3329986901 shutdown_connections 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/3329986901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd31813eef0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 -- 172.21.15.121:0/3329986901 >> 172.21.15.121:0/3329986901 conn(0x7fd3180ac370 msgr2=0x7fd3180ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 -- 172.21.15.121:0/3329986901 shutdown_connections 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 -- 172.21.15.121:0/3329986901 wait complete. 2024-09-15T23:55:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.963+0000 7fd31e4fa640 1 Processor -- start 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd31e4fa640 1 -- start start 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd31e4fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd31e4fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180a7fc0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd317fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd317fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46756/0 (socket says 172.21.15.121:46756) 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd317fff640 1 -- 172.21.15.121:0/1935452670 learned_addr learned my addr 172.21.15.121:0/1935452670 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.964+0000 7fd317fff640 1 -- 172.21.15.121:0/1935452670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31809e6a0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd317fff640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c480 tx=0x7fd30800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308017070 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308005c10 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31809fef0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308007070 con 0x7fd3180a4ab0 2024-09-15T23:55:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.965+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180a1bd0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd30801a070 con 0x7fd3180a4ab0 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31809e3c0 con 0x7fd3180a4ab0 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd314ff9640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 0x7fd30403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3439+0+0 (secure 0 0 0) 0x7fd30804a520 con 0x7fd3180a4ab0 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd3177fe640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 0x7fd30403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:55:54.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.966+0000 7fd3177fe640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 0x7fd30403a760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034000 tx=0x7fd30c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:55:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:54.970+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd30801b9c0 con 0x7fd3180a4ab0 2024-09-15T23:55:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.181+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7fd3180732e0 con 0x7fd3180a4ab0 2024-09-15T23:55:55.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.238+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v6) ==== 84+0+0 (secure 0 0 0) 0x7fd308011720 con 0x7fd3180a4ab0 2024-09-15T23:55:55.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.240+0000 7fd314ff9640 1 -- 172.21.15.121:0/1935452670 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 6) ==== 45746+0+0 (secure 0 0 0) 0x7fd30801bc80 con 0x7fd3180a4ab0 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 msgr2=0x7fd30403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 0x7fd30403a760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd30c034000 tx=0x7fd30c02e000 comp rx=0 tx=0).stop 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 msgr2=0x7fd3180a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c480 tx=0x7fd30800c940 comp rx=0 tx=0).stop 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 shutdown_connections 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:6824/1047503300,v1:172.21.15.121:6825/1047503300] conn(0x7fd3040382a0 0x7fd30403a760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 --2- 172.21.15.121:0/1935452670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd3180a4ab0 0x7fd3180a0c50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 >> 172.21.15.121:0/1935452670 conn(0x7fd3180ac370 msgr2=0x7fd318137060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:55:55.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 shutdown_connections 2024-09-15T23:55:55.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:55.241+0000 7fd31e4fa640 1 -- 172.21.15.121:0/1935452670 wait complete. 2024-09-15T23:55:55.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:55.254 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-15T23:55:55.361 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.360+0000 7fde0272a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:55:55.402 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.401+0000 7fde0272a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:55:55.531 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.530+0000 7fde0272a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:55:55.579 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.578+0000 7fde0272a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:55:55.686 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.685+0000 7fde0272a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:55:55.777 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:55.776+0000 7fde0272a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:55:56.040 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:56.040+0000 7fde0272a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:55:56.084 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:56.083+0000 7fde0272a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:55:56.199 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:56.198+0000 7fde0272a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:55:56.900 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:56.899+0000 7fde0272a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:55:56.943 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:56.942+0000 7fde0272a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:55:57.252 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.251+0000 7fde0272a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:55:57.334 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.333+0000 7fde0272a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:55:57.440 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.440+0000 7fde0272a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:55:57.483 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.482+0000 7fde0272a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:55:57.592 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.591+0000 7fde0272a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:55:57.643 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.642+0000 7fde0272a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:55:57.684 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.684+0000 7fde0272a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:55:57.797 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.796+0000 7fde0272a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:55:57.845 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.844+0000 7fde0272a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:55:57.897 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.896+0000 7fde0272a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:55:57.962 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:57.962+0000 7fde0272a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:55:58.005 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.004+0000 7fde0272a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:55:58.046 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.045+0000 7fde0272a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:55:58.622 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.622+0000 7fde0272a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.665+0000 7fdd81cb0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd81cb0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd81cb0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd81cb0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd81cb0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd84cf6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd84cf6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd84cf6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd84cf6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:58.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:55:58.666+0000 7fdd84cf6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:55:59.636 INFO:teuthology.orchestra.run.smithi121.stdout:{"date": "Sun Sep 15 23:55:59 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:55:59.645 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:55:59.646 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:55:59.647 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:55:59.730 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:55:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:55:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:55:59.741 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:55:59.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:55:59.741 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok mds_sessions 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:59.874 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 v1:192.168.0.1:0/2317194972", 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.1:0/2317194972", 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:59.876 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:55:59.877 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:53.959222+0000", 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:53.959222+0000", 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:55:59.878 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:00.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:00.884 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-15T23:56:00.969 INFO:teuthology.orchestra.run.smithi121.stdout:{"date": "Sun Sep 15 23:56:00 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-15T23:56:00.976 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:00.976 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:00.977 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:00.978 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:01.055 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:01.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:01.066 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:01.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:01.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok mds_sessions 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:01.198 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:01.199 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:01.200 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:53.959222+0000", 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:53.959222+0000", 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:56:01.201 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:02.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:02.208 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-15T23:56:02.300 INFO:teuthology.orchestra.run.smithi121.stdout:{"date": "Sun Sep 15 23:56:02 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:02.308 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:02.309 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:02.310 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:02.310 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:02.310 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:02.310 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:02.310 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:02.389 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:02.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:02.399 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:02.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:02.399 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok mds_sessions 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:02.531 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:56:02.532 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:53.959222+0000", 2024-09-15T23:56:02.533 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:53.959222+0000", 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:56:02.534 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:03.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:03.540 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-15T23:56:03.631 INFO:teuthology.orchestra.run.smithi121.stdout:{"date": "Sun Sep 15 23:56:03 2024", "client_count": {"total_clients": 0, "fuse": 0, "kclient": 0, "libcephfs": 0}, "filesystems": {"cephfs": {}}} 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:03.638 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:03.639 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:03.640 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:03.718 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:03.722 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:03.729 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:03.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:03.729 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok mds_sessions 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:03.864 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:03.865 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:03.866 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:53.959222+0000", 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:53.959222+0000", 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:56:03.867 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:04.585 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:04.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:04.872 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dump) 2024-09-15T23:56:04.957 INFO:teuthology.orchestra.run.smithi121.stdout:{"date": "Sun Sep 15 23:56:04 2024", "client_count": {"total_clients": 4, "fuse": 2, "kclient": 0, "libcephfs": 2}, "filesystems": {"cephfs": {"4421": {"mount_root": "/", "chit": 78.57, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.45, "mlatsd": 0.07, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.0@smithi121/192.168.0.1"}, "4427": {"mount_root": "/", "chit": 66.67, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.44, "mlatsd": 0.0, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.1@smithi121/192.168.0.2"}, "4445": {"mount_root": "/", "chit": 100.0, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.56, "mlatsd": 0.0, "mount_point@host/addr": "N/A@smithi121/172.21.15.121"}, "4446": {"mount_root": "/", "chit": 100.0, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.53, "mlatsd": 0.0, "mount_point@host/addr": "N/A@smithi121/172.21.15.121"}}}} 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:04.965 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:04.967 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:04.967 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:05.044 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:05.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:05.054 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44826.asok 2024-09-15T23:56:05.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:05.054 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44826.asok mds_sessions 2024-09-15T23:56:05.187 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:05.187 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4421, 2024-09-15T23:56:05.187 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:05.187 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:05.187 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4421 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2317194972 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4421 v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.1:0/2317194972", 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.188 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:05.189 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:53.959222+0000", 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:53.959222+0000", 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:56:05.190 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:05.195 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:05.196 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:05.197 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:05.198 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:05.198 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:05.198 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:05.198 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:05.275 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.45243.asok 2024-09-15T23:56:05.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:05.286 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45243.asok 2024-09-15T23:56:05.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:05.287 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45243.asok mds_sessions 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4427, 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4427 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:05.419 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2316251358 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4427 v1:192.168.0.2:0/2316251358", 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/2316251358", 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:05.420 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6827", 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6829", 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3125597125 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:56:55.452959+0000", 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:55:55.452959+0000", 2024-09-15T23:56:05.421 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 12 2024-09-15T23:56:05.422 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:05.427 DEBUG:tasks.cephfs.test_fstop:metrics={'date': 'Sun Sep 15 23:56:04 2024', 'client_count': {'total_clients': 4, 'fuse': 2, 'kclient': 0, 'libcephfs': 2}, 'filesystems': {'cephfs': {'4421': {'mount_root': '/', 'chit': 78.57, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.45, 'mlatsd': 0.07, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.0@smithi121/192.168.0.1'}, '4427': {'mount_root': '/', 'chit': 66.67, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.44, 'mlatsd': 0.0, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.1@smithi121/192.168.0.2'}, '4445': {'mount_root': '/', 'chit': 100.0, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.56, 'mlatsd': 0.0, 'mount_point@host/addr': 'N/A@smithi121/172.21.15.121'}, '4446': {'mount_root': '/', 'chit': 100.0, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.53, 'mlatsd': 0.0, 'mount_point@host/addr': 'N/A@smithi121/172.21.15.121'}}}} 2024-09-15T23:56:05.428 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.526+0000 7f22b9fef640 1 Processor -- start 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.526+0000 7f22b9fef640 1 -- start start 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b9fef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22b40a04b0 0x7f22b413b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b9fef640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b409abc0 con 0x7f22b4133020 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b9fef640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f22b40a2310 con 0x7f22b40a04b0 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b2ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f22b40a04b0 0x7f22b413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f22b4133020 0x7f22b4133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50166/0 (socket says 172.21.15.121:50166) 2024-09-15T23:56:05.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b37fe640 1 -- 172.21.15.121:0/1938132854 learned_addr learned my addr 172.21.15.121:0/1938132854 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b2ffd640 1 -- 172.21.15.121:0/1938132854 >> v1:172.21.15.121:6789/0 conn(0x7f22b4133020 legacy=0x7f22b4133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.527+0000 7f22b2ffd640 1 -- 172.21.15.121:0/1938132854 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b4132bf0 con 0x7f22b40a04b0 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.528+0000 7f22b2ffd640 1 --2- 172.21.15.121:0/1938132854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b413b330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009720 tx=0x7f22a802b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93abeacda8db6aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.528+0000 7f22b27fc640 1 -- 172.21.15.121:0/1938132854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8038070 con 0x7f22b40a04b0 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.528+0000 7f22b27fc640 1 -- 172.21.15.121:0/1938132854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a8033440 con 0x7f22b40a04b0 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.528+0000 7f22b27fc640 1 -- 172.21.15.121:0/1938132854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a8033740 con 0x7f22b40a04b0 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 -- 172.21.15.121:0/1938132854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 msgr2=0x7f22b413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 --2- 172.21.15.121:0/1938132854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b413b330 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009720 tx=0x7f22a802b220 comp rx=0 tx=0).stop 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 -- 172.21.15.121:0/1938132854 shutdown_connections 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 --2- 172.21.15.121:0/1938132854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b413b330 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:05.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 -- 172.21.15.121:0/1938132854 >> 172.21.15.121:0/1938132854 conn(0x7f22b40a8430 msgr2=0x7f22b40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:05.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 -- 172.21.15.121:0/1938132854 shutdown_connections 2024-09-15T23:56:05.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 -- 172.21.15.121:0/1938132854 wait complete. 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.529+0000 7f22b9fef640 1 Processor -- start 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b9fef640 1 -- start start 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b9fef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b9fef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22b40a1410 con 0x7f22b40a04b0 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50942/0 (socket says 172.21.15.121:50942) 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b37fe640 1 -- 172.21.15.121:0/2224085975 learned_addr learned my addr 172.21.15.121:0/2224085975 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.530+0000 7f22b37fe640 1 -- 172.21.15.121:0/2224085975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b406eaf0 con 0x7f22b40a04b0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f22b37fe640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f22a400cb20 tx=0x7f22a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a4017070 con 0x7f22b40a04b0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a400abf0 con 0x7f22b40a04b0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22a4012400 con 0x7f22b40a04b0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b40735c0 con 0x7f22b40a04b0 2024-09-15T23:56:05.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.531+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b4073270 con 0x7f22b40a04b0 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.532+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 10) ==== 45848+0+0 (secure 0 0 0) 0x7f22a401a070 con 0x7f22b40a04b0 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.532+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b40a3a20 con 0x7f22b40a04b0 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.532+0000 7f229bfff640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 0x7f22a003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.532+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f22a404b1f0 con 0x7f22b40a04b0 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.532+0000 7f22b2ffd640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 0x7f22a003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:05.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.533+0000 7f22b2ffd640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 0x7f22a003a8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22a8035000 tx=0x7f22a802f000 comp rx=0 tx=0).ready entity=mgr.4433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:05.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.537+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22a40113a0 con 0x7f22b40a04b0 2024-09-15T23:56:05.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:05.747+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7f22b40a1920 con 0x7f22b40a04b0 2024-09-15T23:56:06.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.646+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v11) ==== 85+0+0 (secure 0 0 0) 0x7f22a401aa90 con 0x7f22b40a04b0 2024-09-15T23:56:06.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f229bfff640 1 -- 172.21.15.121:0/2224085975 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f22a401ac70 con 0x7f22b40a04b0 2024-09-15T23:56:06.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 msgr2=0x7f22a003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 0x7f22a003a8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22a8035000 tx=0x7f22a802f000 comp rx=0 tx=0).stop 2024-09-15T23:56:06.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 msgr2=0x7f22b412f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f22a400cb20 tx=0x7f22a400a060 comp rx=0 tx=0).stop 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 shutdown_connections 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f22a0038410 0x7f22a003a8d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 --2- 172.21.15.121:0/2224085975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22b40a04b0 0x7f22b412f850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 >> 172.21.15.121:0/2224085975 conn(0x7f22b40a8430 msgr2=0x7f22b40a5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 shutdown_connections 2024-09-15T23:56:06.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.650+0000 7f22b9fef640 1 -- 172.21.15.121:0/2224085975 wait complete. 2024-09-15T23:56:06.663 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:06.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:06.707 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:06.707 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:06.707 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:06.707 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:06.764 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:06.772 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:06.771+0000 7f7f02728040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:56:06.817 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:06.816+0000 7f7f02728040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:06.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.872+0000 7f7a34703640 1 Processor -- start 2024-09-15T23:56:06.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a34703640 1 -- start start 2024-09-15T23:56:06.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a34703640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7a2c0a4c20 0x7f7a2c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a34703640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2c13a080 con 0x7f7a2c13a280 2024-09-15T23:56:06.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a34703640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2c0a3d50 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a31c9e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7a2c0a4c20 0x7f7a2c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a3249f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7a2c13a280 0x7f7a2c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50182/0 (socket says 172.21.15.121:50182) 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.873+0000 7f7a3249f640 1 -- 172.21.15.121:0/611065914 learned_addr learned my addr 172.21.15.121:0/611065914 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.874+0000 7f7a31c9e640 1 -- 172.21.15.121:0/611065914 >> v1:172.21.15.121:6789/0 conn(0x7f7a2c13a280 legacy=0x7f7a2c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.874+0000 7f7a31c9e640 1 -- 172.21.15.121:0/611065914 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c0a3f80 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.874+0000 7f7a31c9e640 1 --2- 172.21.15.121:0/611065914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c13f060 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009720 tx=0x7f7a1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3025b7933a7bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.874+0000 7f7a3149d640 1 -- 172.21.15.121:0/611065914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a1c037070 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a3149d640 1 -- 172.21.15.121:0/611065914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1c02ad90 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a3149d640 1 -- 172.21.15.121:0/611065914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a1c032590 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 -- 172.21.15.121:0/611065914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 msgr2=0x7f7a2c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 --2- 172.21.15.121:0/611065914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c13f060 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c009720 tx=0x7f7a1c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 -- 172.21.15.121:0/611065914 shutdown_connections 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 --2- 172.21.15.121:0/611065914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c13f060 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 -- 172.21.15.121:0/611065914 >> 172.21.15.121:0/611065914 conn(0x7f7a2c0ac3e0 msgr2=0x7f7a2c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 -- 172.21.15.121:0/611065914 shutdown_connections 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.875+0000 7f7a34703640 1 -- 172.21.15.121:0/611065914 wait complete. 2024-09-15T23:56:06.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.876+0000 7f7a34703640 1 Processor -- start 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.876+0000 7f7a34703640 1 -- start start 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a34703640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a34703640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c0a7ec0 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a3249f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a3249f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50980/0 (socket says 172.21.15.121:50980) 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a3249f640 1 -- 172.21.15.121:0/540946739 learned_addr learned my addr 172.21.15.121:0/540946739 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a3249f640 1 -- 172.21.15.121:0/540946739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c125070 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a3249f640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c4a0 tx=0x7f7a2800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28017070 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a28005c10 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2c124780 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a28007070 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.877+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2c124470 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f7a2801a070 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c122c20 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a22ffd640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 0x7f7a1003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f7a2804a740 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a31c9e640 1 -- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 msgr2=0x7f7a1003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:06.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.878+0000 7f7a31c9e640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 0x7f7a1003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:06.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:06.883+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a2801b3b0 con 0x7f7a2c0a4c20 2024-09-15T23:56:06.954 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:06.953+0000 7f7f02728040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:56:07.004 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.003+0000 7f7f02728040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:56:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.068+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7a2c124950 con 0x7f7a2c0a4c20 2024-09-15T23:56:07.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.068+0000 7f7a22ffd640 1 -- 172.21.15.121:0/540946739 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v28) ==== 80+0+358 (secure 0 0 0) 0x7f7a28010c00 con 0x7f7a2c0a4c20 2024-09-15T23:56:07.069 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6825/1047503300 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.069 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6824/1047503300 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.070 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1333687230 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.070 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/822936298 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.070 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2264301746 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.070 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/370154040 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.070 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:07.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 msgr2=0x7f7a1003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 0x7f7a1003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 msgr2=0x7f7a2c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800c4a0 tx=0x7f7a2800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 shutdown_connections 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f7a100383c0 0x7f7a1003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 --2- 172.21.15.121:0/540946739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a2c0a4c20 0x7f7a2c0a0ff0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 >> 172.21.15.121:0/540946739 conn(0x7f7a2c0ac3e0 msgr2=0x7f7a2c0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 shutdown_connections 2024-09-15T23:56:07.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.070+0000 7f7a34703640 1 -- 172.21.15.121:0/540946739 wait complete. 2024-09-15T23:56:07.082 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:07.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:07.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:07.106 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[44826]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:07.108 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:07.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:07.109 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:56:07.122 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.121+0000 7f7f02728040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:07.164 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:07.164 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:07.164 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:07.220 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.219+0000 7f7f02728040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:56:07.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:07.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.364+0000 7f05f4fb7640 1 Processor -- start 2024-09-15T23:56:07.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.364+0000 7f05f4fb7640 1 -- start start 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.364+0000 7f05f4fb7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f05f0135f30 0x7f05f013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.364+0000 7f05f4fb7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f00a08c0 con 0x7f05f0135b50 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.364+0000 7f05f4fb7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f05f009b310 con 0x7f05f0135f30 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f05f0135f30 0x7f05f013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f05f0135f30 0x7f05f013bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:50994/0 (socket says 172.21.15.121:50994) 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 -- 172.21.15.121:0/4176653393 learned_addr learned my addr 172.21.15.121:0/4176653393 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 -- 172.21.15.121:0/4176653393 >> v1:172.21.15.121:6789/0 conn(0x7f05f0135b50 legacy=0x7f05f009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 -- 172.21.15.121:0/4176653393 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f00a2270 con 0x7f05f0135f30 2024-09-15T23:56:07.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.365+0000 7f05e7fff640 1 --2- 172.21.15.121:0/4176653393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135f30 0x7f05f013bb80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05d800ba90 tx=0x7f05d802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5812f4ad2b572c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05edd9b640 1 -- 172.21.15.121:0/4176653393 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8036020 con 0x7f05f0135f30 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05edd9b640 1 -- 172.21.15.121:0/4176653393 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8032770 con 0x7f05f0135f30 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05edd9b640 1 -- 172.21.15.121:0/4176653393 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8032a70 con 0x7f05f0135f30 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 -- 172.21.15.121:0/4176653393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135f30 msgr2=0x7f05f013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/4176653393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135f30 0x7f05f013bb80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05d800ba90 tx=0x7f05d802c940 comp rx=0 tx=0).stop 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 -- 172.21.15.121:0/4176653393 shutdown_connections 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/4176653393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135f30 0x7f05f013bb80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 -- 172.21.15.121:0/4176653393 >> 172.21.15.121:0/4176653393 conn(0x7f05f00a85e0 msgr2=0x7f05f00a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 -- 172.21.15.121:0/4176653393 shutdown_connections 2024-09-15T23:56:07.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.366+0000 7f05f4fb7640 1 -- 172.21.15.121:0/4176653393 wait complete. 2024-09-15T23:56:07.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.367+0000 7f05f4fb7640 1 Processor -- start 2024-09-15T23:56:07.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.367+0000 7f05f4fb7640 1 -- start start 2024-09-15T23:56:07.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05f4fb7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05f4fb7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f05f0136350 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51004/0 (socket says 172.21.15.121:51004) 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05ee59c640 1 -- 172.21.15.121:0/3109401211 learned_addr learned my addr 172.21.15.121:0/3109401211 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.368+0000 7f05ee59c640 1 -- 172.21.15.121:0/3109401211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f0126500 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05ee59c640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c450 tx=0x7f05e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e0017070 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0005220 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f0125970 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05e00035f0 con 0x7f05f0135b50 2024-09-15T23:56:07.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.369+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f00a74b0 con 0x7f05f0135b50 2024-09-15T23:56:07.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f05e001a070 con 0x7f05f0135b50 2024-09-15T23:56:07.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f0123e30 con 0x7f05f0135b50 2024-09-15T23:56:07.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05e6ffd640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 0x7f05d003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f05e004a830 con 0x7f05f0135b50 2024-09-15T23:56:07.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05e7fff640 1 -- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 msgr2=0x7f05d003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:07.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.370+0000 7f05e7fff640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 0x7f05d003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:07.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.375+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05e0019e10 con 0x7f05f0135b50 2024-09-15T23:56:07.499 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.499+0000 7f7f02728040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:56:07.545 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.544+0000 7f7f02728040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:56:07.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.560+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05f009aae0 con 0x7f05f0135b50 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.561+0000 7f05e6ffd640 1 -- 172.21.15.121:0/3109401211 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v28) ==== 80+0+358 (secure 0 0 0) 0x7f05e001a760 con 0x7f05f0135b50 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6825/1047503300 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6824/1047503300 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1333687230 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/822936298 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/2264301746 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.562 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/370154040 2024-09-16T23:55:58.623965+0000 2024-09-15T23:56:07.563 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 msgr2=0x7f05d003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 0x7f05d003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 msgr2=0x7f05f0122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c450 tx=0x7f05e000c910 comp rx=0 tx=0).stop 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 shutdown_connections 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f05d00383c0 0x7f05d003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 --2- 172.21.15.121:0/3109401211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05f0135b50 0x7f05f0122a10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 >> 172.21.15.121:0/3109401211 conn(0x7f05f00a85e0 msgr2=0x7f05f009de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 shutdown_connections 2024-09-15T23:56:07.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.563+0000 7f05f4fb7640 1 -- 172.21.15.121:0/3109401211 wait complete. 2024-09-15T23:56:07.575 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:07.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:07.575 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:07.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[45243]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:07.600 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:07.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:07.600 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:56:07.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:07.670 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:07.669+0000 7f7f02728040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:56:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.768+0000 7fd894368640 1 Processor -- start 2024-09-15T23:56:07.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.768+0000 7fd894368640 1 -- start start 2024-09-15T23:56:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd894368640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd88c09f840 0x7fd88c13cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd894368640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88c09e0b0 con 0x7fd88c12e100 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd894368640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd88c09edf0 con 0x7fd88c09f840 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd891903640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd88c09f840 0x7fd88c13cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd891903640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd88c09f840 0x7fd88c13cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51006/0 (socket says 172.21.15.121:51006) 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd891903640 1 -- 172.21.15.121:0/94158538 learned_addr learned my addr 172.21.15.121:0/94158538 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd891903640 1 -- 172.21.15.121:0/94158538 >> v1:172.21.15.121:6789/0 conn(0x7fd88c12e100 legacy=0x7fd88c12e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.769+0000 7fd891903640 1 -- 172.21.15.121:0/94158538 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c09ddf0 con 0x7fd88c09f840 2024-09-15T23:56:07.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.770+0000 7fd891903640 1 --2- 172.21.15.121:0/94158538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c13cbb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0097f0 tx=0x7fd87c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75d27350c002d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.770+0000 7fd891102640 1 -- 172.21.15.121:0/94158538 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c037070 con 0x7fd88c09f840 2024-09-15T23:56:07.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.770+0000 7fd891102640 1 -- 172.21.15.121:0/94158538 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c032440 con 0x7fd88c09f840 2024-09-15T23:56:07.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.770+0000 7fd891102640 1 -- 172.21.15.121:0/94158538 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c02ae60 con 0x7fd88c09f840 2024-09-15T23:56:07.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 -- 172.21.15.121:0/94158538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 msgr2=0x7fd88c13cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 --2- 172.21.15.121:0/94158538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c13cbb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0097f0 tx=0x7fd87c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 -- 172.21.15.121:0/94158538 shutdown_connections 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 --2- 172.21.15.121:0/94158538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c13cbb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 -- 172.21.15.121:0/94158538 >> 172.21.15.121:0/94158538 conn(0x7fd88c071aa0 msgr2=0x7fd88c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 -- 172.21.15.121:0/94158538 shutdown_connections 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.771+0000 7fd894368640 1 -- 172.21.15.121:0/94158538 wait complete. 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd894368640 1 Processor -- start 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd894368640 1 -- start start 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd894368640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd894368640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c09e500 con 0x7fd88c09f840 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd892104640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd892104640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51012/0 (socket says 172.21.15.121:51012) 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.772+0000 7fd892104640 1 -- 172.21.15.121:0/1475961138 learned_addr learned my addr 172.21.15.121:0/1475961138 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:07.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd892104640 1 -- 172.21.15.121:0/1475961138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c0aac70 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd892104640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c450 tx=0x7fd88800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd888017070 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888005220 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88c0a3570 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8880035f0 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.773+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88c135080 con 0x7fd88c09f840 2024-09-15T23:56:07.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7fd88801a070 con 0x7fd88c09f840 2024-09-15T23:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd88c0a3260 con 0x7fd88c09f840 2024-09-15T23:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd882ffd640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 0x7fd87003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7fd88804a720 con 0x7fd88c09f840 2024-09-15T23:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd891903640 1 -- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 msgr2=0x7fd87003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:07.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.774+0000 7fd891903640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 0x7fd87003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:07.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.783+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd88801ac60 con 0x7fd88c09f840 2024-09-15T23:56:07.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.975+0000 7fd891903640 1 -- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 msgr2=0x7fd87003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:07.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.975+0000 7fd891903640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 0x7fd87003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.990+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd88c09f010 con 0x7fd88c09f840 2024-09-15T23:56:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.991+0000 7fd882ffd640 1 -- 172.21.15.121:0/1475961138 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7fd88801a9a0 con 0x7fd88c09f840 2024-09-15T23:56:07.992 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:07.992 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:56:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:56:07.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 msgr2=0x7fd87003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:07.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 0x7fd87003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 msgr2=0x7fd88c133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:07.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd88800c450 tx=0x7fd88800c910 comp rx=0 tx=0).stop 2024-09-15T23:56:07.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 shutdown_connections 2024-09-15T23:56:07.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd8700383c0 0x7fd87003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 --2- 172.21.15.121:0/1475961138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd88c09f840 0x7fd88c133db0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:07.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 >> 172.21.15.121:0/1475961138 conn(0x7fd88c071aa0 msgr2=0x7fd88c1317e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:07.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 shutdown_connections 2024-09-15T23:56:07.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:07.993+0000 7fd894368640 1 -- 172.21.15.121:0/1475961138 wait complete. 2024-09-15T23:56:08.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:08.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a6a7b640 1 Processor -- start 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a6a7b640 1 -- start start 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a6a7b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89a013a280 0x7f89a013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a6a7b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a013a080 con 0x7f89a00a4c20 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a6a7b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f89a00a3d50 con 0x7f89a013a280 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.105+0000 7f89a4817640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89a013a280 0x7f89a013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.106+0000 7f89a4817640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f89a013a280 0x7f89a013a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51020/0 (socket says 172.21.15.121:51020) 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.106+0000 7f89a4817640 1 -- 172.21.15.121:0/2117208691 learned_addr learned my addr 172.21.15.121:0/2117208691 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.106+0000 7f89a4817640 1 -- 172.21.15.121:0/2117208691 >> v1:172.21.15.121:6789/0 conn(0x7f89a00a4c20 legacy=0x7f89a00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.106+0000 7f89a4817640 1 -- 172.21.15.121:0/2117208691 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a00a3f80 con 0x7f89a013a280 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.106+0000 7f89a4817640 1 --2- 172.21.15.121:0/2117208691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a013a280 0x7f89a013a660 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89940097f0 tx=0x7f899402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2d194a22fadf07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f899f7fe640 1 -- 172.21.15.121:0/2117208691 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994037070 con 0x7f89a013a280 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f899f7fe640 1 -- 172.21.15.121:0/2117208691 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8994032440 con 0x7f89a013a280 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f899f7fe640 1 -- 172.21.15.121:0/2117208691 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f899402ae60 con 0x7f89a013a280 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 -- 172.21.15.121:0/2117208691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a013a280 msgr2=0x7f89a013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/2117208691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a013a280 0x7f89a013a660 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89940097f0 tx=0x7f899402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 -- 172.21.15.121:0/2117208691 shutdown_connections 2024-09-15T23:56:08.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/2117208691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a013a280 0x7f89a013a660 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 -- 172.21.15.121:0/2117208691 >> 172.21.15.121:0/2117208691 conn(0x7f89a00ac3e0 msgr2=0x7f89a00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 -- 172.21.15.121:0/2117208691 shutdown_connections 2024-09-15T23:56:08.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.107+0000 7f89a6a7b640 1 -- 172.21.15.121:0/2117208691 wait complete. 2024-09-15T23:56:08.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.108+0000 7f89a6a7b640 1 Processor -- start 2024-09-15T23:56:08.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.108+0000 7f89a6a7b640 1 -- start start 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a6a7b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a6a7b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0139d40 con 0x7f89a00a4c20 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a4817640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a4817640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51022/0 (socket says 172.21.15.121:51022) 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a4817640 1 -- 172.21.15.121:0/1253158957 learned_addr learned my addr 172.21.15.121:0/1253158957 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a4817640 1 -- 172.21.15.121:0/1253158957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0124ff0 con 0x7f89a00a4c20 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a4817640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8994035040 tx=0x7f89940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994041020 con 0x7f89a00a4c20 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89940307f0 con 0x7f89a00a4c20 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994037040 con 0x7f89a00a4c20 2024-09-15T23:56:08.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.109+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a0125270 con 0x7f89a00a4c20 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.110+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a0138290 con 0x7f89a00a4c20 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.110+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f8994044020 con 0x7f89a00a4c20 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.110+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a006dab0 con 0x7f89a00a4c20 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.110+0000 7f899d7fa640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 0x7f898403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.111+0000 7f899ffff640 1 -- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 msgr2=0x7f898403a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.111+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f899406be90 con 0x7f89a00a4c20 2024-09-15T23:56:08.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.111+0000 7f899ffff640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 0x7f898403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:08.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.115+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f899404b030 con 0x7f89a00a4c20 2024-09-15T23:56:08.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.312+0000 7f899ffff640 1 -- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 msgr2=0x7f898403a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:08.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.312+0000 7f899ffff640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 0x7f898403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:08.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.323+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89a00a2f50 con 0x7f89a00a4c20 2024-09-15T23:56:08.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.323+0000 7f899d7fa640 1 -- 172.21.15.121:0/1253158957 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7f89a0124ff0 con 0x7f89a00a4c20 2024-09-15T23:56:08.324 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:08.324 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:56:08.325 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 msgr2=0x7f898403a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 0x7f898403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 msgr2=0x7f89a00a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8994035040 tx=0x7f89940046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 shutdown_connections 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f89840383c0 0x7f898403a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 --2- 172.21.15.121:0/1253158957 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f89a00a4c20 0x7f89a00a1150 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 >> 172.21.15.121:0/1253158957 conn(0x7f89a00ac3e0 msgr2=0x7f89a00aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 shutdown_connections 2024-09-15T23:56:08.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.325+0000 7f89a6a7b640 1 -- 172.21.15.121:0/1253158957 wait complete. 2024-09-15T23:56:08.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:08.413 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:08.411+0000 7f7f02728040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:56:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.437+0000 7f0f88d9f640 1 Processor -- start 2024-09-15T23:56:08.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.437+0000 7f0f88d9f640 1 -- start start 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f88d9f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f8413a280 0x7f0f8413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f88d9f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8413a080 con 0x7f0f840a4c20 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f88d9f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0f840a3d50 con 0x7f0f8413a280 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f8259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f8413a280 0x7f0f8413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f8259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0f8413a280 0x7f0f8413a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51024/0 (socket says 172.21.15.121:51024) 2024-09-15T23:56:08.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f8259c640 1 -- 172.21.15.121:0/3381297459 learned_addr learned my addr 172.21.15.121:0/3381297459 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f8259c640 1 -- 172.21.15.121:0/3381297459 >> v1:172.21.15.121:6789/0 conn(0x7f0f840a4c20 legacy=0x7f0f840a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.438+0000 7f0f8259c640 1 -- 172.21.15.121:0/3381297459 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840a3f80 con 0x7f0f8413a280 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f8259c640 1 --2- 172.21.15.121:0/3381297459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8413a280 0x7f0f8413a660 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097f0 tx=0x7f0f7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c44c7825e396ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f8159a640 1 -- 172.21.15.121:0/3381297459 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f74037070 con 0x7f0f8413a280 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f8159a640 1 -- 172.21.15.121:0/3381297459 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f74032440 con 0x7f0f8413a280 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f8159a640 1 -- 172.21.15.121:0/3381297459 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f7402ae60 con 0x7f0f8413a280 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3381297459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8413a280 msgr2=0x7f0f8413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.439+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3381297459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8413a280 0x7f0f8413a660 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f740097f0 tx=0x7f0f7402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.440+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3381297459 shutdown_connections 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.440+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3381297459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f8413a280 0x7f0f8413a660 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.440+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3381297459 >> 172.21.15.121:0/3381297459 conn(0x7f0f840ac3e0 msgr2=0x7f0f840ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.440+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3381297459 shutdown_connections 2024-09-15T23:56:08.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.440+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3381297459 wait complete. 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f88d9f640 1 Processor -- start 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f88d9f640 1 -- start start 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f88d9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f88d9f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f84139d40 con 0x7f0f840a4c20 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f8259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f8259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51026/0 (socket says 172.21.15.121:51026) 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f8259c640 1 -- 172.21.15.121:0/3984134077 learned_addr learned my addr 172.21.15.121:0/3984134077 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.441+0000 7f0f8259c640 1 -- 172.21.15.121:0/3984134077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f84124ff0 con 0x7f0f840a4c20 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f8259c640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0f74035040 tx=0x7f0f740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f74041020 con 0x7f0f840a4c20 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f740307f0 con 0x7f0f840a4c20 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f84125270 con 0x7f0f840a4c20 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f74037040 con 0x7f0f840a4c20 2024-09-15T23:56:08.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.442+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f84138290 con 0x7f0f840a4c20 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8406dab0 con 0x7f0f840a4c20 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f0f74044020 con 0x7f0f840a4c20 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f7affd640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 0x7f0f6403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f0f7406be90 con 0x7f0f840a4c20 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f81d9b640 1 -- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 msgr2=0x7f0f6403a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:08.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.443+0000 7f0f81d9b640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 0x7f0f6403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:08.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.448+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f7404b030 con 0x7f0f840a4c20 2024-09-15T23:56:08.460 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:08.458+0000 7f7f02728040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:56:08.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.623+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f840a2f50 con 0x7f0f840a4c20 2024-09-15T23:56:08.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.624+0000 7f0f7affd640 1 -- 172.21.15.121:0/3984134077 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+11056 (secure 0 0 0) 0x7f0f84124ff0 con 0x7f0f840a4c20 2024-09-15T23:56:08.625 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:08.625 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:58.624005+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:40.793323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:41.516392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6825/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6824/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/1333687230":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/822936298":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/2264301746":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/370154040":"2024-09-16T23:55:58.623965+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 msgr2=0x7f0f6403a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 0x7f0f6403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 msgr2=0x7f0f840a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0f74035040 tx=0x7f0f740046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 shutdown_connections 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0f640383c0 0x7f0f6403a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 --2- 172.21.15.121:0/3984134077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f840a4c20 0x7f0f840a1150 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 >> 172.21.15.121:0/3984134077 conn(0x7f0f840ac3e0 msgr2=0x7f0f840aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 shutdown_connections 2024-09-15T23:56:08.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.627+0000 7f0f88d9f640 1 -- 172.21.15.121:0/3984134077 wait complete. 2024-09-15T23:56:08.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:56:08.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:08.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.738+0000 7f0ee51cd640 1 Processor -- start 2024-09-15T23:56:08.739 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.738+0000 7f0ee51cd640 1 -- start start 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.738+0000 7f0ee51cd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ee013a280 0x7f0ee013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0ee51cd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee013a080 con 0x7f0ee00a4c20 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0ee51cd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee00a3d50 con 0x7f0ee013a280 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0eded9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ee013a280 0x7f0ee013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0eded9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0ee013a280 0x7f0ee013a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51030/0 (socket says 172.21.15.121:51030) 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0eded9d640 1 -- 172.21.15.121:0/1858276470 learned_addr learned my addr 172.21.15.121:0/1858276470 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0eded9d640 1 -- 172.21.15.121:0/1858276470 >> v1:172.21.15.121:6789/0 conn(0x7f0ee00a4c20 legacy=0x7f0ee00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.739+0000 7f0eded9d640 1 -- 172.21.15.121:0/1858276470 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00a3f80 con 0x7f0ee013a280 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.740+0000 7f0eded9d640 1 --2- 172.21.15.121:0/1858276470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee013a280 0x7f0ee013a660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40097f0 tx=0x7f0ed402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780f11926a91b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.740+0000 7f0eddd9b640 1 -- 172.21.15.121:0/1858276470 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4037070 con 0x7f0ee013a280 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.740+0000 7f0eddd9b640 1 -- 172.21.15.121:0/1858276470 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4032440 con 0x7f0ee013a280 2024-09-15T23:56:08.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.740+0000 7f0eddd9b640 1 -- 172.21.15.121:0/1858276470 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed402ae60 con 0x7f0ee013a280 2024-09-15T23:56:08.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 -- 172.21.15.121:0/1858276470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee013a280 msgr2=0x7f0ee013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/1858276470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee013a280 0x7f0ee013a660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40097f0 tx=0x7f0ed402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 -- 172.21.15.121:0/1858276470 shutdown_connections 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/1858276470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee013a280 0x7f0ee013a660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 -- 172.21.15.121:0/1858276470 >> 172.21.15.121:0/1858276470 conn(0x7f0ee00ac3e0 msgr2=0x7f0ee00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 -- 172.21.15.121:0/1858276470 shutdown_connections 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.741+0000 7f0ee51cd640 1 -- 172.21.15.121:0/1858276470 wait complete. 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.742+0000 7f0ee51cd640 1 Processor -- start 2024-09-15T23:56:08.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.742+0000 7f0ee51cd640 1 -- start start 2024-09-15T23:56:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.743+0000 7f0ee51cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.743+0000 7f0ee51cd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0139d40 con 0x7f0ee00a4c20 2024-09-15T23:56:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.743+0000 7f0eded9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:08.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.743+0000 7f0eded9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51044/0 (socket says 172.21.15.121:51044) 2024-09-15T23:56:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.743+0000 7f0eded9d640 1 -- 172.21.15.121:0/2586436354 learned_addr learned my addr 172.21.15.121:0/2586436354 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0eded9d640 1 -- 172.21.15.121:0/2586436354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee0125a30 con 0x7f0ee00a4c20 2024-09-15T23:56:08.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0eded9d640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0ed402a220 tx=0x7f0ed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:08.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4041020 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4030840 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee0123a80 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4037040 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.744+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee00a21c0 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f0ed4044020 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee006dab0 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ec77fe640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 0x7f0ecc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f0ed406bf30 con 0x7f0ee00a4c20 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ede59c640 1 -- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 msgr2=0x7f0ecc03a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:08.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.745+0000 7f0ede59c640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 0x7f0ecc03a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:08.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.750+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ed404b030 con 0x7f0ee00a4c20 2024-09-15T23:56:08.786 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:08.785+0000 7f7f02728040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:56:08.870 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:08.870+0000 7f7f02728040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.946+0000 7f0ede59c640 1 -- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 msgr2=0x7f0ecc03a8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:08.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.946+0000 7f0ede59c640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 0x7f0ecc03a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:08.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.952+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee00a2f50 con 0x7f0ee00a4c20 2024-09-15T23:56:08.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.953+0000 7f0ec77fe640 1 -- 172.21.15.121:0/2586436354 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7f0ed403d940 con 0x7f0ee00a4c20 2024-09-15T23:56:08.954 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:08.954 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:56:08.954 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 msgr2=0x7f0ecc03a8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 0x7f0ecc03a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 msgr2=0x7f0ee0125450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0ed402a220 tx=0x7f0ed40046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 shutdown_connections 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f0ecc0383f0 0x7f0ecc03a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 --2- 172.21.15.121:0/2586436354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ee00a4c20 0x7f0ee0125450 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 >> 172.21.15.121:0/2586436354 conn(0x7f0ee00ac3e0 msgr2=0x7f0ee00ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:08.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 shutdown_connections 2024-09-15T23:56:08.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:08.955+0000 7f0ee51cd640 1 -- 172.21.15.121:0/2586436354 wait complete. 2024-09-15T23:56:08.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:08.980 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:08.979+0000 7f7f02728040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:09.025 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.024+0000 7f7f02728040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:56:09.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.064+0000 7f16fcc5a640 1 Processor -- start 2024-09-15T23:56:09.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.064+0000 7f16fcc5a640 1 -- start start 2024-09-15T23:56:09.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16fcc5a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f16f813a220 0x7f16f813a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16fcc5a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f809f2f0 con 0x7f16f80a1c80 2024-09-15T23:56:09.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16fcc5a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f16f80a07d0 con 0x7f16f813a220 2024-09-15T23:56:09.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16f659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f16f813a220 0x7f16f813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16f659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f16f813a220 0x7f16f813a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51046/0 (socket says 172.21.15.121:51046) 2024-09-15T23:56:09.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16f659c640 1 -- 172.21.15.121:0/3246712222 learned_addr learned my addr 172.21.15.121:0/3246712222 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16f659c640 1 -- 172.21.15.121:0/3246712222 >> v1:172.21.15.121:6789/0 conn(0x7f16f80a1c80 legacy=0x7f16f8136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.065+0000 7f16f659c640 1 -- 172.21.15.121:0/3246712222 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f8139dd0 con 0x7f16f813a220 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.066+0000 7f16f659c640 1 --2- 172.21.15.121:0/3246712222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f813a220 0x7f16f813a600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097f0 tx=0x7f16e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74dcd092c6b9867 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.066+0000 7f16f559a640 1 -- 172.21.15.121:0/3246712222 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e8037070 con 0x7f16f813a220 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.066+0000 7f16f559a640 1 -- 172.21.15.121:0/3246712222 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e8032440 con 0x7f16f813a220 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.066+0000 7f16f559a640 1 -- 172.21.15.121:0/3246712222 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e802ae60 con 0x7f16f813a220 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 -- 172.21.15.121:0/3246712222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f813a220 msgr2=0x7f16f813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/3246712222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f813a220 0x7f16f813a600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f16e80097f0 tx=0x7f16e802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 -- 172.21.15.121:0/3246712222 shutdown_connections 2024-09-15T23:56:09.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/3246712222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f813a220 0x7f16f813a600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 -- 172.21.15.121:0/3246712222 >> 172.21.15.121:0/3246712222 conn(0x7f16f806d820 msgr2=0x7f16f806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 -- 172.21.15.121:0/3246712222 shutdown_connections 2024-09-15T23:56:09.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.067+0000 7f16fcc5a640 1 -- 172.21.15.121:0/3246712222 wait complete. 2024-09-15T23:56:09.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.069+0000 7f16fcc5a640 1 Processor -- start 2024-09-15T23:56:09.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.069+0000 7f16fcc5a640 1 -- start start 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.069+0000 7f16fcc5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.069+0000 7f16fcc5a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8139a20 con 0x7f16f80a1c80 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16f659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16f659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51052/0 (socket says 172.21.15.121:51052) 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16f659c640 1 -- 172.21.15.121:0/1194947859 learned_addr learned my addr 172.21.15.121:0/1194947859 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16f659c640 1 -- 172.21.15.121:0/1194947859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80aa0a0 con 0x7f16f80a1c80 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16f659c640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f16e80090b0 tx=0x7f16e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e8041070 con 0x7f16f80a1c80 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e803c7a0 con 0x7f16f80a1c80 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f80a96b0 con 0x7f16f80a1c80 2024-09-15T23:56:09.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16e8037040 con 0x7f16f80a1c80 2024-09-15T23:56:09.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.070+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f80a9950 con 0x7f16f80a1c80 2024-09-15T23:56:09.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.071+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f80a7d80 con 0x7f16f80a1c80 2024-09-15T23:56:09.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.071+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f16e8044070 con 0x7f16f80a1c80 2024-09-15T23:56:09.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.071+0000 7f16eeffd640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 0x7f16d803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.072+0000 7f16f5d9b640 1 -- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 msgr2=0x7f16d803a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:09.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.072+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f16e806c010 con 0x7f16f80a1c80 2024-09-15T23:56:09.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.072+0000 7f16f5d9b640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 0x7f16d803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:09.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.076+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16f80aa0a0 con 0x7f16f80a1c80 2024-09-15T23:56:09.158 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.157+0000 7f7f02728040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:56:09.211 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.210+0000 7f7f02728040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:56:09.254 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.253+0000 7f7f02728040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:56:09.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.273+0000 7f16f5d9b640 1 -- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 msgr2=0x7f16d803a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:09.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.273+0000 7f16f5d9b640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 0x7f16d803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:09.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.302+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16f80a0100 con 0x7f16f80a1c80 2024-09-15T23:56:09.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.303+0000 7f16eeffd640 1 -- 172.21.15.121:0/1194947859 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+3578 (secure 0 0 0) 0x7f16e803a520 con 0x7f16f80a1c80 2024-09-15T23:56:09.306 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":12,"btime":"2024-09-15T23:55:45:218030+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:55:42.553611+0000","modified":"2024-09-15T23:55:44.540268+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4330},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4330":{"gid":4330,"name":"b","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6829/3125597125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6827","nonce":3125597125},{"type":"v1","addr":"172.21.15.121:6829","nonce":3125597125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4330,"qdb_cluster":[4330]},"id":2}]} 2024-09-15T23:56:09.307 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 12 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 msgr2=0x7f16d803a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 0x7f16d803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 msgr2=0x7f16f80a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f16e80090b0 tx=0x7f16e80046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 shutdown_connections 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f16d8038370 0x7f16d803a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 --2- 172.21.15.121:0/1194947859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16f80a1c80 0x7f16f80a6000 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 >> 172.21.15.121:0/1194947859 conn(0x7f16f806d820 msgr2=0x7f16f81346d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 shutdown_connections 2024-09-15T23:56:09.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.305+0000 7f16fcc5a640 1 -- 172.21.15.121:0/1194947859 wait complete. 2024-09-15T23:56:09.318 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:09.368 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.368+0000 7f7f02728040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:56:09.420 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.418+0000 7f7f02728040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:56:09.462 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.460+0000 7fd624331640 1 Processor -- start 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.460+0000 7fd624331640 1 -- start start 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd624331640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd61c0a4c20 0x7fd61c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd624331640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61c13a080 con 0x7fd61c13a280 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd624331640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c0a3d50 con 0x7fd61c0a4c20 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd6218cc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd61c0a4c20 0x7fd61c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd6218cc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd61c0a4c20 0x7fd61c13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51054/0 (socket says 172.21.15.121:51054) 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.461+0000 7fd6218cc640 1 -- 172.21.15.121:0/3931596631 learned_addr learned my addr 172.21.15.121:0/3931596631 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6218cc640 1 -- 172.21.15.121:0/3931596631 >> v1:172.21.15.121:6789/0 conn(0x7fd61c13a280 legacy=0x7fd61c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6218cc640 1 -- 172.21.15.121:0/3931596631 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c0a3f80 con 0x7fd61c0a4c20 2024-09-15T23:56:09.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6218cc640 1 --2- 172.21.15.121:0/3931596631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c13f060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097f0 tx=0x7fd60c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a16d560d9cc061b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6210cb640 1 -- 172.21.15.121:0/3931596631 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c037070 con 0x7fd61c0a4c20 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6210cb640 1 -- 172.21.15.121:0/3931596631 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c032440 con 0x7fd61c0a4c20 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.462+0000 7fd6210cb640 1 -- 172.21.15.121:0/3931596631 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c02ae60 con 0x7fd61c0a4c20 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 -- 172.21.15.121:0/3931596631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 msgr2=0x7fd61c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 --2- 172.21.15.121:0/3931596631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c13f060 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0097f0 tx=0x7fd60c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 -- 172.21.15.121:0/3931596631 shutdown_connections 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 --2- 172.21.15.121:0/3931596631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c13f060 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 -- 172.21.15.121:0/3931596631 >> 172.21.15.121:0/3931596631 conn(0x7fd61c0ac3e0 msgr2=0x7fd61c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 -- 172.21.15.121:0/3931596631 shutdown_connections 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.463+0000 7fd624331640 1 -- 172.21.15.121:0/3931596631 wait complete. 2024-09-15T23:56:09.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.464+0000 7fd624331640 1 Processor -- start 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.464+0000 7fd624331640 1 -- start start 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.464+0000 7fd624331640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.464+0000 7fd624331640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c0a7ec0 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd6220cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd6220cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51060/0 (socket says 172.21.15.121:51060) 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd6220cd640 1 -- 172.21.15.121:0/2186088979 learned_addr learned my addr 172.21.15.121:0/2186088979 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd6220cd640 1 -- 172.21.15.121:0/2186088979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c124f10 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd6220cd640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c380 tx=0x7fd61800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd618005200 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6180053c0 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd618007190 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c1247c0 con 0x7fd61c0a4c20 2024-09-15T23:56:09.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.465+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c123540 con 0x7fd61c0a4c20 2024-09-15T23:56:09.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.466+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7fd618007400 con 0x7fd61c0a4c20 2024-09-15T23:56:09.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.466+0000 7fd612ffd640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 0x7fd60003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.466+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7fd61804a990 con 0x7fd61c0a4c20 2024-09-15T23:56:09.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.466+0000 7fd6218cc640 1 -- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 msgr2=0x7fd60003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:09.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.466+0000 7fd6218cc640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 0x7fd60003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:09.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.467+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c0a2f50 con 0x7fd61c0a4c20 2024-09-15T23:56:09.470 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.470+0000 7f7f02728040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:56:09.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.471+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd61c124f10 con 0x7fd61c0a4c20 2024-09-15T23:56:09.537 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.537+0000 7f7f02728040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:09.581 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.580+0000 7f7f02728040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:56:09.624 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:09.623+0000 7f7f02728040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:56:09.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.662+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd61c1249e0 con 0x7fd61c0a4c20 2024-09-15T23:56:09.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.663+0000 7fd612ffd640 1 -- 172.21.15.121:0/2186088979 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+11056 (secure 0 0 0) 0x7fd618012a20 con 0x7fd61c0a4c20 2024-09-15T23:56:09.664 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:09.664 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":28,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:55:58.624005+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:55:40.793323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:55:41.516392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0800000429153442,"score_stable":1.0800000429153442,"optimal_score":1,"raw_score_acting":1.0800000429153442,"raw_score_stable":1.0800000429153442,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6825/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6824/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/1333687230":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/822936298":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/2264301746":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/370154040":"2024-09-16T23:55:58.623965+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 msgr2=0x7fd60003a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 0x7fd60003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 msgr2=0x7fd61c0a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd61800c380 tx=0x7fd61800c840 comp rx=0 tx=0).stop 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 shutdown_connections 2024-09-15T23:56:09.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fd600038370 0x7fd60003a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 --2- 172.21.15.121:0/2186088979 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd61c0a4c20 0x7fd61c0a1180 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 >> 172.21.15.121:0/2186088979 conn(0x7fd61c0ac3e0 msgr2=0x7fd61c0aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 shutdown_connections 2024-09-15T23:56:09.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.665+0000 7fd624331640 1 -- 172.21.15.121:0/2186088979 wait complete. 2024-09-15T23:56:09.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.817+0000 7f9302f91640 1 Processor -- start 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.817+0000 7f9302f91640 1 -- start start 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f9302f91640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f92fc0a4c20 0x7f92fc13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f9302f91640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92fc13a080 con 0x7f92fc13a280 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f9302f91640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f92fc0a3d50 con 0x7f92fc0a4c20 2024-09-15T23:56:09.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f92fbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f92fc0a4c20 0x7f92fc13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f92fbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f92fc0a4c20 0x7f92fc13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51072/0 (socket says 172.21.15.121:51072) 2024-09-15T23:56:09.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f92fbfff640 1 -- 172.21.15.121:0/94398358 learned_addr learned my addr 172.21.15.121:0/94398358 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f9300d2d640 1 --1- 172.21.15.121:0/94398358 >> v1:172.21.15.121:6789/0 conn(0x7f92fc13a280 0x7f92fc13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50258/0 (socket says 172.21.15.121:50258) 2024-09-15T23:56:09.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f92fbfff640 1 -- 172.21.15.121:0/94398358 >> v1:172.21.15.121:6789/0 conn(0x7f92fc13a280 legacy=0x7f92fc13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.820 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.818+0000 7f92fbfff640 1 -- 172.21.15.121:0/94398358 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc0a3f80 con 0x7f92fc0a4c20 2024-09-15T23:56:09.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.819+0000 7f92fbfff640 1 --2- 172.21.15.121:0/94398358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc13f060 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92e80097f0 tx=0x7f92e802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485626987ea88261 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.819+0000 7f92fb7fe640 1 -- 172.21.15.121:0/94398358 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e8037070 con 0x7f92fc0a4c20 2024-09-15T23:56:09.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.819+0000 7f92fb7fe640 1 -- 172.21.15.121:0/94398358 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8032440 con 0x7f92fc0a4c20 2024-09-15T23:56:09.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.819+0000 7f92fb7fe640 1 -- 172.21.15.121:0/94398358 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e802ae60 con 0x7f92fc0a4c20 2024-09-15T23:56:09.821 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 -- 172.21.15.121:0/94398358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 msgr2=0x7f92fc13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 --2- 172.21.15.121:0/94398358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc13f060 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92e80097f0 tx=0x7f92e802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 -- 172.21.15.121:0/94398358 shutdown_connections 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 --2- 172.21.15.121:0/94398358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc13f060 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 -- 172.21.15.121:0/94398358 >> 172.21.15.121:0/94398358 conn(0x7f92fc0ac3e0 msgr2=0x7f92fc0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 -- 172.21.15.121:0/94398358 shutdown_connections 2024-09-15T23:56:09.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.820+0000 7f9302f91640 1 -- 172.21.15.121:0/94398358 wait complete. 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.821+0000 7f9302f91640 1 Processor -- start 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.821+0000 7f9302f91640 1 -- start start 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9302f91640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9302f91640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc0a7ec0 con 0x7f92fc0a4c20 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9300d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9300d2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51078/0 (socket says 172.21.15.121:51078) 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9300d2d640 1 -- 172.21.15.121:0/2261174664 learned_addr learned my addr 172.21.15.121:0/2261174664 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9300d2d640 1 -- 172.21.15.121:0/2261174664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc125070 con 0x7f92fc0a4c20 2024-09-15T23:56:09.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9300d2d640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c450 tx=0x7f92f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92f0007410 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f00075b0 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92f0004910 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc124780 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.822+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc124470 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.823+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7f92f001a020 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.823+0000 7f92f97fa640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 0x7f92e003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.823+0000 7f92fbfff640 1 -- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 msgr2=0x7f92e003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.823+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3697+0+0 (secure 0 0 0) 0x7f92f004ad60 con 0x7f92fc0a4c20 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.823+0000 7f92fbfff640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 0x7f92e003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:09.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.824+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc122c20 con 0x7f92fc0a4c20 2024-09-15T23:56:09.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:09.828+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92f001b9c0 con 0x7f92fc0a4c20 2024-09-15T23:56:10.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.024+0000 7f92fbfff640 1 -- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 msgr2=0x7f92e003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6824/4272875154 2024-09-15T23:56:10.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.024+0000 7f92fbfff640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 0x7f92e003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:10.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.189+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f92fc124950 con 0x7f92fc0a4c20 2024-09-15T23:56:10.191 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:56:10.190+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:56:10.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.190+0000 7f92f97fa640 1 -- 172.21.15.121:0/2261174664 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) ==== 161+0+0 (secure 0 0 0) 0x7f92f001bc20 con 0x7f92fc0a4c20 2024-09-15T23:56:10.191 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:56:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 msgr2=0x7f92e003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 0x7f92e003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 msgr2=0x7f92fc0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f000c450 tx=0x7f92f000c910 comp rx=0 tx=0).stop 2024-09-15T23:56:10.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 shutdown_connections 2024-09-15T23:56:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7f92e00383c0 0x7f92e003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 --2- 172.21.15.121:0/2261174664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92fc0a4c20 0x7f92fc0a0ff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 >> 172.21.15.121:0/2261174664 conn(0x7f92fc0ac3e0 msgr2=0x7f92fc0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 shutdown_connections 2024-09-15T23:56:10.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.194+0000 7f9302f91640 1 -- 172.21.15.121:0/2261174664 wait complete. 2024-09-15T23:56:10.196 INFO:tasks.ceph.mds.b.smithi121.stderr: -2499> 2024-09-15T23:55:47.057+0000 7fa112af0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:10.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:56:10.224 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:56:10.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.310+0000 7fc9ae41e640 1 Processor -- start 2024-09-15T23:56:10.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.310+0000 7fc9ae41e640 1 -- start start 2024-09-15T23:56:10.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.310+0000 7fc9ae41e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc9a80a7140 0x7fc9a80a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9ae41e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80a6d10 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9ae41e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a806e230 con 0x7fc9a80a7140 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9a7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc9a80a7140 0x7fc9a80a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9a7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc9a80a7140 0x7fc9a80a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51098/0 (socket says 172.21.15.121:51098) 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9a7fff640 1 -- 172.21.15.121:0/13752102 learned_addr learned my addr 172.21.15.121:0/13752102 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc99ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc9a80a4ab0 0x7fc9a8139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50272/0 (socket says 172.21.15.121:50272) 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9a7fff640 1 -- 172.21.15.121:0/13752102 >> v1:172.21.15.121:6789/0 conn(0x7fc9a80a4ab0 legacy=0x7fc9a8139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.311+0000 7fc9a7fff640 1 -- 172.21.15.121:0/13752102 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80a3ae0 con 0x7fc9a80a7140 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9a7fff640 1 --2- 172.21.15.121:0/13752102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a7140 0x7fc9a80a7520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc9980097f0 tx=0x7fc99802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34f2f77da3334b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9a77fe640 1 -- 172.21.15.121:0/13752102 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc998037070 con 0x7fc9a80a7140 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9a77fe640 1 -- 172.21.15.121:0/13752102 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc998032440 con 0x7fc9a80a7140 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9a77fe640 1 -- 172.21.15.121:0/13752102 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc99802ae60 con 0x7fc9a80a7140 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9ae41e640 1 -- 172.21.15.121:0/13752102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a7140 msgr2=0x7fc9a80a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:10.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.312+0000 7fc9ae41e640 1 --2- 172.21.15.121:0/13752102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a7140 0x7fc9a80a7520 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc9980097f0 tx=0x7fc99802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 -- 172.21.15.121:0/13752102 shutdown_connections 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 --2- 172.21.15.121:0/13752102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a7140 0x7fc9a80a7520 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 -- 172.21.15.121:0/13752102 >> 172.21.15.121:0/13752102 conn(0x7fc9a80ac370 msgr2=0x7fc9a80ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 -- 172.21.15.121:0/13752102 shutdown_connections 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 -- 172.21.15.121:0/13752102 wait complete. 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.313+0000 7fc9ae41e640 1 Processor -- start 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9ae41e640 1 -- start start 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9ae41e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9ae41e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80a7fc0 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51100/0 (socket says 172.21.15.121:51100) 2024-09-15T23:56:10.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9a7fff640 1 -- 172.21.15.121:0/1994877091 learned_addr learned my addr 172.21.15.121:0/1994877091 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:10.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.314+0000 7fc9a7fff640 1 -- 172.21.15.121:0/1994877091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a8125260 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9a7fff640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc998035040 tx=0x7fc9980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc998041070 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99803c7a0 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc998037040 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8124820 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.315+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a8124f70 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 11) ==== 45839+0+0 (secure 0 0 0) 0x7fc998044070 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9a57fa640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:10.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a8122c50 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3783+0+0 (secure 0 0 0) 0x7fc99806c100 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc99ffff640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc99ffff640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc99ffff640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 msgr2=0x7fc98803a880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-15T23:56:10.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.316+0000 7fc9a57fa640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:10.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.321+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc99803a760 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.339 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.338+0000 7f7f02728040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:56:10.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.342+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 12) ==== 45448+0+0 (secure 0 0 0) 0x7fc99803a070 con 0x7fc9a80a4ab0 2024-09-15T23:56:10.385 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e8361a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.385 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e8361a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e8361a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e8361a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e8361a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e86620640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e86620640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.386 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e86620640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.387 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e86620640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.387 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:10.384+0000 7f7e86620640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:10.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:10.530+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc9a8124b50 con 0x7fc9a80a4ab0 2024-09-15T23:56:11.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.191+0000 7fc9a57fa640 1 -- 172.21.15.121:0/1994877091 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7fc9980432c0 con 0x7fc9a80a4ab0 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 msgr2=0x7fc9a80a1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc998035040 tx=0x7fc9980046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 shutdown_connections 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:6824/4272875154,v1:172.21.15.121:6825/4272875154] conn(0x7fc9880383c0 0x7fc98803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 --2- 172.21.15.121:0/1994877091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9a80a4ab0 0x7fc9a80a1130 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 >> 172.21.15.121:0/1994877091 conn(0x7fc9a80ac370 msgr2=0x7fc9a80a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:11.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 shutdown_connections 2024-09-15T23:56:11.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.194+0000 7fc9ae41e640 1 -- 172.21.15.121:0/1994877091 wait complete. 2024-09-15T23:56:11.208 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:56:11.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f037f6640 1 Processor -- start 2024-09-15T23:56:11.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f037f6640 1 -- start start 2024-09-15T23:56:11.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f037f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6efc133020 0x7f6efc0a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f037f6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6efc09abc0 con 0x7f6efc133400 2024-09-15T23:56:11.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f037f6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6efc0a2310 con 0x7f6efc133020 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f01592640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6efc133020 0x7f6efc0a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f00d91640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6efc133400 0x7f6efc135fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:50274/0 (socket says 172.21.15.121:50274) 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f00d91640 1 -- 172.21.15.121:0/1672301046 learned_addr learned my addr 172.21.15.121:0/1672301046 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.360+0000 7f6f01592640 1 --2- 172.21.15.121:0/1672301046 >> v2:172.21.15.121:3300/0 conn(0x7f6efc133020 0x7f6efc0a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51230/0 (socket says 172.21.15.121:51230) 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.361+0000 7f6f01592640 1 -- 172.21.15.121:0/1672301046 >> v1:172.21.15.121:6789/0 conn(0x7f6efc133400 legacy=0x7f6efc135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.361+0000 7f6f01592640 1 -- 172.21.15.121:0/1672301046 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc132bf0 con 0x7f6efc133020 2024-09-15T23:56:11.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.361+0000 7f6ef3fff640 1 -- 172.21.15.121:0/1672301046 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950571045 0 0) 0x7f6efc09abc0 con 0x7f6efc133400 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.361+0000 7f6f01592640 1 --2- 172.21.15.121:0/1672301046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc0a04b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a8c0 tx=0x7f6ef802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19262b88cd500c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6ef3fff640 1 -- 172.21.15.121:0/1672301046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ef800b040 con 0x7f6efc133020 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6ef3fff640 1 -- 172.21.15.121:0/1672301046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8030640 con 0x7f6efc133020 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6ef3fff640 1 -- 172.21.15.121:0/1672301046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8030940 con 0x7f6efc133020 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 -- 172.21.15.121:0/1672301046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 msgr2=0x7f6efc0a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 --2- 172.21.15.121:0/1672301046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc0a04b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800a8c0 tx=0x7f6ef802b4d0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 -- 172.21.15.121:0/1672301046 shutdown_connections 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 --2- 172.21.15.121:0/1672301046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc0a04b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 -- 172.21.15.121:0/1672301046 >> 172.21.15.121:0/1672301046 conn(0x7f6efc0a8430 msgr2=0x7f6efc0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:11.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 -- 172.21.15.121:0/1672301046 shutdown_connections 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.362+0000 7f6f037f6640 1 -- 172.21.15.121:0/1672301046 wait complete. 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.363+0000 7f6f037f6640 1 Processor -- start 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.363+0000 7f6f037f6640 1 -- start start 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f037f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f037f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc0a19c0 con 0x7f6efc133020 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f01592640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f01592640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:51236/0 (socket says 172.21.15.121:51236) 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f01592640 1 -- 172.21.15.121:0/2392013017 learned_addr learned my addr 172.21.15.121:0/2392013017 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f01592640 1 -- 172.21.15.121:0/2392013017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc11e9a0 con 0x7f6efc133020 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f01592640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ef802ba90 tx=0x7f6ef8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8040070 con 0x7f6efc133020 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef80339f0 con 0x7f6efc133020 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8033cd0 con 0x7f6efc133020 2024-09-15T23:56:11.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc131910 con 0x7f6efc133020 2024-09-15T23:56:11.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.364+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc072a50 con 0x7f6efc133020 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.365+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7f6ef8043070 con 0x7f6efc133020 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.365+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6efc072170 con 0x7f6efc133020 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.365+0000 7f6ef1ffb640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 0x7f6ee003a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.365+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4127+0+0 (secure 0 0 0) 0x7f6ef806c110 con 0x7f6efc133020 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.365+0000 7f6f00d91640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 0x7f6ee003a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:11.369 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.366+0000 7f6f00d91640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 0x7f6ee003a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6eec000c00 tx=0x7f6eec007910 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:11.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.370+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ef803b7a0 con 0x7f6efc133020 2024-09-15T23:56:11.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:11.535+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6efc133830 con 0x7f6efc133020 2024-09-15T23:56:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.343+0000 7f6ef1ffb640 1 -- 172.21.15.121:0/2392013017 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f6ef803ba00 con 0x7f6efc133020 2024-09-15T23:56:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:56:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 msgr2=0x7f6ee003a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 0x7f6ee003a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6eec000c00 tx=0x7f6eec007910 comp rx=0 tx=0).stop 2024-09-15T23:56:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 msgr2=0x7f6efc070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ef802ba90 tx=0x7f6ef8004730 comp rx=0 tx=0).stop 2024-09-15T23:56:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 shutdown_connections 2024-09-15T23:56:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f6ee00380f0 0x7f6ee003a5b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 --2- 172.21.15.121:0/2392013017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6efc133020 0x7f6efc070910 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 >> 172.21.15.121:0/2392013017 conn(0x7f6efc0a8430 msgr2=0x7f6efc09f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 shutdown_connections 2024-09-15T23:56:12.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.346+0000 7f6f037f6640 1 -- 172.21.15.121:0/2392013017 wait complete. 2024-09-15T23:56:12.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:56:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff428e27640 1 Processor -- start 2024-09-15T23:56:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff428e27640 1 -- start start 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff428e27640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff4240a37b0 0x7ff42409acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff428e27640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42409b200 con 0x7ff4240a3b90 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff428e27640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff42409b4f0 con 0x7ff4240a37b0 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff42259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff4240a37b0 0x7ff42409acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff421d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff4240a3b90 0x7ff4240a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38796/0 (socket says 172.21.15.121:38796) 2024-09-15T23:56:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff421d9b640 1 -- 172.21.15.121:0/895634445 learned_addr learned my addr 172.21.15.121:0/895634445 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.476+0000 7ff42259c640 1 --2- 172.21.15.121:0/895634445 >> v2:172.21.15.121:3300/0 conn(0x7ff4240a37b0 0x7ff42409acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38640/0 (socket says 172.21.15.121:38640) 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.477+0000 7ff42259c640 1 -- 172.21.15.121:0/895634445 >> v1:172.21.15.121:6789/0 conn(0x7ff4240a3b90 legacy=0x7ff4240a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.477+0000 7ff42259c640 1 -- 172.21.15.121:0/895634445 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4240a1c90 con 0x7ff4240a37b0 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.477+0000 7ff42259c640 1 --2- 172.21.15.121:0/895634445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff42409acc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff414009720 tx=0x7ff41402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65b1e38d6d0afb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff42159a640 1 -- 172.21.15.121:0/895634445 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414037070 con 0x7ff4240a37b0 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff42159a640 1 -- 172.21.15.121:0/895634445 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41402ad90 con 0x7ff4240a37b0 2024-09-15T23:56:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff42159a640 1 -- 172.21.15.121:0/895634445 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414032590 con 0x7ff4240a37b0 2024-09-15T23:56:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 -- 172.21.15.121:0/895634445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 msgr2=0x7ff42409acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 --2- 172.21.15.121:0/895634445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff42409acc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff414009720 tx=0x7ff41402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 -- 172.21.15.121:0/895634445 shutdown_connections 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 --2- 172.21.15.121:0/895634445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff42409acc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 -- 172.21.15.121:0/895634445 >> 172.21.15.121:0/895634445 conn(0x7ff4240a8430 msgr2=0x7ff4240a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 -- 172.21.15.121:0/895634445 shutdown_connections 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.478+0000 7ff428e27640 1 -- 172.21.15.121:0/895634445 wait complete. 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.479+0000 7ff428e27640 1 Processor -- start 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.479+0000 7ff428e27640 1 -- start start 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff428e27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff428e27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4240a5220 con 0x7ff4240a37b0 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff42259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff42259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38652/0 (socket says 172.21.15.121:38652) 2024-09-15T23:56:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff42259c640 1 -- 172.21.15.121:0/3859517738 learned_addr learned my addr 172.21.15.121:0/3859517738 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff42259c640 1 -- 172.21.15.121:0/3859517738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff424123690 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff42259c640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff414009840 tx=0x7ff4140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414041070 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41403c460 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff424124870 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff414037040 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.480+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff424134180 con 0x7ff4240a37b0 2024-09-15T23:56:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.481+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 45575+0+0 (secure 0 0 0) 0x7ff414044070 con 0x7ff4240a37b0 2024-09-15T23:56:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.481+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42409e810 con 0x7ff4240a37b0 2024-09-15T23:56:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.481+0000 7ff412ffd640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 0x7ff40403a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.481+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3689+0+0 (secure 0 0 0) 0x7ff41406bd00 con 0x7ff4240a37b0 2024-09-15T23:56:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.481+0000 7ff421d9b640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 0x7ff40403a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.482+0000 7ff421d9b640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 0x7ff40403a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff418005880 tx=0x7ff418007a80 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.486+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff42409e810 con 0x7ff4240a37b0 2024-09-15T23:56:12.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.652+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 14) ==== 45681+0+0 (secure 0 0 0) 0x7ff41403a070 con 0x7ff4240a37b0 2024-09-15T23:56:12.658 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:12.657+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff424124560 con 0x7ff4240a37b0 2024-09-15T23:56:13.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.656+0000 7ff412ffd640 1 -- 172.21.15.121:0/3859517738 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7ff4140432c0 con 0x7ff4240a37b0 2024-09-15T23:56:13.657 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 msgr2=0x7ff40403a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 0x7ff40403a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff418005880 tx=0x7ff418007a80 comp rx=0 tx=0).stop 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 msgr2=0x7ff4241252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff414009840 tx=0x7ff4140046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 shutdown_connections 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff4040380f0 0x7ff40403a5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 --2- 172.21.15.121:0/3859517738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4240a37b0 0x7ff4241252c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 >> 172.21.15.121:0/3859517738 conn(0x7ff4240a8430 msgr2=0x7ff42409e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:13.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 shutdown_connections 2024-09-15T23:56:13.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.662+0000 7ff428e27640 1 -- 172.21.15.121:0/3859517738 wait complete. 2024-09-15T23:56:13.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:56:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.778+0000 7fef90731640 1 Processor -- start 2024-09-15T23:56:13.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.778+0000 7fef90731640 1 -- start start 2024-09-15T23:56:13.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef90731640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fef880a42a0 0x7fef8809f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:13.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef90731640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8809ce40 con 0x7fef880a37b0 2024-09-15T23:56:13.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef90731640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fef8809f960 con 0x7fef880a42a0 2024-09-15T23:56:13.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8e4cd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fef880a37b0 0x7fef880a3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38804/0 (socket says 172.21.15.121:38804) 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8e4cd640 1 -- 172.21.15.121:0/695351289 learned_addr learned my addr 172.21.15.121:0/695351289 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8dccc640 1 --2- 172.21.15.121:0/695351289 >> v2:172.21.15.121:3300/0 conn(0x7fef880a42a0 0x7fef8809f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8d4cb640 1 -- 172.21.15.121:0/695351289 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338880918 0 0) 0x7fef8809ce40 con 0x7fef880a37b0 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8d4cb640 1 -- 172.21.15.121:0/695351289 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef74003520 con 0x7fef880a37b0 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8dccc640 1 -- 172.21.15.121:0/695351289 >> v1:172.21.15.121:6789/0 conn(0x7fef880a37b0 legacy=0x7fef880a3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.779+0000 7fef8dccc640 1 -- 172.21.15.121:0/695351289 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8809d7a0 con 0x7fef880a42a0 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.780+0000 7fef8dccc640 1 --2- 172.21.15.121:0/695351289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a42a0 0x7fef8809f230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef78009720 tx=0x7fef7802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7379b2faa81631 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.780+0000 7fef8d4cb640 1 -- 172.21.15.121:0/695351289 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef78037070 con 0x7fef880a42a0 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.780+0000 7fef8d4cb640 1 -- 172.21.15.121:0/695351289 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7802ad90 con 0x7fef880a42a0 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.780+0000 7fef8d4cb640 1 -- 172.21.15.121:0/695351289 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef78032590 con 0x7fef880a42a0 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 -- 172.21.15.121:0/695351289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a42a0 msgr2=0x7fef8809f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 --2- 172.21.15.121:0/695351289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a42a0 0x7fef8809f230 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fef78009720 tx=0x7fef7802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 -- 172.21.15.121:0/695351289 shutdown_connections 2024-09-15T23:56:13.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 --2- 172.21.15.121:0/695351289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a42a0 0x7fef8809f230 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 -- 172.21.15.121:0/695351289 >> 172.21.15.121:0/695351289 conn(0x7fef880a8430 msgr2=0x7fef880a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 -- 172.21.15.121:0/695351289 shutdown_connections 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.781+0000 7fef90731640 1 -- 172.21.15.121:0/695351289 wait complete. 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef90731640 1 Processor -- start 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef90731640 1 -- start start 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef90731640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef90731640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef880a5220 con 0x7fef880a37b0 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef8e4cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef8e4cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38668/0 (socket says 172.21.15.121:38668) 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef8e4cd640 1 -- 172.21.15.121:0/442352469 learned_addr learned my addr 172.21.15.121:0/442352469 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef8e4cd640 1 -- 172.21.15.121:0/442352469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef88071f40 con 0x7fef880a37b0 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.782+0000 7fef8e4cd640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c480 tx=0x7fef8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef84017070 con 0x7fef880a37b0 2024-09-15T23:56:13.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef84005c10 con 0x7fef880a37b0 2024-09-15T23:56:13.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef880721d0 con 0x7fef880a37b0 2024-09-15T23:56:13.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef84007070 con 0x7fef880a37b0 2024-09-15T23:56:13.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef88134490 con 0x7fef880a37b0 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.783+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) ==== 45681+0+0 (secure 0 0 0) 0x7fef8401a070 con 0x7fef880a37b0 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.784+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8809d590 con 0x7fef880a37b0 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.784+0000 7fef7effd640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 0x7fef6c03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.784+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7fef8404a360 con 0x7fef880a37b0 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.784+0000 7fef8dccc640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 0x7fef6c03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:13.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.784+0000 7fef8dccc640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 0x7fef6c03a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef78034000 tx=0x7fef7802e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:13.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.788+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef8809d590 con 0x7fef880a37b0 2024-09-15T23:56:13.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.952+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fef8809f230 con 0x7fef880a37b0 2024-09-15T23:56:13.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.954+0000 7fef7effd640 1 -- 172.21.15.121:0/442352469 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v6) ==== 104+0+0 (secure 0 0 0) 0x7fef8401a790 con 0x7fef880a37b0 2024-09-15T23:56:13.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 msgr2=0x7fef6c03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 0x7fef6c03a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef78034000 tx=0x7fef7802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 msgr2=0x7fef8811e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c480 tx=0x7fef8400c940 comp rx=0 tx=0).stop 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 shutdown_connections 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fef6c038210 0x7fef6c03a6d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 --2- 172.21.15.121:0/442352469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef880a37b0 0x7fef8811e460 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 >> 172.21.15.121:0/442352469 conn(0x7fef880a8430 msgr2=0x7fef88134b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 shutdown_connections 2024-09-15T23:56:13.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:13.956+0000 7fef90731640 1 -- 172.21.15.121:0/442352469 wait complete. 2024-09-15T23:56:13.968 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump' 2024-09-15T23:56:14.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b27b6f640 1 Processor -- start 2024-09-15T23:56:14.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b27b6f640 1 -- start start 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b27b6f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1b20135b50 0x7f1b2009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b27b6f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b2009b020 con 0x7f1b20135f30 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b27b6f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2009b310 con 0x7f1b20135b50 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.065+0000 7f1b2590b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1b20135b50 0x7f1b2009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.066+0000 7f1b2510a640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1b20135f30 0x7f1b200a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38816/0 (socket says 172.21.15.121:38816) 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.066+0000 7f1b2510a640 1 -- 172.21.15.121:0/3272744065 learned_addr learned my addr 172.21.15.121:0/3272744065 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.066+0000 7f1b2590b640 1 -- 172.21.15.121:0/3272744065 >> v1:172.21.15.121:6789/0 conn(0x7f1b20135f30 legacy=0x7f1b200a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.066+0000 7f1b2590b640 1 -- 172.21.15.121:0/3272744065 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b200a08c0 con 0x7f1b20135b50 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.066+0000 7f1b2590b640 1 --2- 172.21.15.121:0/3272744065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2009aae0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009720 tx=0x7f1b1c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bebf0dc6e762c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b24909640 1 -- 172.21.15.121:0/3272744065 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c037070 con 0x7f1b20135b50 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b24909640 1 -- 172.21.15.121:0/3272744065 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c02ae20 con 0x7f1b20135b50 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b24909640 1 -- 172.21.15.121:0/3272744065 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c032590 con 0x7f1b20135b50 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 -- 172.21.15.121:0/3272744065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 msgr2=0x7f1b2009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/3272744065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2009aae0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009720 tx=0x7f1b1c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 -- 172.21.15.121:0/3272744065 shutdown_connections 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/3272744065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2009aae0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 -- 172.21.15.121:0/3272744065 >> 172.21.15.121:0/3272744065 conn(0x7f1b200a85e0 msgr2=0x7f1b200a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 -- 172.21.15.121:0/3272744065 shutdown_connections 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.067+0000 7f1b27b6f640 1 -- 172.21.15.121:0/3272744065 wait complete. 2024-09-15T23:56:14.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.068+0000 7f1b27b6f640 1 Processor -- start 2024-09-15T23:56:14.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.068+0000 7f1b27b6f640 1 -- start start 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.068+0000 7f1b27b6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.068+0000 7f1b27b6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b200a5430 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b2590b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b2590b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38686/0 (socket says 172.21.15.121:38686) 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b2590b640 1 -- 172.21.15.121:0/777663823 learned_addr learned my addr 172.21.15.121:0/777663823 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b2590b640 1 -- 172.21.15.121:0/777663823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b20121d50 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b2590b640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c02adf0 tx=0x7f1b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c041070 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c03c590 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c037040 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b20121600 con 0x7f1b20135b50 2024-09-15T23:56:14.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.069+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b20120380 con 0x7f1b20135b50 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.070+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) ==== 45681+0+0 (secure 0 0 0) 0x7f1b1c044070 con 0x7f1b20135b50 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.070+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b20136350 con 0x7f1b20135b50 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.070+0000 7f1b167fc640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 0x7f1b0403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.070+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7f1b1c06bcd0 con 0x7f1b20135b50 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.070+0000 7f1b2510a640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 0x7f1b0403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.071+0000 7f1b2510a640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 0x7f1b0403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007fd0 tx=0x7f1b10007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.075+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b1c071020 con 0x7f1b20135b50 2024-09-15T23:56:14.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.311+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump"]} v 0) -- 0x7f1b200a1f10 con 0x7f1b20135b50 2024-09-15T23:56:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.661+0000 7f1b167fc640 1 -- 172.21.15.121:0/777663823 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dump"]}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7f1b1c02ae20 con 0x7f1b20135b50 2024-09-15T23:56:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 msgr2=0x7f1b0403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 0x7f1b0403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1b10007fd0 tx=0x7f1b10007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 msgr2=0x7f1b2011e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c02adf0 tx=0x7f1b1c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 shutdown_connections 2024-09-15T23:56:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1b04038210 0x7f1b0403a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 --2- 172.21.15.121:0/777663823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b20135b50 0x7f1b2011e600 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 >> 172.21.15.121:0/777663823 conn(0x7f1b200a85e0 msgr2=0x7f1b200a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 shutdown_connections 2024-09-15T23:56:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.663+0000 7f1b27b6f640 1 -- 172.21.15.121:0/777663823 wait complete. 2024-09-15T23:56:14.675 INFO:tasks.cephfs_test_runner:Tests 'cephfs-top --dump' output is valid ... ok 2024-09-15T23:56:14.675 INFO:tasks.cephfs_test_runner:Starting test: test_dumpfs (tasks.cephfs.test_fstop.TestFSTop) Tests 'cephfs-top --dumpfs' output is valid 2024-09-15T23:56:14.675 INFO:tasks.cephfs_test_runner:test_dumpfs (tasks.cephfs.test_fstop.TestFSTop) 2024-09-15T23:56:14.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:14.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.772+0000 7fc89801e640 1 Processor -- start 2024-09-15T23:56:14.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc89801e640 1 -- start start 2024-09-15T23:56:14.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc89801e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc890133640 0x7fc89013b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc89801e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900a16c0 con 0x7fc8900a39c0 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc89801e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc8900a1490 con 0x7fc890133640 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc8955b9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc890133640 0x7fc89013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc895dba640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc8900a39c0 0x7fc890132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38818/0 (socket says 172.21.15.121:38818) 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.773+0000 7fc895dba640 1 -- 172.21.15.121:0/3437321866 learned_addr learned my addr 172.21.15.121:0/3437321866 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc8955b9640 1 -- 172.21.15.121:0/3437321866 >> v1:172.21.15.121:6789/0 conn(0x7fc8900a39c0 legacy=0x7fc890132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc8955b9640 1 -- 172.21.15.121:0/3437321866 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8900a4010 con 0x7fc890133640 2024-09-15T23:56:14.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc894db8640 1 -- 172.21.15.121:0/3437321866 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621726044 0 0) 0x7fc8900a16c0 con 0x7fc8900a39c0 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc8955b9640 1 --2- 172.21.15.121:0/3437321866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc890133640 0x7fc89013b270 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009720 tx=0x7fc88c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45b146d7dcb5a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc894db8640 1 -- 172.21.15.121:0/3437321866 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc88c037070 con 0x7fc890133640 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc894db8640 1 -- 172.21.15.121:0/3437321866 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc88c02ad90 con 0x7fc890133640 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.774+0000 7fc894db8640 1 -- 172.21.15.121:0/3437321866 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc88c032590 con 0x7fc890133640 2024-09-15T23:56:14.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 -- 172.21.15.121:0/3437321866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc890133640 msgr2=0x7fc89013b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 --2- 172.21.15.121:0/3437321866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc890133640 0x7fc89013b270 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009720 tx=0x7fc88c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 -- 172.21.15.121:0/3437321866 shutdown_connections 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 --2- 172.21.15.121:0/3437321866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc890133640 0x7fc89013b270 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 -- 172.21.15.121:0/3437321866 >> 172.21.15.121:0/3437321866 conn(0x7fc8900a85e0 msgr2=0x7fc8900a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 -- 172.21.15.121:0/3437321866 shutdown_connections 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.775+0000 7fc89801e640 1 -- 172.21.15.121:0/3437321866 wait complete. 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc89801e640 1 Processor -- start 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc89801e640 1 -- start start 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc89801e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc89801e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8901329c0 con 0x7fc8900a39c0 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc895dba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc895dba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38704/0 (socket says 172.21.15.121:38704) 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.776+0000 7fc895dba640 1 -- 172.21.15.121:0/3298002704 learned_addr learned my addr 172.21.15.121:0/3298002704 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:14.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc895dba640 1 -- 172.21.15.121:0/3298002704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8901394f0 con 0x7fc8900a39c0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc895dba640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c370 tx=0x7fc88400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884007410 con 0x7fc8900a39c0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8840075d0 con 0x7fc8900a39c0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89013a2b0 con 0x7fc8900a39c0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc884004950 con 0x7fc8900a39c0 2024-09-15T23:56:14.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.777+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc890138e60 con 0x7fc8900a39c0 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 14) ==== 45681+0+0 (secure 0 0 0) 0x7fc884011070 con 0x7fc8900a39c0 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8900a2340 con 0x7fc8900a39c0 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc8827fc640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 0x7fc87403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7fc88404ac00 con 0x7fc8900a39c0 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc8955b9640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 0x7fc87403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:14.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.778+0000 7fc8955b9640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 0x7fc87403a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc88c034000 tx=0x7fc88c02e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:14.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.782+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc88401cbd0 con 0x7fc8900a39c0 2024-09-15T23:56:14.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.949+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc89009e3a0 con 0x7fc8900a39c0 2024-09-15T23:56:14.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.949+0000 7fc8827fc640 1 -- 172.21.15.121:0/3298002704 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+7815 (secure 0 0 0) 0x7fc884004d80 con 0x7fc8900a39c0 2024-09-15T23:56:14.950 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:14.951 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":32,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:13.655420+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/269545708":"2024-09-16T23:56:10.339991+0000","172.21.15.121:6824/4272875154":"2024-09-16T23:56:10.339991+0000","172.21.15.121:0/2264301746":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/822936298":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6825/4272875154":"2024-09-16T23:56:10.339991+0000","172.21.15.121:0/1333687230":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6824/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6825/1047503300":"2024-09-16T23:55:58.623965+0000","172.21.15.121:6829/3125597125":"2024-09-16T23:56:10.190897+0000","172.21.15.121:0/3353691964":"2024-09-16T23:56:10.339991+0000","172.21.15.121:0/1529689488":"2024-09-16T23:56:10.339991+0000","172.21.15.121:0/370154040":"2024-09-16T23:55:58.623965+0000","172.21.15.121:0/3244016210":"2024-09-16T23:56:10.339991+0000","172.21.15.121:6827/3125597125":"2024-09-16T23:56:10.190897+0000","172.21.15.121:0/2792882012":"2024-09-16T23:56:10.339991+0000","172.21.15.121:0/3816957790":"2024-09-16T23:56:10.339991+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:14.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 msgr2=0x7fc87403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 0x7fc87403a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc88c034000 tx=0x7fc88c02e000 comp rx=0 tx=0).stop 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 msgr2=0x7fc890139cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc88400c370 tx=0x7fc88400c830 comp rx=0 tx=0).stop 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 shutdown_connections 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fc874038210 0x7fc87403a6d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 --2- 172.21.15.121:0/3298002704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8900a39c0 0x7fc890139cb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 >> 172.21.15.121:0/3298002704 conn(0x7fc8900a85e0 msgr2=0x7fc89009f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 shutdown_connections 2024-09-15T23:56:14.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:14.951+0000 7fc89801e640 1 -- 172.21.15.121:0/3298002704 wait complete. 2024-09-15T23:56:14.963 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:55:04.051077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:56:14.963 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:56:15.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1721c4c640 1 Processor -- start 2024-09-15T23:56:15.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1721c4c640 1 -- start start 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1721c4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f171c0a7140 0x7f171c0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1721c4c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c0a6d10 con 0x7f171c0a4ab0 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1721c4c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f171c06e230 con 0x7f171c0a7140 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f171b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f171c0a7140 0x7f171c0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1713fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f171c0a4ab0 0x7f171c139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38834/0 (socket says 172.21.15.121:38834) 2024-09-15T23:56:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.063+0000 7f1713fff640 1 -- 172.21.15.121:0/628951941 learned_addr learned my addr 172.21.15.121:0/628951941 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171b7fe640 1 -- 172.21.15.121:0/628951941 >> v1:172.21.15.121:6789/0 conn(0x7f171c0a4ab0 legacy=0x7f171c139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171b7fe640 1 -- 172.21.15.121:0/628951941 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c0a3ae0 con 0x7f171c0a7140 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171affd640 1 -- 172.21.15.121:0/628951941 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002590919 0 0) 0x7f171c0a6d10 con 0x7f171c0a4ab0 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171b7fe640 1 --2- 172.21.15.121:0/628951941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a7140 0x7f171c0a7520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f170c009720 tx=0x7f170c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e3d3d89746bee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171affd640 1 -- 172.21.15.121:0/628951941 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c037070 con 0x7f171c0a7140 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171affd640 1 -- 172.21.15.121:0/628951941 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c02ad90 con 0x7f171c0a7140 2024-09-15T23:56:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.064+0000 7f171affd640 1 -- 172.21.15.121:0/628951941 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c032590 con 0x7f171c0a7140 2024-09-15T23:56:15.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 -- 172.21.15.121:0/628951941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a7140 msgr2=0x7f171c0a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 --2- 172.21.15.121:0/628951941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a7140 0x7f171c0a7520 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f170c009720 tx=0x7f170c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:15.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 -- 172.21.15.121:0/628951941 shutdown_connections 2024-09-15T23:56:15.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 --2- 172.21.15.121:0/628951941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a7140 0x7f171c0a7520 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 -- 172.21.15.121:0/628951941 >> 172.21.15.121:0/628951941 conn(0x7f171c0ac370 msgr2=0x7f171c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 -- 172.21.15.121:0/628951941 shutdown_connections 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.065+0000 7f1721c4c640 1 -- 172.21.15.121:0/628951941 wait complete. 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.066+0000 7f1721c4c640 1 Processor -- start 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.066+0000 7f1721c4c640 1 -- start start 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.066+0000 7f1721c4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.066+0000 7f1721c4c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f171c0a7fc0 con 0x7f171c0a4ab0 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f171b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f171b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38722/0 (socket says 172.21.15.121:38722) 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f171b7fe640 1 -- 172.21.15.121:0/3201607342 learned_addr learned my addr 172.21.15.121:0/3201607342 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f171b7fe640 1 -- 172.21.15.121:0/3201607342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c0a0150 con 0x7f171c0a4ab0 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f171b7fe640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f170c009840 tx=0x7f170c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c041020 con 0x7f171c0a4ab0 2024-09-15T23:56:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c03d550 con 0x7f171c0a4ab0 2024-09-15T23:56:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171c09f210 con 0x7f171c0a4ab0 2024-09-15T23:56:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c037040 con 0x7f171c0a4ab0 2024-09-15T23:56:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.067+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171c09e820 con 0x7f171c0a4ab0 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.068+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f170c044020 con 0x7f171c0a4ab0 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.068+0000 7f1718ff9640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 0x7f16fc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.068+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7f170c06b890 con 0x7f171c0a4ab0 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.068+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171c136a40 con 0x7f171c0a4ab0 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.068+0000 7f1713fff640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 0x7f16fc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.069+0000 7f1713fff640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 0x7f16fc03a760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1704000c00 tx=0x7f1704007910 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.073+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f170c04b030 con 0x7f171c0a4ab0 2024-09-15T23:56:15.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.241+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f171c0732e0 con 0x7f171c0a4ab0 2024-09-15T23:56:15.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.241+0000 7f1718ff9640 1 -- 172.21.15.121:0/3201607342 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7f170c03d870 con 0x7f171c0a4ab0 2024-09-15T23:56:15.242 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-15T23:56:15.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 msgr2=0x7f16fc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 0x7f16fc03a760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1704000c00 tx=0x7f1704007910 comp rx=0 tx=0).stop 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 msgr2=0x7f171c0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f170c009840 tx=0x7f170c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 shutdown_connections 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f16fc0382a0 0x7f16fc03a760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 --2- 172.21.15.121:0/3201607342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f171c0a4ab0 0x7f171c0a0e40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 >> 172.21.15.121:0/3201607342 conn(0x7f171c0ac370 msgr2=0x7f171c137210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 shutdown_connections 2024-09-15T23:56:15.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.243+0000 7f1721c4c640 1 -- 172.21.15.121:0/3201607342 wait complete. 2024-09-15T23:56:15.255 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs' 2024-09-15T23:56:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.351+0000 7f1a404af640 1 Processor -- start 2024-09-15T23:56:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a404af640 1 -- start start 2024-09-15T23:56:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a404af640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a3813a280 0x7f1a3813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a404af640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3813a080 con 0x7f1a380a4c20 2024-09-15T23:56:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a404af640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1a380a3d50 con 0x7f1a3813a280 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a3e24b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a3813a280 0x7f1a3813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a3da4a640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a380a4c20 0x7f1a380a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38836/0 (socket says 172.21.15.121:38836) 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.352+0000 7f1a3da4a640 1 -- 172.21.15.121:0/2820778968 learned_addr learned my addr 172.21.15.121:0/2820778968 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3e24b640 1 -- 172.21.15.121:0/2820778968 >> v1:172.21.15.121:6789/0 conn(0x7f1a380a4c20 legacy=0x7f1a380a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3e24b640 1 -- 172.21.15.121:0/2820778968 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a380a3f80 con 0x7f1a3813a280 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3d249640 1 -- 172.21.15.121:0/2820778968 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104033498 0 0) 0x7f1a3813a080 con 0x7f1a380a4c20 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3e24b640 1 --2- 172.21.15.121:0/2820778968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a3813a280 0x7f1a3813a660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009720 tx=0x7f1a2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a7bcdd20230108 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3d249640 1 -- 172.21.15.121:0/2820778968 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c037070 con 0x7f1a3813a280 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3d249640 1 -- 172.21.15.121:0/2820778968 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c02ad90 con 0x7f1a3813a280 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.353+0000 7f1a3d249640 1 -- 172.21.15.121:0/2820778968 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c032590 con 0x7f1a3813a280 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 -- 172.21.15.121:0/2820778968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a3813a280 msgr2=0x7f1a3813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 --2- 172.21.15.121:0/2820778968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a3813a280 0x7f1a3813a660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009720 tx=0x7f1a2c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 -- 172.21.15.121:0/2820778968 shutdown_connections 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 --2- 172.21.15.121:0/2820778968 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a3813a280 0x7f1a3813a660 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 -- 172.21.15.121:0/2820778968 >> 172.21.15.121:0/2820778968 conn(0x7f1a380ac3e0 msgr2=0x7f1a380ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 -- 172.21.15.121:0/2820778968 shutdown_connections 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.354+0000 7f1a404af640 1 -- 172.21.15.121:0/2820778968 wait complete. 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a404af640 1 Processor -- start 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a404af640 1 -- start start 2024-09-15T23:56:15.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a404af640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a404af640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a38139d40 con 0x7f1a380a4c20 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a3e24b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.355+0000 7f1a3e24b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38740/0 (socket says 172.21.15.121:38740) 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a3e24b640 1 -- 172.21.15.121:0/1909863425 learned_addr learned my addr 172.21.15.121:0/1909863425 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a3e24b640 1 -- 172.21.15.121:0/1909863425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a38124770 con 0x7f1a380a4c20 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a3e24b640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009720 tx=0x7f1a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c041070 con 0x7f1a380a4c20 2024-09-15T23:56:15.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c03c460 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2c037040 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a38122bc0 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.356+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a38124ec0 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.357+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f1a2c044070 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.357+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3813ab20 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.357+0000 7f1a2affd640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 0x7f1a1c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.357+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7f1a2c06bc00 con 0x7f1a380a4c20 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.357+0000 7f1a3da4a640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 0x7f1a1c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.358+0000 7f1a3da4a640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 0x7f1a1c03a790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a340015a0 tx=0x7f1a340079e0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.366 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.362+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a2c03bdd0 con 0x7f1a380a4c20 2024-09-15T23:56:15.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.595+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]} v 0) -- 0x7f1a3806dab0 con 0x7f1a380a4c20 2024-09-15T23:56:15.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.661+0000 7f1a2affd640 1 -- 172.21.15.121:0/1909863425 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]}]=0 v75) ==== 127+0+0 (secure 0 0 0) 0x7f1a2c03a520 con 0x7f1a380a4c20 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 msgr2=0x7f1a1c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 0x7f1a1c03a790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1a340015a0 tx=0x7f1a340079e0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 msgr2=0x7f1a380a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009720 tx=0x7f1a2c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 shutdown_connections 2024-09-15T23:56:15.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f1a1c0382d0 0x7f1a1c03a790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 --2- 172.21.15.121:0/1909863425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a380a4c20 0x7f1a380a1270 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 >> 172.21.15.121:0/1909863425 conn(0x7f1a380ac3e0 msgr2=0x7f1a38139620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 shutdown_connections 2024-09-15T23:56:15.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.664+0000 7f1a404af640 1 -- 172.21.15.121:0/1909863425 wait complete. 2024-09-15T23:56:15.675 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:56:15.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.776+0000 7f1519806640 1 Processor -- start 2024-09-15T23:56:15.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.776+0000 7f1519806640 1 -- start start 2024-09-15T23:56:15.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1519806640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f15140a3b90 0x7f15140a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1519806640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15140a4560 con 0x7f15140a37b0 2024-09-15T23:56:15.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1519806640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f151409b4f0 con 0x7f15140a3b90 2024-09-15T23:56:15.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f15127fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f15140a3b90 0x7f15140a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1512ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f15140a37b0 0x7f151409acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38838/0 (socket says 172.21.15.121:38838) 2024-09-15T23:56:15.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1512ffd640 1 -- 172.21.15.121:0/2386118120 learned_addr learned my addr 172.21.15.121:0/2386118120 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:15.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f15127fc640 1 -- 172.21.15.121:0/2386118120 >> v1:172.21.15.121:6789/0 conn(0x7f15140a37b0 legacy=0x7f151409acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f1511ffb640 1 -- 172.21.15.121:0/2386118120 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29693471 0 0) 0x7f15140a4560 con 0x7f15140a37b0 2024-09-15T23:56:15.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.777+0000 7f15127fc640 1 -- 172.21.15.121:0/2386118120 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15140a1c90 con 0x7f15140a3b90 2024-09-15T23:56:15.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f15127fc640 1 --2- 172.21.15.121:0/2386118120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a3b90 0x7f15140a4020 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1508009720 tx=0x7f150802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdefe5f5ca08bed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1511ffb640 1 -- 172.21.15.121:0/2386118120 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1508037070 con 0x7f15140a3b90 2024-09-15T23:56:15.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1511ffb640 1 -- 172.21.15.121:0/2386118120 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150802ad90 con 0x7f15140a3b90 2024-09-15T23:56:15.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1511ffb640 1 -- 172.21.15.121:0/2386118120 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1508032590 con 0x7f15140a3b90 2024-09-15T23:56:15.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1519806640 1 -- 172.21.15.121:0/2386118120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a3b90 msgr2=0x7f15140a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1519806640 1 --2- 172.21.15.121:0/2386118120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a3b90 0x7f15140a4020 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1508009720 tx=0x7f150802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1519806640 1 -- 172.21.15.121:0/2386118120 shutdown_connections 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1519806640 1 --2- 172.21.15.121:0/2386118120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a3b90 0x7f15140a4020 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.778+0000 7f1519806640 1 -- 172.21.15.121:0/2386118120 >> 172.21.15.121:0/2386118120 conn(0x7f15140a8430 msgr2=0x7f15140a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.779+0000 7f1519806640 1 -- 172.21.15.121:0/2386118120 shutdown_connections 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.779+0000 7f1519806640 1 -- 172.21.15.121:0/2386118120 wait complete. 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.779+0000 7f1519806640 1 Processor -- start 2024-09-15T23:56:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1519806640 1 -- start start 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1519806640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1519806640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15140a5220 con 0x7f15140a37b0 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1512ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1512ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38756/0 (socket says 172.21.15.121:38756) 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1512ffd640 1 -- 172.21.15.121:0/600291364 learned_addr learned my addr 172.21.15.121:0/600291364 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1512ffd640 1 -- 172.21.15.121:0/600291364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1514121b10 con 0x7f15140a37b0 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.780+0000 7f1512ffd640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f150400c840 tx=0x7f150400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1504018070 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150400a660 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15141334f0 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f150400a980 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1514120e80 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.781+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f150401b070 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.782+0000 7f14fbfff640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 0x7f150003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.782+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7f150404a850 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.782+0000 7f15127fc640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 0x7f150003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.782+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15140a4020 con 0x7f15140a37b0 2024-09-15T23:56:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.782+0000 7f15127fc640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 0x7f150003a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1508009720 tx=0x7f150802e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:15.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.786+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1514121b10 con 0x7f15140a37b0 2024-09-15T23:56:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.958+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f15140a1ee0 con 0x7f15140a37b0 2024-09-15T23:56:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.960+0000 7f14fbfff640 1 -- 172.21.15.121:0/600291364 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v7)=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f1504011360 con 0x7f15140a37b0 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 msgr2=0x7f150003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 0x7f150003a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1508009720 tx=0x7f150802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 msgr2=0x7f15141215d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f150400c840 tx=0x7f150400cd00 comp rx=0 tx=0).stop 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 shutdown_connections 2024-09-15T23:56:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f15000382a0 0x7f150003a760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 --2- 172.21.15.121:0/600291364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15140a37b0 0x7f15141215d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 >> 172.21.15.121:0/600291364 conn(0x7f15140a8430 msgr2=0x7f1514133cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 shutdown_connections 2024-09-15T23:56:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:15.963+0000 7f1519806640 1 -- 172.21.15.121:0/600291364 wait complete. 2024-09-15T23:56:15.974 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:15.975 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:16.012 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:16.012 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:16.012 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:16.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:56:16.069 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:16.069 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:16.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:56:16.125 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-15T23:56:16.125 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f3200af1640 1 Processor -- start 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f3200af1640 1 -- start start 2024-09-15T23:56:16.263 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f3200af1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31fc135b50 0x7f31fc09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f3200af1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31fc09b020 con 0x7f31fc135f30 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f3200af1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f31fc09b310 con 0x7f31fc135b50 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f31fa59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f31fc135b50 0x7f31fc09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f31f1d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f31fc135f30 0x7f31fc0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38840/0 (socket says 172.21.15.121:38840) 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.262+0000 7f31f1d9b640 1 -- 172.21.15.121:0/396686766 learned_addr learned my addr 172.21.15.121:0/396686766 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31fa59c640 1 -- 172.21.15.121:0/396686766 >> v1:172.21.15.121:6789/0 conn(0x7f31fc135f30 legacy=0x7f31fc0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31fa59c640 1 -- 172.21.15.121:0/396686766 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc0a08c0 con 0x7f31fc135b50 2024-09-15T23:56:16.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31fa59c640 1 --2- 172.21.15.121:0/396686766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc09aae0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009720 tx=0x7f31ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a152f8bb174649b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31f9d9b640 1 -- 172.21.15.121:0/396686766 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec037070 con 0x7f31fc135b50 2024-09-15T23:56:16.265 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31f9d9b640 1 -- 172.21.15.121:0/396686766 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec02ae20 con 0x7f31fc135b50 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.263+0000 7f31f9d9b640 1 -- 172.21.15.121:0/396686766 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec032590 con 0x7f31fc135b50 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 -- 172.21.15.121:0/396686766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 msgr2=0x7f31fc09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 --2- 172.21.15.121:0/396686766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc09aae0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009720 tx=0x7f31ec02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 -- 172.21.15.121:0/396686766 shutdown_connections 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 --2- 172.21.15.121:0/396686766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc09aae0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 -- 172.21.15.121:0/396686766 >> 172.21.15.121:0/396686766 conn(0x7f31fc0a85e0 msgr2=0x7f31fc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 -- 172.21.15.121:0/396686766 shutdown_connections 2024-09-15T23:56:16.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.264+0000 7f3200af1640 1 -- 172.21.15.121:0/396686766 wait complete. 2024-09-15T23:56:16.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.265+0000 7f3200af1640 1 Processor -- start 2024-09-15T23:56:16.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.265+0000 7f3200af1640 1 -- start start 2024-09-15T23:56:16.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f3200af1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f3200af1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc0a5430 con 0x7f31fc135b50 2024-09-15T23:56:16.268 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31fa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31fa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38764/0 (socket says 172.21.15.121:38764) 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31fa59c640 1 -- 172.21.15.121:0/119102122 learned_addr learned my addr 172.21.15.121:0/119102122 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31fa59c640 1 -- 172.21.15.121:0/119102122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc11fe30 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31fa59c640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f31ec02adf0 tx=0x7f31ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec041070 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec03c590 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31fc0a0270 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec037040 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.266+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31fc09ff90 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.267+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f31ec044070 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.267+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31fc136350 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.267+0000 7f31f37fe640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 0x7f31dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.267+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7f31ec06b820 con 0x7f31fc135b50 2024-09-15T23:56:16.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.268+0000 7f31f1d9b640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 0x7f31dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.270 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.268+0000 7f31f1d9b640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 0x7f31dc03a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.272+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31ec02ae20 con 0x7f31fc135b50 2024-09-15T23:56:16.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.474+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31fc0a1f10 con 0x7f31fc135b50 2024-09-15T23:56:16.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.475+0000 7f31f37fe640 1 -- 172.21.15.121:0/119102122 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+2266 (secure 0 0 0) 0x7f31ec03c960 con 0x7f31fc135b50 2024-09-15T23:56:16.476 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:16.476 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":14,"btime":"2024-09-15T23:56:11:191733+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4329,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6828/3697132311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3697132311},{"type":"v1","addr":"172.21.15.121:6828","nonce":3697132311}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":4491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1078840170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1078840170},{"type":"v1","addr":"172.21.15.121:6825","nonce":1078840170}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[]} 2024-09-15T23:56:16.476 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 14 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 msgr2=0x7f31dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 0x7f31dc03a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 msgr2=0x7f31fc1ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f31ec02adf0 tx=0x7f31ec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 shutdown_connections 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f31dc0382a0 0x7f31dc03a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 --2- 172.21.15.121:0/119102122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31fc135b50 0x7f31fc1ce990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 >> 172.21.15.121:0/119102122 conn(0x7f31fc0a85e0 msgr2=0x7f31fc09d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 shutdown_connections 2024-09-15T23:56:16.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.477+0000 7f3200af1640 1 -- 172.21.15.121:0/119102122 wait complete. 2024-09-15T23:56:16.489 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:56:16.490 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:56:16.490 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:56:16.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:16.490 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:56:16.490 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:56:16.490 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:56:16.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:16.499 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:56:16.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:56:16.500 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:56:16.500 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:56:16.544 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:56:16.544 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:16.545 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:56:16.545 DEBUG:teuthology.parallel:result is None 2024-09-15T23:56:16.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:56:16.620 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:56:16.620 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:56:16.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.646+0000 7fe9f08e6640 1 Processor -- start 2024-09-15T23:56:16.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.646+0000 7fe9f08e6640 1 -- start start 2024-09-15T23:56:16.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9f08e6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9ec135b50 0x7fe9ec09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9f08e6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec09b020 con 0x7fe9ec135f30 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9f08e6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec09b310 con 0x7fe9ec135b50 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9ea59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9ec135b50 0x7fe9ec09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9e9d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe9ec135f30 0x7fe9ec0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38858/0 (socket says 172.21.15.121:38858) 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.647+0000 7fe9e9d9b640 1 -- 172.21.15.121:0/3989467838 learned_addr learned my addr 172.21.15.121:0/3989467838 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9ea59c640 1 -- 172.21.15.121:0/3989467838 >> v1:172.21.15.121:6789/0 conn(0x7fe9ec135f30 legacy=0x7fe9ec0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9ea59c640 1 -- 172.21.15.121:0/3989467838 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0a08c0 con 0x7fe9ec135b50 2024-09-15T23:56:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9ea59c640 1 --2- 172.21.15.121:0/3989467838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec09aae0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009d90 tx=0x7fe9e402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c1ef07696543c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9e959a640 1 -- 172.21.15.121:0/3989467838 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4007670 con 0x7fe9ec135b50 2024-09-15T23:56:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9e959a640 1 -- 172.21.15.121:0/3989467838 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4007810 con 0x7fe9ec135b50 2024-09-15T23:56:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.648+0000 7fe9e959a640 1 -- 172.21.15.121:0/3989467838 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4007b10 con 0x7fe9ec135b50 2024-09-15T23:56:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 -- 172.21.15.121:0/3989467838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 msgr2=0x7fe9ec09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/3989467838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec09aae0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009d90 tx=0x7fe9e402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 -- 172.21.15.121:0/3989467838 shutdown_connections 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/3989467838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec09aae0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 -- 172.21.15.121:0/3989467838 >> 172.21.15.121:0/3989467838 conn(0x7fe9ec0a85e0 msgr2=0x7fe9ec0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 -- 172.21.15.121:0/3989467838 shutdown_connections 2024-09-15T23:56:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.649+0000 7fe9f08e6640 1 -- 172.21.15.121:0/3989467838 wait complete. 2024-09-15T23:56:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.650+0000 7fe9f08e6640 1 Processor -- start 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.650+0000 7fe9f08e6640 1 -- start start 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.650+0000 7fe9f08e6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.650+0000 7fe9f08e6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0a5430 con 0x7fe9ec135b50 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9ea59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9ea59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38806/0 (socket says 172.21.15.121:38806) 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9ea59c640 1 -- 172.21.15.121:0/864904641 learned_addr learned my addr 172.21.15.121:0/864904641 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9ea59c640 1 -- 172.21.15.121:0/864904641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec073a00 con 0x7fe9ec135b50 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9ea59c640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009d90 tx=0x7fe9e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4040070 con 0x7fe9ec135b50 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e4031a90 con 0x7fe9ec135b50 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec071a50 con 0x7fe9ec135b50 2024-09-15T23:56:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9e4031d70 con 0x7fe9ec135b50 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.651+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec0a7420 con 0x7fe9ec135b50 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.652+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fe9e4039040 con 0x7fe9ec135b50 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.652+0000 7fe9e2ffd640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 0x7fe9cc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.652+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec06ff50 con 0x7fe9ec135b50 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.652+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 3275+0+0 (secure 0 0 0) 0x7fe9e406ce40 con 0x7fe9ec135b50 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.652+0000 7fe9e9d9b640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 0x7fe9cc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.653+0000 7fe9e9d9b640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 0x7fe9cc03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4007fd0 tx=0x7fe9d4007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:16.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.657+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9e404bd50 con 0x7fe9ec135b50 2024-09-15T23:56:16.837 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:16.836+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe9ec0a1f10 con 0x7fe9ec135b50 2024-09-15T23:56:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.665+0000 7fe9e2ffd640 1 -- 172.21.15.121:0/864904641 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7fe9e4041270 con 0x7fe9ec135b50 2024-09-15T23:56:17.666 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-15T23:56:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 msgr2=0x7fe9cc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 0x7fe9cc03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4007fd0 tx=0x7fe9d4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 msgr2=0x7fe9ec06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009d90 tx=0x7fe9e4004a40 comp rx=0 tx=0).stop 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 shutdown_connections 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe9cc0382a0 0x7fe9cc03a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 --2- 172.21.15.121:0/864904641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9ec135b50 0x7fe9ec06e950 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 >> 172.21.15.121:0/864904641 conn(0x7fe9ec0a85e0 msgr2=0x7fe9ec09de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.668+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 shutdown_connections 2024-09-15T23:56:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.669+0000 7fe9f08e6640 1 -- 172.21.15.121:0/864904641 wait complete. 2024-09-15T23:56:17.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:56:17.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d49d8d640 1 Processor -- start 2024-09-15T23:56:17.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d49d8d640 1 -- start start 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d49d8d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d440a39c0 0x7f9d44132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d49d8d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d440a16c0 con 0x7f9d44133470 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d49d8d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440a1490 con 0x7f9d440a39c0 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d437fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9d440a39c0 0x7f9d44132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d3bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9d44133470 0x7f9d44135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38866/0 (socket says 172.21.15.121:38866) 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.786+0000 7f9d3bfff640 1 -- 172.21.15.121:0/2828324675 learned_addr learned my addr 172.21.15.121:0/2828324675 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.787+0000 7f9d437fe640 1 -- 172.21.15.121:0/2828324675 >> v1:172.21.15.121:6789/0 conn(0x7f9d44133470 legacy=0x7f9d44135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.787+0000 7f9d437fe640 1 -- 172.21.15.121:0/2828324675 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d440a4010 con 0x7f9d440a39c0 2024-09-15T23:56:17.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.787+0000 7f9d42ffd640 1 -- 172.21.15.121:0/2828324675 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473371839 0 0) 0x7f9d440a16c0 con 0x7f9d44133470 2024-09-15T23:56:17.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.787+0000 7f9d437fe640 1 --2- 172.21.15.121:0/2828324675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d44132f30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29152555b27061b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:17.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d42ffd640 1 -- 172.21.15.121:0/2828324675 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34037070 con 0x7f9d440a39c0 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d42ffd640 1 -- 172.21.15.121:0/2828324675 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3402ad90 con 0x7f9d440a39c0 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d42ffd640 1 -- 172.21.15.121:0/2828324675 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34032590 con 0x7f9d440a39c0 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 -- 172.21.15.121:0/2828324675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 msgr2=0x7f9d44132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/2828324675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d44132f30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d3402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 -- 172.21.15.121:0/2828324675 shutdown_connections 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/2828324675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d44132f30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 -- 172.21.15.121:0/2828324675 >> 172.21.15.121:0/2828324675 conn(0x7f9d440a85e0 msgr2=0x7f9d440a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 -- 172.21.15.121:0/2828324675 shutdown_connections 2024-09-15T23:56:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.788+0000 7f9d49d8d640 1 -- 172.21.15.121:0/2828324675 wait complete. 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.789+0000 7f9d49d8d640 1 Processor -- start 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.789+0000 7f9d49d8d640 1 -- start start 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.789+0000 7f9d49d8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d49d8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441329c0 con 0x7f9d440a39c0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38816/0 (socket says 172.21.15.121:38816) 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d437fe640 1 -- 172.21.15.121:0/1652455205 learned_addr learned my addr 172.21.15.121:0/1652455205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d437fe640 1 -- 172.21.15.121:0/1652455205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4406e950 con 0x7f9d440a39c0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d437fe640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34037050 con 0x7f9d440a39c0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d34038040 con 0x7f9d440a39c0 2024-09-15T23:56:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4406ebf0 con 0x7f9d440a39c0 2024-09-15T23:56:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34004180 con 0x7f9d440a39c0 2024-09-15T23:56:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.790+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d44138d50 con 0x7f9d440a39c0 2024-09-15T23:56:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.791+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f9d34004320 con 0x7f9d440a39c0 2024-09-15T23:56:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.791+0000 7f9d40ff9640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.791+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d440a0670 con 0x7f9d440a39c0 2024-09-15T23:56:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.791+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 2587+0+0 (secure 0 0 0) 0x7f9d3406b7b0 con 0x7f9d440a39c0 2024-09-15T23:56:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.791+0000 7f9d3bfff640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.792+0000 7f9d3bfff640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 0x7f9d2403a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c000c00 tx=0x7f9d2c007a40 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:17.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:17.796+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d440a0670 con 0x7f9d440a39c0 2024-09-15T23:56:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.029+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9d441339e0 con 0x7f9d440a39c0 2024-09-15T23:56:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.029+0000 7f9d40ff9640 1 -- 172.21.15.121:0/1652455205 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+2534 (secure 0 0 0) 0x7f9d441339e0 con 0x7f9d440a39c0 2024-09-15T23:56:18.031 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:18.031 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:18.031 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-15T23:56:18.031 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.032 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-15T23:56:18.032 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmrl0yDhAAmges61AkNVATl3fkDcJtCA==", 2024-09-15T23:56:18.032 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.032 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:56:18.032 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.033 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-15T23:56:18.034 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dm1c5EFRAAQjii6dloQtB9r6b+oDUlfA==", 2024-09-15T23:56:18.034 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.034 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:56:18.034 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:56:18.034 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:56:18.035 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.035 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.036 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-15T23:56:18.036 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC+c+dmWS98OBAABYXXLJEiQ32Ch8sOdjmGMQ==", 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDCc+dmae/mKxAAb1MVakHG7AWyXTfjXcC5Ww==", 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.037 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDGc+dm0fWaLRAAVx8jT36dFL/hVkUBD+L4uA==", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.038 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg==", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmOA9CIRAA3IDTN3uPbSBxbM2AFlMv4w==", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:56:18.039 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC7c+dm1qMxNRAAha+qdHw6Albq/4FeBkKFmw==", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmGfgJCxAAO99Xwfzdn6pwAplxw70kOQ==", 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:18.041 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 msgr2=0x7f9d2403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 0x7f9d2403a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c000c00 tx=0x7f9d2c007a40 comp rx=0 tx=0).stop 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 msgr2=0x7f9d4413a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009720 tx=0x7f9d340046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 shutdown_connections 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f9d240382a0 0x7f9d2403a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 --2- 172.21.15.121:0/1652455205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d440a39c0 0x7f9d4413a170 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 >> 172.21.15.121:0/1652455205 conn(0x7f9d440a85e0 msgr2=0x7f9d440a6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 shutdown_connections 2024-09-15T23:56:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.031+0000 7f9d49d8d640 1 -- 172.21.15.121:0/1652455205 wait complete. 2024-09-15T23:56:18.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:56:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.140+0000 7feaf903c640 1 Processor -- start 2024-09-15T23:56:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.140+0000 7feaf903c640 1 -- start start 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf903c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feaf40a39c0 0x7feaf4132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf903c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40a16c0 con 0x7feaf4133470 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf903c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7feaf40a1490 con 0x7feaf40a39c0 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf2d9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feaf40a39c0 0x7feaf4132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7feaf4133470 0x7feaf4135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38874/0 (socket says 172.21.15.121:38874) 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf259c640 1 -- 172.21.15.121:0/158161840 learned_addr learned my addr 172.21.15.121:0/158161840 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf2d9d640 1 -- 172.21.15.121:0/158161840 >> v1:172.21.15.121:6789/0 conn(0x7feaf4133470 legacy=0x7feaf4135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.141+0000 7feaf2d9d640 1 -- 172.21.15.121:0/158161840 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40a4010 con 0x7feaf40a39c0 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.142+0000 7feaf2d9d640 1 --2- 172.21.15.121:0/158161840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf4132f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7feaec009720 tx=0x7feaec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de4cf4d9a39eb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.142+0000 7feaf1d9b640 1 -- 172.21.15.121:0/158161840 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec037070 con 0x7feaf40a39c0 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.142+0000 7feaf1d9b640 1 -- 172.21.15.121:0/158161840 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec02ad90 con 0x7feaf40a39c0 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.142+0000 7feaf1d9b640 1 -- 172.21.15.121:0/158161840 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec032590 con 0x7feaf40a39c0 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 -- 172.21.15.121:0/158161840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 msgr2=0x7feaf4132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 --2- 172.21.15.121:0/158161840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf4132f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7feaec009720 tx=0x7feaec02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 -- 172.21.15.121:0/158161840 shutdown_connections 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 --2- 172.21.15.121:0/158161840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf4132f30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 -- 172.21.15.121:0/158161840 >> 172.21.15.121:0/158161840 conn(0x7feaf40a85e0 msgr2=0x7feaf40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 -- 172.21.15.121:0/158161840 shutdown_connections 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.143+0000 7feaf903c640 1 -- 172.21.15.121:0/158161840 wait complete. 2024-09-15T23:56:18.148 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.144+0000 7feaf903c640 1 Processor -- start 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.144+0000 7feaf903c640 1 -- start start 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.144+0000 7feaf903c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.144+0000 7feaf903c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feaf41329c0 con 0x7feaf40a39c0 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38832/0 (socket says 172.21.15.121:38832) 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf2d9d640 1 -- 172.21.15.121:0/1156478711 learned_addr learned my addr 172.21.15.121:0/1156478711 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf2d9d640 1 -- 172.21.15.121:0/1156478711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf413a6b0 con 0x7feaf40a39c0 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf2d9d640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feaec02ad60 tx=0x7feaec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec041020 con 0x7feaf40a39c0 2024-09-15T23:56:18.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec03d550 con 0x7feaf40a39c0 2024-09-15T23:56:18.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf4139f60 con 0x7feaf40a39c0 2024-09-15T23:56:18.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feaec037040 con 0x7feaf40a39c0 2024-09-15T23:56:18.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.145+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf413df70 con 0x7feaf40a39c0 2024-09-15T23:56:18.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.146+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7feaec044020 con 0x7feaf40a39c0 2024-09-15T23:56:18.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.146+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4138400 con 0x7feaf40a39c0 2024-09-15T23:56:18.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.146+0000 7feadb7fe640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 0x7feae003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.146+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 2587+0+0 (secure 0 0 0) 0x7feaec06b4b0 con 0x7feaf40a39c0 2024-09-15T23:56:18.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.146+0000 7feaf259c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 0x7feae003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.147+0000 7feaf259c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 0x7feae003a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feae8007fd0 tx=0x7feae8007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.151+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaec04b030 con 0x7feaf40a39c0 2024-09-15T23:56:18.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.319+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feaf40a23d0 con 0x7feaf40a39c0 2024-09-15T23:56:18.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.320+0000 7feadb7fe640 1 -- 172.21.15.121:0/1156478711 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7feaf413a6b0 con 0x7feaf40a39c0 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:18.321 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 msgr2=0x7feae003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 0x7feae003a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feae8007fd0 tx=0x7feae8007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 msgr2=0x7feaf409e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feaec02ad60 tx=0x7feaec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 shutdown_connections 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7feae00382a0 0x7feae003a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.321+0000 7feaf903c640 1 --2- 172.21.15.121:0/1156478711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf40a39c0 0x7feaf409e170 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.322+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 >> 172.21.15.121:0/1156478711 conn(0x7feaf40a85e0 msgr2=0x7feaf40a75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.322+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 shutdown_connections 2024-09-15T23:56:18.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.322+0000 7feaf903c640 1 -- 172.21.15.121:0/1156478711 wait complete. 2024-09-15T23:56:18.333 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:56:18.333 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.434+0000 7f61de566640 1 Processor -- start 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.434+0000 7f61de566640 1 -- start start 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61de566640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f61d806dab0 0x7f61d80a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61de566640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d806e410 con 0x7f61d80a7140 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61de566640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f61d806de90 con 0x7f61d806dab0 2024-09-15T23:56:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61d7fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f61d806dab0 0x7f61d80a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61d77fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f61d80a7140 0x7f61d8136990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38888/0 (socket says 172.21.15.121:38888) 2024-09-15T23:56:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61d77fe640 1 -- 172.21.15.121:0/430628191 learned_addr learned my addr 172.21.15.121:0/430628191 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61d7fff640 1 -- 172.21.15.121:0/430628191 >> v1:172.21.15.121:6789/0 conn(0x7f61d80a7140 legacy=0x7f61d8136990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.435+0000 7f61d7fff640 1 -- 172.21.15.121:0/430628191 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80a8140 con 0x7f61d806dab0 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.436+0000 7f61d7fff640 1 --2- 172.21.15.121:0/430628191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d80a6c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009720 tx=0x7f61c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea19df12e8bb463 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.436+0000 7f61d6ffd640 1 -- 172.21.15.121:0/430628191 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8037070 con 0x7f61d806dab0 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.436+0000 7f61d6ffd640 1 -- 172.21.15.121:0/430628191 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c802ad90 con 0x7f61d806dab0 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.436+0000 7f61d6ffd640 1 -- 172.21.15.121:0/430628191 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8032590 con 0x7f61d806dab0 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 -- 172.21.15.121:0/430628191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 msgr2=0x7f61d80a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 --2- 172.21.15.121:0/430628191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d80a6c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009720 tx=0x7f61c802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 -- 172.21.15.121:0/430628191 shutdown_connections 2024-09-15T23:56:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 --2- 172.21.15.121:0/430628191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d80a6c00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 -- 172.21.15.121:0/430628191 >> 172.21.15.121:0/430628191 conn(0x7f61d80ac620 msgr2=0x7f61d80aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 -- 172.21.15.121:0/430628191 shutdown_connections 2024-09-15T23:56:18.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.437+0000 7f61de566640 1 -- 172.21.15.121:0/430628191 wait complete. 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61de566640 1 Processor -- start 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61de566640 1 -- start start 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61de566640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61de566640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80a3c70 con 0x7f61d806dab0 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61d7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38860/0 (socket says 172.21.15.121:38860) 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.438+0000 7f61d7fff640 1 -- 172.21.15.121:0/1016162155 learned_addr learned my addr 172.21.15.121:0/1016162155 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61d7fff640 1 -- 172.21.15.121:0/1016162155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d8123360 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61d7fff640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f61c802a150 tx=0x7f61c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8041070 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8032e30 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d81253d0 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c8037040 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.439+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d80abf60 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f61c8044070 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d80a6c00 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61d4ff9640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 0x7f61c403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 2587+0+0 (secure 0 0 0) 0x7f61c806b9f0 con 0x7f61d806dab0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61d77fe640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 0x7f61c403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.440+0000 7f61d77fe640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 0x7f61c403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000f60 tx=0x7f61cc007a80 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.445+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61c803c7c0 con 0x7f61d806dab0 2024-09-15T23:56:18.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.612+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f61d80a3ee0 con 0x7f61d806dab0 2024-09-15T23:56:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.668+0000 7f61d4ff9640 1 -- 172.21.15.121:0/1016162155 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f61c803cce0 con 0x7f61d806dab0 2024-09-15T23:56:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-15T23:56:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.670+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 msgr2=0x7f61c403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.670+0000 7f61de566640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 0x7f61c403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000f60 tx=0x7f61cc007a80 comp rx=0 tx=0).stop 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.670+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 msgr2=0x7f61d8124c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.670+0000 7f61de566640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f61c802a150 tx=0x7f61c80046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 shutdown_connections 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f61c40382a0 0x7f61c403a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 --2- 172.21.15.121:0/1016162155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d806dab0 0x7f61d8124c90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 >> 172.21.15.121:0/1016162155 conn(0x7f61d80ac620 msgr2=0x7f61d813a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 shutdown_connections 2024-09-15T23:56:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.671+0000 7f61de566640 1 -- 172.21.15.121:0/1016162155 wait complete. 2024-09-15T23:56:18.686 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:56:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.789+0000 7f99b401e640 1 Processor -- start 2024-09-15T23:56:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.789+0000 7f99b401e640 1 -- start start 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b401e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f99ac0a42a0 0x7f99ac09f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b401e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99ac09ce40 con 0x7f99ac0a37b0 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b401e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f99ac09f960 con 0x7f99ac0a42a0 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b15b9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f99ac0a42a0 0x7f99ac09f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b1dba640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f99ac0a37b0 0x7f99ac0a3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38898/0 (socket says 172.21.15.121:38898) 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b15b9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f99ac0a42a0 0x7f99ac09f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38864/0 (socket says 172.21.15.121:38864) 2024-09-15T23:56:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b1dba640 1 -- 172.21.15.121:0/933382080 learned_addr learned my addr 172.21.15.121:0/933382080 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:18.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b15b9640 1 -- 172.21.15.121:0/933382080 >> v1:172.21.15.121:6789/0 conn(0x7f99ac0a37b0 legacy=0x7f99ac0a3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.790+0000 7f99b15b9640 1 -- 172.21.15.121:0/933382080 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac09d7a0 con 0x7f99ac0a42a0 2024-09-15T23:56:18.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b15b9640 1 --2- 172.21.15.121:0/933382080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a42a0 0x7f99ac09f230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f999c009720 tx=0x7f999c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa16b03166bc1579 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b0db8640 1 -- 172.21.15.121:0/933382080 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f999c037070 con 0x7f99ac0a42a0 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b0db8640 1 -- 172.21.15.121:0/933382080 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c02ad90 con 0x7f99ac0a42a0 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b0db8640 1 -- 172.21.15.121:0/933382080 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f999c032590 con 0x7f99ac0a42a0 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 -- 172.21.15.121:0/933382080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a42a0 msgr2=0x7f99ac09f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 --2- 172.21.15.121:0/933382080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a42a0 0x7f99ac09f230 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f999c009720 tx=0x7f999c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 -- 172.21.15.121:0/933382080 shutdown_connections 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 --2- 172.21.15.121:0/933382080 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a42a0 0x7f99ac09f230 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 -- 172.21.15.121:0/933382080 >> 172.21.15.121:0/933382080 conn(0x7f99ac0a8430 msgr2=0x7f99ac0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 -- 172.21.15.121:0/933382080 shutdown_connections 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.791+0000 7f99b401e640 1 -- 172.21.15.121:0/933382080 wait complete. 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.792+0000 7f99b401e640 1 Processor -- start 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.792+0000 7f99b401e640 1 -- start start 2024-09-15T23:56:18.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b401e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b401e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac0a5220 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b1dba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b1dba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38866/0 (socket says 172.21.15.121:38866) 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b1dba640 1 -- 172.21.15.121:0/1623150498 learned_addr learned my addr 172.21.15.121:0/1623150498 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b1dba640 1 -- 172.21.15.121:0/1623150498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac11e620 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b1dba640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c4a0 tx=0x7f99a800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a8017070 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a8005c10 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac11fca0 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99a8007070 con 0x7f99ac0a37b0 2024-09-15T23:56:18.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.793+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac072be0 con 0x7f99ac0a37b0 2024-09-15T23:56:18.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.794+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f99a801a070 con 0x7f99ac0a37b0 2024-09-15T23:56:18.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.794+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ac073570 con 0x7f99ac0a37b0 2024-09-15T23:56:18.797 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.794+0000 7f99a27fc640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 0x7f999003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:18.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.795+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 2957+0+0 (secure 0 0 0) 0x7f99a804a2c0 con 0x7f99ac0a37b0 2024-09-15T23:56:18.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.795+0000 7f99b15b9640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 0x7f999003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:18.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.795+0000 7f99b15b9640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 0x7f999003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f999c034000 tx=0x7f999c02e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.799+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99a80117a0 con 0x7f99ac0a37b0 2024-09-15T23:56:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:18.964+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f99ac09f230 con 0x7f99ac0a37b0 2024-09-15T23:56:19.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.672+0000 7f99a27fc640 1 -- 172.21.15.121:0/1623150498 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f99a801a360 con 0x7f99ac0a37b0 2024-09-15T23:56:19.673 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 msgr2=0x7f999003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 0x7f999003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f999c034000 tx=0x7f999c02e000 comp rx=0 tx=0).stop 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 msgr2=0x7f99ac136bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c4a0 tx=0x7f99a800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 shutdown_connections 2024-09-15T23:56:19.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f99900382a0 0x7f999003a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 --2- 172.21.15.121:0/1623150498 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99ac0a37b0 0x7f99ac136bb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 >> 172.21.15.121:0/1623150498 conn(0x7f99ac0a8430 msgr2=0x7f99ac0a13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:19.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 shutdown_connections 2024-09-15T23:56:19.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.676+0000 7f99b401e640 1 -- 172.21.15.121:0/1623150498 wait complete. 2024-09-15T23:56:19.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:56:19.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe3558ba640 1 Processor -- start 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe3558ba640 1 -- start start 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe3558ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3500a5870 0x7fe3500a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe3558ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3500a53f0 con 0x7fe3500a5c50 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe3558ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe3500a1fc0 con 0x7fe3500a5870 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe34effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3500a5870 0x7fe3500a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe34e7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe3500a5c50 0x7fe350137a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38912/0 (socket says 172.21.15.121:38912) 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe34effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe3500a5870 0x7fe3500a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38872/0 (socket says 172.21.15.121:38872) 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe34e7fc640 1 -- 172.21.15.121:0/384890625 learned_addr learned my addr 172.21.15.121:0/384890625 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.804+0000 7fe34effd640 1 -- 172.21.15.121:0/384890625 >> v1:172.21.15.121:6789/0 conn(0x7fe3500a5c50 legacy=0x7fe350137a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.805+0000 7fe34effd640 1 -- 172.21.15.121:0/384890625 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3500a5670 con 0x7fe3500a5870 2024-09-15T23:56:19.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.805+0000 7fe34effd640 1 --2- 172.21.15.121:0/384890625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe3500a3bc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe340009d90 tx=0x7fe34002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78edf2d7380e3d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.805+0000 7fe34dffb640 1 -- 172.21.15.121:0/384890625 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340007670 con 0x7fe3500a5870 2024-09-15T23:56:19.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.805+0000 7fe34dffb640 1 -- 172.21.15.121:0/384890625 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340007810 con 0x7fe3500a5870 2024-09-15T23:56:19.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.805+0000 7fe34dffb640 1 -- 172.21.15.121:0/384890625 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340007b10 con 0x7fe3500a5870 2024-09-15T23:56:19.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 -- 172.21.15.121:0/384890625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 msgr2=0x7fe3500a3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 --2- 172.21.15.121:0/384890625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe3500a3bc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe340009d90 tx=0x7fe34002a660 comp rx=0 tx=0).stop 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 -- 172.21.15.121:0/384890625 shutdown_connections 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 --2- 172.21.15.121:0/384890625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe3500a3bc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 -- 172.21.15.121:0/384890625 >> 172.21.15.121:0/384890625 conn(0x7fe3500aa380 msgr2=0x7fe3500aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 -- 172.21.15.121:0/384890625 shutdown_connections 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.806+0000 7fe3558ba640 1 -- 172.21.15.121:0/384890625 wait complete. 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.807+0000 7fe3558ba640 1 Processor -- start 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.807+0000 7fe3558ba640 1 -- start start 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.807+0000 7fe3558ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.807+0000 7fe3558ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500a3430 con 0x7fe3500a5870 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe34effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe34effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38874/0 (socket says 172.21.15.121:38874) 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe34effd640 1 -- 172.21.15.121:0/3009299265 learned_addr learned my addr 172.21.15.121:0/3009299265 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:19.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe34effd640 1 -- 172.21.15.121:0/3009299265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350126080 con 0x7fe3500a5870 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe34effd640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe340009d90 tx=0x7fe340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340040070 con 0x7fe3500a5870 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340031a90 con 0x7fe3500a5870 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe350123aa0 con 0x7fe3500a5870 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340031d70 con 0x7fe3500a5870 2024-09-15T23:56:19.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.808+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3501252f0 con 0x7fe3500a5870 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.809+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fe340039040 con 0x7fe3500a5870 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.809+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3500a3bc0 con 0x7fe3500a5870 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.809+0000 7fe347fff640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 0x7fe33003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.809+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 3339+0+0 (secure 0 0 0) 0x7fe34002ae00 con 0x7fe3500a5870 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.809+0000 7fe34e7fc640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 0x7fe33003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:19.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.810+0000 7fe34e7fc640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 0x7fe33003a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe338007fd0 tx=0x7fe338007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:19.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:19.814+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe34003b3b0 con 0x7fe3500a5870 2024-09-15T23:56:20.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.013+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe350125920 con 0x7fe3500a5870 2024-09-15T23:56:20.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.678+0000 7fe347fff640 1 -- 172.21.15.121:0/3009299265 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v16) ==== 172+0+0 (secure 0 0 0) 0x7fe340044e70 con 0x7fe3500a5870 2024-09-15T23:56:20.684 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 6 and data pool 7 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 msgr2=0x7fe33003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 0x7fe33003a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe338007fd0 tx=0x7fe338007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 msgr2=0x7fe350121b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe340009d90 tx=0x7fe340004a40 comp rx=0 tx=0).stop 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 shutdown_connections 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fe3300382a0 0x7fe33003a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 --2- 172.21.15.121:0/3009299265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe3500a5870 0x7fe350121b20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.688+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 >> 172.21.15.121:0/3009299265 conn(0x7fe3500aa380 msgr2=0x7fe3500a7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:20.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.689+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 shutdown_connections 2024-09-15T23:56:20.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.689+0000 7fe3558ba640 1 -- 172.21.15.121:0/3009299265 wait complete. 2024-09-15T23:56:20.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f011e311640 1 Processor -- start 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f011e311640 1 -- start start 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f011e311640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f011809ee30 0x7f011813ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f011e311640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180a2280 con 0x7f01180a39c0 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f011e311640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f011809e6e0 con 0x7f011809ee30 2024-09-15T23:56:20.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f01177fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f011809ee30 0x7f011813ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:20.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f0117fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f01180a39c0 0x7f01180a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38926/0 (socket says 172.21.15.121:38926) 2024-09-15T23:56:20.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.816+0000 7f0117fff640 1 -- 172.21.15.121:0/4026261853 learned_addr learned my addr 172.21.15.121:0/4026261853 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:20.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f01177fe640 1 -- 172.21.15.121:0/4026261853 >> v1:172.21.15.121:6789/0 conn(0x7f01180a39c0 legacy=0x7f01180a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f01177fe640 1 -- 172.21.15.121:0/4026261853 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011809e3d0 con 0x7f011809ee30 2024-09-15T23:56:20.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f0116ffd640 1 -- 172.21.15.121:0/4026261853 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346713857 0 0) 0x7f01180a2280 con 0x7f01180a39c0 2024-09-15T23:56:20.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f01177fe640 1 --2- 172.21.15.121:0/4026261853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f011813ced0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f010c009720 tx=0x7f010c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80229924be9cc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:20.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f0116ffd640 1 -- 172.21.15.121:0/4026261853 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c037070 con 0x7f011809ee30 2024-09-15T23:56:20.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f0116ffd640 1 -- 172.21.15.121:0/4026261853 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c02ad90 con 0x7f011809ee30 2024-09-15T23:56:20.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.817+0000 7f0116ffd640 1 -- 172.21.15.121:0/4026261853 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f010c032590 con 0x7f011809ee30 2024-09-15T23:56:20.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 -- 172.21.15.121:0/4026261853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 msgr2=0x7f011813ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 --2- 172.21.15.121:0/4026261853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f011813ced0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f010c009720 tx=0x7f010c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 -- 172.21.15.121:0/4026261853 shutdown_connections 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 --2- 172.21.15.121:0/4026261853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f011813ced0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 -- 172.21.15.121:0/4026261853 >> 172.21.15.121:0/4026261853 conn(0x7f01180a85e0 msgr2=0x7f01180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 -- 172.21.15.121:0/4026261853 shutdown_connections 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.818+0000 7f011e311640 1 -- 172.21.15.121:0/4026261853 wait complete. 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.819+0000 7f011e311640 1 Processor -- start 2024-09-15T23:56:20.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.819+0000 7f011e311640 1 -- start start 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.819+0000 7f011e311640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.819+0000 7f011e311640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01180a1ed0 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0117fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0117fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38894/0 (socket says 172.21.15.121:38894) 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0117fff640 1 -- 172.21.15.121:0/1310765270 learned_addr learned my addr 172.21.15.121:0/1310765270 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0117fff640 1 -- 172.21.15.121:0/1310765270 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01180737c0 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0117fff640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f010800c420 tx=0x7f010800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0108018070 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080074d0 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0118071230 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0108004950 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.820+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011809c740 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.821+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f010801b070 con 0x7f011809ee30 2024-09-15T23:56:20.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.821+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118073990 con 0x7f011809ee30 2024-09-15T23:56:20.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.821+0000 7f0114ff9640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 0x7f010403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:20.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.821+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 3439+0+0 (secure 0 0 0) 0x7f010804a620 con 0x7f011809ee30 2024-09-15T23:56:20.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.821+0000 7f01177fe640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 0x7f010403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:20.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.822+0000 7f01177fe640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 0x7f010403a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f010c034000 tx=0x7f010c02e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:20.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.826+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0108011960 con 0x7f011809ee30 2024-09-15T23:56:20.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.991+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f011806bde0 con 0x7f011809ee30 2024-09-15T23:56:20.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.992+0000 7f0114ff9640 1 -- 172.21.15.121:0/1310765270 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+10688 (secure 0 0 0) 0x7f0108011bc0 con 0x7f011809ee30 2024-09-15T23:56:20.993 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:20.993 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":38,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:20.014224+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 msgr2=0x7f010403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 0x7f010403a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f010c034000 tx=0x7f010c02e000 comp rx=0 tx=0).stop 2024-09-15T23:56:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 msgr2=0x7f0118070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:20.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f010800c420 tx=0x7f010800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 shutdown_connections 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f01040382a0 0x7f010403a760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 --2- 172.21.15.121:0/1310765270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f011809ee30 0x7f0118070680 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 >> 172.21.15.121:0/1310765270 conn(0x7f01180a85e0 msgr2=0x7f0118134d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 shutdown_connections 2024-09-15T23:56:20.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:20.994+0000 7f011e311640 1 -- 172.21.15.121:0/1310765270 wait complete. 2024-09-15T23:56:21.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:21.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.103+0000 7f70c959f640 1 Processor -- start 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.103+0000 7f70c959f640 1 -- start start 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c959f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70c406d7b0 0x7f70c409d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c959f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c406eac0 con 0x7f70c406ccc0 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c959f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f70c409ced0 con 0x7f70c406d7b0 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70c406d7b0 0x7f70c409d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c2ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f70c406ccc0 0x7f70c406d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38932/0 (socket says 172.21.15.121:38932) 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c2ffd640 1 -- 172.21.15.121:0/1019356175 learned_addr learned my addr 172.21.15.121:0/1019356175 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c27fc640 1 -- 172.21.15.121:0/1019356175 >> v1:172.21.15.121:6789/0 conn(0x7f70c406ccc0 legacy=0x7f70c406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.104+0000 7f70c27fc640 1 -- 172.21.15.121:0/1019356175 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c406e270 con 0x7f70c406d7b0 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c27fc640 1 --2- 172.21.15.121:0/1019356175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406d7b0 0x7f70c409d6c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009720 tx=0x7f70b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22575f04a313f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c1ffb640 1 -- 172.21.15.121:0/1019356175 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b8037070 con 0x7f70c406d7b0 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c1ffb640 1 -- 172.21.15.121:0/1019356175 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b802ad90 con 0x7f70c406d7b0 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c1ffb640 1 -- 172.21.15.121:0/1019356175 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b8032590 con 0x7f70c406d7b0 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 -- 172.21.15.121:0/1019356175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406d7b0 msgr2=0x7f70c409d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 --2- 172.21.15.121:0/1019356175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406d7b0 0x7f70c409d6c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009720 tx=0x7f70b802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 -- 172.21.15.121:0/1019356175 shutdown_connections 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 --2- 172.21.15.121:0/1019356175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406d7b0 0x7f70c409d6c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 -- 172.21.15.121:0/1019356175 >> 172.21.15.121:0/1019356175 conn(0x7f70c4071aa0 msgr2=0x7f70c409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 -- 172.21.15.121:0/1019356175 shutdown_connections 2024-09-15T23:56:21.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.105+0000 7f70c959f640 1 -- 172.21.15.121:0/1019356175 wait complete. 2024-09-15T23:56:21.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.106+0000 7f70c959f640 1 Processor -- start 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.106+0000 7f70c959f640 1 -- start start 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c959f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c959f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70c409cc10 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38912/0 (socket says 172.21.15.121:38912) 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c2ffd640 1 -- 172.21.15.121:0/4222196263 learned_addr learned my addr 172.21.15.121:0/4222196263 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c2ffd640 1 -- 172.21.15.121:0/4222196263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40aa630 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c2ffd640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c4a0 tx=0x7f70b400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b4017070 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4005c10 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c40a9250 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.107+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70b4007070 con 0x7f70c406ccc0 2024-09-15T23:56:21.110 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.108+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c413e590 con 0x7f70c406ccc0 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.108+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f70b401a070 con 0x7f70c406ccc0 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.108+0000 7f70ab7fe640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 0x7f70b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.109+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 3439+0+0 (secure 0 0 0) 0x7f70b404a4c0 con 0x7f70c406ccc0 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.109+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c409d6c0 con 0x7f70c406ccc0 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.109+0000 7f70c27fc640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 0x7f70b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.109+0000 7f70c27fc640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 0x7f70b003a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70b8034000 tx=0x7f70b802e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.113+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70b401b3b0 con 0x7f70c406ccc0 2024-09-15T23:56:21.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.278+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70c406bde0 con 0x7f70c406ccc0 2024-09-15T23:56:21.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.279+0000 7f70ab7fe640 1 -- 172.21.15.121:0/4222196263 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+10688 (secure 0 0 0) 0x7f70b4010c00 con 0x7f70c406ccc0 2024-09-15T23:56:21.280 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:21.280 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":38,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:20.014224+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:21.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 msgr2=0x7f70b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 0x7f70b003a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70b8034000 tx=0x7f70b802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 msgr2=0x7f70c41ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c4a0 tx=0x7f70b400c960 comp rx=0 tx=0).stop 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 shutdown_connections 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70b00382a0 0x7f70b003a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 --2- 172.21.15.121:0/4222196263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70c406ccc0 0x7f70c41ce840 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 >> 172.21.15.121:0/4222196263 conn(0x7f70c4071aa0 msgr2=0x7f70c413a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.281+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 shutdown_connections 2024-09-15T23:56:21.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.282+0000 7f70c959f640 1 -- 172.21.15.121:0/4222196263 wait complete. 2024-09-15T23:56:21.294 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:56:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.395+0000 7effdbc47640 1 Processor -- start 2024-09-15T23:56:21.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.395+0000 7effdbc47640 1 -- start start 2024-09-15T23:56:21.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effdbc47640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7effd40a3b90 0x7effd40a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effdbc47640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd40a4560 con 0x7effd40a37b0 2024-09-15T23:56:21.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effdbc47640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7effd409b4f0 con 0x7effd40a3b90 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effd91e2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7effd40a3b90 0x7effd40a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effd99e3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7effd40a37b0 0x7effd409acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38944/0 (socket says 172.21.15.121:38944) 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effd99e3640 1 -- 172.21.15.121:0/2688263048 learned_addr learned my addr 172.21.15.121:0/2688263048 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effd91e2640 1 -- 172.21.15.121:0/2688263048 >> v1:172.21.15.121:6789/0 conn(0x7effd40a37b0 legacy=0x7effd409acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.396+0000 7effd91e2640 1 -- 172.21.15.121:0/2688263048 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd40a1c90 con 0x7effd40a3b90 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effd91e2640 1 --2- 172.21.15.121:0/2688263048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a3b90 0x7effd40a4020 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7effc8009720 tx=0x7effc802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9b5ac07a5cb24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effd89e1640 1 -- 172.21.15.121:0/2688263048 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8037070 con 0x7effd40a3b90 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effd89e1640 1 -- 172.21.15.121:0/2688263048 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc802ad90 con 0x7effd40a3b90 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effd89e1640 1 -- 172.21.15.121:0/2688263048 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc8032590 con 0x7effd40a3b90 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effdbc47640 1 -- 172.21.15.121:0/2688263048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a3b90 msgr2=0x7effd40a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.397+0000 7effdbc47640 1 --2- 172.21.15.121:0/2688263048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a3b90 0x7effd40a4020 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7effc8009720 tx=0x7effc802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 -- 172.21.15.121:0/2688263048 shutdown_connections 2024-09-15T23:56:21.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 --2- 172.21.15.121:0/2688263048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a3b90 0x7effd40a4020 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 -- 172.21.15.121:0/2688263048 >> 172.21.15.121:0/2688263048 conn(0x7effd40a8430 msgr2=0x7effd40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:21.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 -- 172.21.15.121:0/2688263048 shutdown_connections 2024-09-15T23:56:21.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 -- 172.21.15.121:0/2688263048 wait complete. 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.398+0000 7effdbc47640 1 Processor -- start 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effdbc47640 1 -- start start 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effdbc47640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effdbc47640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7effd40a5220 con 0x7effd40a37b0 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effd99e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effd99e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38928/0 (socket says 172.21.15.121:38928) 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effd99e3640 1 -- 172.21.15.121:0/2185776357 learned_addr learned my addr 172.21.15.121:0/2185776357 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:21.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effd99e3640 1 -- 172.21.15.121:0/2185776357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd4135c40 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.399+0000 7effd99e3640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c4a0 tx=0x7effcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effcc017070 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc005c10 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd4071e60 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effcc007070 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd40712b0 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.400+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7effcc01a070 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.401+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd4071c80 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.401+0000 7effd27fc640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 0x7effc003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.401+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 3439+0+0 (secure 0 0 0) 0x7effcc04a4c0 con 0x7effd40a37b0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.401+0000 7effd91e2640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 0x7effc003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.403 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.401+0000 7effd91e2640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 0x7effc003a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effc8009720 tx=0x7effc802e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.406 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.405+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effd4071c80 con 0x7effd40a37b0 2024-09-15T23:56:21.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.605+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7effd40a4020 con 0x7effd40a37b0 2024-09-15T23:56:21.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.678+0000 7effd27fc640 1 -- 172.21.15.121:0/2185776357 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7effcc01b3b0 con 0x7effd40a37b0 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 msgr2=0x7effc003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 0x7effc003a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effc8009720 tx=0x7effc802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 msgr2=0x7effd40703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c4a0 tx=0x7effcc00c960 comp rx=0 tx=0).stop 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 shutdown_connections 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7effc00382a0 0x7effc003a760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 --2- 172.21.15.121:0/2185776357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effd40a37b0 0x7effd40703b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 >> 172.21.15.121:0/2185776357 conn(0x7effd40a8430 msgr2=0x7effd41bcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 shutdown_connections 2024-09-15T23:56:21.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.680+0000 7effdbc47640 1 -- 172.21.15.121:0/2185776357 wait complete. 2024-09-15T23:56:21.694 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:56:21.694 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:56:21.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.793+0000 7fa1dd6dd640 1 Processor -- start 2024-09-15T23:56:21.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.793+0000 7fa1dd6dd640 1 -- start start 2024-09-15T23:56:21.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1dd6dd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa1d80a4ab0 0x7fa1d813eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1dd6dd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d80a6d10 con 0x7fa1d80a7140 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1dd6dd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d806e230 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1ce7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa1d80a4ab0 0x7fa1d813eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1d6ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa1d80a7140 0x7fa1d80a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:38954/0 (socket says 172.21.15.121:38954) 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1d6ffd640 1 -- 172.21.15.121:0/3247503642 learned_addr learned my addr 172.21.15.121:0/3247503642 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1ce7fc640 1 -- 172.21.15.121:0/3247503642 >> v1:172.21.15.121:6789/0 conn(0x7fa1d80a7140 legacy=0x7fa1d80a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1ce7fc640 1 -- 172.21.15.121:0/3247503642 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d80a3ae0 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.796 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.794+0000 7fa1d67fc640 1 -- 172.21.15.121:0/3247503642 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031825402 0 0) 0x7fa1d80a6d10 con 0x7fa1d80a7140 2024-09-15T23:56:21.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.795+0000 7fa1ce7fc640 1 --2- 172.21.15.121:0/3247503642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d813eef0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009720 tx=0x7fa1c002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba6e08c6342681 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.795+0000 7fa1d67fc640 1 -- 172.21.15.121:0/3247503642 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0037070 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.795+0000 7fa1d67fc640 1 -- 172.21.15.121:0/3247503642 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c002ad90 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.795+0000 7fa1d67fc640 1 -- 172.21.15.121:0/3247503642 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0032590 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/3247503642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 msgr2=0x7fa1d813eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/3247503642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d813eef0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009720 tx=0x7fa1c002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/3247503642 shutdown_connections 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/3247503642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d813eef0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/3247503642 >> 172.21.15.121:0/3247503642 conn(0x7fa1d80ac370 msgr2=0x7fa1d80ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/3247503642 shutdown_connections 2024-09-15T23:56:21.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.796+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/3247503642 wait complete. 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1dd6dd640 1 Processor -- start 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1dd6dd640 1 -- start start 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1dd6dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1dd6dd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80a7fc0 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38946/0 (socket says 172.21.15.121:38946) 2024-09-15T23:56:21.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.797+0000 7fa1d6ffd640 1 -- 172.21.15.121:0/1510173319 learned_addr learned my addr 172.21.15.121:0/1510173319 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1d6ffd640 1 -- 172.21.15.121:0/1510173319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d809f2d0 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1d6ffd640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c420 tx=0x7fa1c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c8018070 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80074d0 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d8137000 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c8004950 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.798+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d809e590 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fa1c801b070 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d809e870 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1cffff640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 0x7fa1b803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7fa1c804a550 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1ce7fc640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 0x7fa1b803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:21.803 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.799+0000 7fa1ce7fc640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 0x7fa1b803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0034000 tx=0x7fa1c002e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:21.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:21.804+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1c80119b0 con 0x7fa1d80a4ab0 2024-09-15T23:56:21.967 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-15T23:56:21.966+0000 7f050ea7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:22.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.002+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa1d80a1360 con 0x7fa1d80a4ab0 2024-09-15T23:56:22.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.686+0000 7fa1cffff640 1 -- 172.21.15.121:0/1510173319 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fa1c8011c10 con 0x7fa1d80a4ab0 2024-09-15T23:56:22.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 msgr2=0x7fa1b803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:22.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 0x7fa1b803a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0034000 tx=0x7fa1c002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:22.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 msgr2=0x7fa1d80a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:22.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c420 tx=0x7fa1c800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 shutdown_connections 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa1b80382a0 0x7fa1b803a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 --2- 172.21.15.121:0/1510173319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1d80a4ab0 0x7fa1d80a0e20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 >> 172.21.15.121:0/1510173319 conn(0x7fa1d80ac370 msgr2=0x7fa1d81374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 shutdown_connections 2024-09-15T23:56:22.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.688+0000 7fa1dd6dd640 1 -- 172.21.15.121:0/1510173319 wait complete. 2024-09-15T23:56:22.702 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:56:22.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:22.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.801+0000 7f23f832c640 1 Processor -- start 2024-09-15T23:56:22.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.801+0000 7f23f832c640 1 -- start start 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f832c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23f013a280 0x7f23f013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f832c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f013a080 con 0x7f23f00a4c20 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f832c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f23f00a3d50 con 0x7f23f013a280 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f60c8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f23f013a280 0x7f23f013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f58c7640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f23f00a4c20 0x7f23f00a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56806/0 (socket says 172.21.15.121:56806) 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f58c7640 1 -- 172.21.15.121:0/1725826152 learned_addr learned my addr 172.21.15.121:0/1725826152 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:22.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f60c8640 1 -- 172.21.15.121:0/1725826152 >> v1:172.21.15.121:6789/0 conn(0x7f23f00a4c20 legacy=0x7f23f00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f60c8640 1 -- 172.21.15.121:0/1725826152 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00a3f80 con 0x7f23f013a280 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.802+0000 7f23f50c6640 1 -- 172.21.15.121:0/1725826152 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97570181 0 0) 0x7f23f013a080 con 0x7f23f00a4c20 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.803+0000 7f23f60c8640 1 --2- 172.21.15.121:0/1725826152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f013a280 0x7f23f013a660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009720 tx=0x7f23ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11beb855b99d5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.803+0000 7f23f50c6640 1 -- 172.21.15.121:0/1725826152 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec037070 con 0x7f23f013a280 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.803+0000 7f23f50c6640 1 -- 172.21.15.121:0/1725826152 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec02ad90 con 0x7f23f013a280 2024-09-15T23:56:22.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.803+0000 7f23f50c6640 1 -- 172.21.15.121:0/1725826152 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec032590 con 0x7f23f013a280 2024-09-15T23:56:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 -- 172.21.15.121:0/1725826152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f013a280 msgr2=0x7f23f013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 --2- 172.21.15.121:0/1725826152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f013a280 0x7f23f013a660 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009720 tx=0x7f23ec02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 -- 172.21.15.121:0/1725826152 shutdown_connections 2024-09-15T23:56:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 --2- 172.21.15.121:0/1725826152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f013a280 0x7f23f013a660 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:22.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 -- 172.21.15.121:0/1725826152 >> 172.21.15.121:0/1725826152 conn(0x7f23f00ac3e0 msgr2=0x7f23f00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 -- 172.21.15.121:0/1725826152 shutdown_connections 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.804+0000 7f23f832c640 1 -- 172.21.15.121:0/1725826152 wait complete. 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f832c640 1 Processor -- start 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f832c640 1 -- start start 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f832c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f832c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f23f0139d40 con 0x7f23f00a4c20 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f60c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f60c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45980/0 (socket says 172.21.15.121:45980) 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.805+0000 7f23f60c8640 1 -- 172.21.15.121:0/2937238859 learned_addr learned my addr 172.21.15.121:0/2937238859 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23f60c8640 1 -- 172.21.15.121:0/2937238859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f0124fa0 con 0x7f23f00a4c20 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23f60c8640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009720 tx=0x7f23ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec041070 con 0x7f23f00a4c20 2024-09-15T23:56:22.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec03c460 con 0x7f23f00a4c20 2024-09-15T23:56:22.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23ec037040 con 0x7f23f00a4c20 2024-09-15T23:56:22.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f0137fd0 con 0x7f23f00a4c20 2024-09-15T23:56:22.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.806+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f01228e0 con 0x7f23f00a4c20 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f23ec044070 con 0x7f23f00a4c20 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f006dab0 con 0x7f23f00a4c20 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23e2ffd640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 0x7f23d403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f23ec06bca0 con 0x7f23f00a4c20 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23f58c7640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 0x7f23d403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:22.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.807+0000 7f23f58c7640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 0x7f23d403a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4007a40 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:22.812 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:22.812+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23ec03bdd0 con 0x7f23f00a4c20 2024-09-15T23:56:23.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.008+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23f00a2f50 con 0x7f23f00a4c20 2024-09-15T23:56:23.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.009+0000 7f23e2ffd640 1 -- 172.21.15.121:0/2937238859 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3573 (secure 0 0 0) 0x7f23ec03a520 con 0x7f23f00a4c20 2024-09-15T23:56:23.010 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:23.010 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-15T23:56:22:681699+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3}]} 2024-09-15T23:56:23.010 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 msgr2=0x7f23d403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 0x7f23d403a760 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4007a40 comp rx=0 tx=0).stop 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 msgr2=0x7f23f00a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009720 tx=0x7f23ec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 shutdown_connections 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f23d40382a0 0x7f23d403a760 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 --2- 172.21.15.121:0/2937238859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23f00a4c20 0x7f23f00a1020 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 >> 172.21.15.121:0/2937238859 conn(0x7f23f00ac3e0 msgr2=0x7f23f00aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 shutdown_connections 2024-09-15T23:56:23.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.011+0000 7f23f832c640 1 -- 172.21.15.121:0/2937238859 wait complete. 2024-09-15T23:56:23.023 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:23.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.119+0000 7f711537f640 1 Processor -- start 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.119+0000 7f711537f640 1 -- start start 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.119+0000 7f711537f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f711013a020 0x7f71100a3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.119+0000 7f711537f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711006c390 con 0x7f711013a400 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.119+0000 7f711537f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f71100a3de0 con 0x7f711013a020 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.120+0000 7f710effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f711013a020 0x7f71100a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.120+0000 7f7107fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f711013a400 0x7f711009ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56822/0 (socket says 172.21.15.121:56822) 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.120+0000 7f7107fff640 1 -- 172.21.15.121:0/2343639688 learned_addr learned my addr 172.21.15.121:0/2343639688 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.120+0000 7f710effd640 1 -- 172.21.15.121:0/2343639688 >> v1:172.21.15.121:6789/0 conn(0x7f711013a400 legacy=0x7f711009ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.120+0000 7f710effd640 1 -- 172.21.15.121:0/2343639688 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71100a51e0 con 0x7f711013a020 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f710effd640 1 --2- 172.21.15.121:0/2343639688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f71100a3080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7100009720 tx=0x7f710002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5ae4d23f5fa52d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f710e7fc640 1 -- 172.21.15.121:0/2343639688 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7100037070 con 0x7f711013a020 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f710e7fc640 1 -- 172.21.15.121:0/2343639688 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710002ad90 con 0x7f711013a020 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f710e7fc640 1 -- 172.21.15.121:0/2343639688 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7100032590 con 0x7f711013a020 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 -- 172.21.15.121:0/2343639688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 msgr2=0x7f71100a3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 --2- 172.21.15.121:0/2343639688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f71100a3080 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7100009720 tx=0x7f710002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 -- 172.21.15.121:0/2343639688 shutdown_connections 2024-09-15T23:56:23.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 --2- 172.21.15.121:0/2343639688 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f71100a3080 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 -- 172.21.15.121:0/2343639688 >> 172.21.15.121:0/2343639688 conn(0x7f71100a90f0 msgr2=0x7f71100a9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 -- 172.21.15.121:0/2343639688 shutdown_connections 2024-09-15T23:56:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.121+0000 7f711537f640 1 -- 172.21.15.121:0/2343639688 wait complete. 2024-09-15T23:56:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.122+0000 7f711537f640 1 Processor -- start 2024-09-15T23:56:23.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.122+0000 7f711537f640 1 -- start start 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f711537f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f711537f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71100a4c10 con 0x7f711013a020 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f710effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f710effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45992/0 (socket says 172.21.15.121:45992) 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f710effd640 1 -- 172.21.15.121:0/2777751166 learned_addr learned my addr 172.21.15.121:0/2777751166 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f710effd640 1 -- 172.21.15.121:0/2777751166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7110124ee0 con 0x7f711013a020 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f710effd640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7100009840 tx=0x7f71000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7100041020 con 0x7f711013a020 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710003d550 con 0x7f711013a020 2024-09-15T23:56:23.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7100037040 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7110124790 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.123+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71100a1cb0 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.124+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f7100044020 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.124+0000 7f71077fe640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 0x7f70f003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.124+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711013a8d0 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.124+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f710006b8b0 con 0x7f711013a020 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.124+0000 7f7107fff640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 0x7f70f003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.127 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.125+0000 7f7107fff640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 0x7f70f003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.130 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.129+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f710004b030 con 0x7f711013a020 2024-09-15T23:56:23.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.295+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7110139be0 con 0x7f711013a020 2024-09-15T23:56:23.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.296+0000 7f71077fe640 1 -- 172.21.15.121:0/2777751166 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+10675 (secure 0 0 0) 0x7f7110124ee0 con 0x7f711013a020 2024-09-15T23:56:23.297 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:23.297 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":39,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:21.678516+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:23.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 msgr2=0x7f70f003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 0x7f70f003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 msgr2=0x7f7110120d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7100009840 tx=0x7f71000046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 shutdown_connections 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f70f00382a0 0x7f70f003a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 --2- 172.21.15.121:0/2777751166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f711013a020 0x7f7110120d50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 >> 172.21.15.121:0/2777751166 conn(0x7f71100a90f0 msgr2=0x7f7110138490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 shutdown_connections 2024-09-15T23:56:23.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.298+0000 7f711537f640 1 -- 172.21.15.121:0/2777751166 wait complete. 2024-09-15T23:56:23.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:56:23.310 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:23.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7fede200a640 1 Processor -- start 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7fede200a640 1 -- start start 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7fede200a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feddc135b50 0x7feddc09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7fede200a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feddc09b020 con 0x7feddc135f30 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7fede200a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7feddc09b310 con 0x7feddc135b50 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7feddb7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7feddc135b50 0x7feddc09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7feddaffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7feddc135f30 0x7feddc0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56826/0 (socket says 172.21.15.121:56826) 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.408+0000 7feddaffd640 1 -- 172.21.15.121:0/2691251683 learned_addr learned my addr 172.21.15.121:0/2691251683 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7feddb7fe640 1 -- 172.21.15.121:0/2691251683 >> v1:172.21.15.121:6789/0 conn(0x7feddc135f30 legacy=0x7feddc0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7feddb7fe640 1 -- 172.21.15.121:0/2691251683 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc0a08c0 con 0x7feddc135b50 2024-09-15T23:56:23.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7fedda7fc640 1 -- 172.21.15.121:0/2691251683 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428922817 0 0) 0x7feddc09b020 con 0x7feddc135f30 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7feddb7fe640 1 --2- 172.21.15.121:0/2691251683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc09aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009720 tx=0x7fedcc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c66c18bead7a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7fedda7fc640 1 -- 172.21.15.121:0/2691251683 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc037070 con 0x7feddc135b50 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7fedda7fc640 1 -- 172.21.15.121:0/2691251683 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc02ae20 con 0x7feddc135b50 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.409+0000 7fedda7fc640 1 -- 172.21.15.121:0/2691251683 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc032590 con 0x7feddc135b50 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 -- 172.21.15.121:0/2691251683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 msgr2=0x7feddc09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 --2- 172.21.15.121:0/2691251683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc09aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009720 tx=0x7fedcc02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 -- 172.21.15.121:0/2691251683 shutdown_connections 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 --2- 172.21.15.121:0/2691251683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc09aae0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 -- 172.21.15.121:0/2691251683 >> 172.21.15.121:0/2691251683 conn(0x7feddc0a85e0 msgr2=0x7feddc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 -- 172.21.15.121:0/2691251683 shutdown_connections 2024-09-15T23:56:23.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.410+0000 7fede200a640 1 -- 172.21.15.121:0/2691251683 wait complete. 2024-09-15T23:56:23.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.411+0000 7fede200a640 1 Processor -- start 2024-09-15T23:56:23.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.411+0000 7fede200a640 1 -- start start 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.411+0000 7fede200a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.411+0000 7fede200a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feddc0a5430 con 0x7feddc135b50 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7feddb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45998/0 (socket says 172.21.15.121:45998) 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7feddb7fe640 1 -- 172.21.15.121:0/3141051147 learned_addr learned my addr 172.21.15.121:0/3141051147 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7feddb7fe640 1 -- 172.21.15.121:0/3141051147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc073200 con 0x7feddc135b50 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7feddb7fe640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fedcc035040 tx=0x7fedcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc037040 con 0x7feddc135b50 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc004160 con 0x7feddc135b50 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc073ae0 con 0x7feddc135b50 2024-09-15T23:56:23.415 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc004440 con 0x7feddc135b50 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.412+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc0a4830 con 0x7feddc135b50 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.413+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fedcc03a070 con 0x7feddc135b50 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.413+0000 7fedc3fff640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 0x7fedc803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.413+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7fedcc06b8b0 con 0x7feddc135b50 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.413+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc11f410 con 0x7feddc135b50 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.413+0000 7feddaffd640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 0x7fedc803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.416 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.414+0000 7feddaffd640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 0x7fedc803a710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd0007910 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.418+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedcc02ae20 con 0x7feddc135b50 2024-09-15T23:56:23.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.580+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 --> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feddc11eb80 con 0x7fedc8038250 2024-09-15T23:56:23.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.586+0000 7fedc3fff640 1 -- 172.21.15.121:0/3141051147 <== mgr.4466 v2:172.21.15.121:6827/1410518606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245911 (secure 0 0 0) 0x7feddc11eb80 con 0x7fedc8038250 2024-09-15T23:56:23.590 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:23.591 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:56:23.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 msgr2=0x7fedc803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 0x7fedc803a710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd0007910 comp rx=0 tx=0).stop 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 msgr2=0x7feddc13cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fedcc035040 tx=0x7fedcc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 shutdown_connections 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fedc8038250 0x7fedc803a710 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 --2- 172.21.15.121:0/3141051147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feddc135b50 0x7feddc13cb90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 >> 172.21.15.121:0/3141051147 conn(0x7feddc0a85e0 msgr2=0x7feddc0a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 shutdown_connections 2024-09-15T23:56:23.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.589+0000 7fede200a640 1 -- 172.21.15.121:0/3141051147 wait complete. 2024-09-15T23:56:23.600 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-15T23:56:22.349956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":221,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87428,"kb_used_data":2172,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028092,"statfs":{"total":289910292480,"available":289820766208,"internally_reserved":0,"allocated":2224128,"data_stored":1550025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000795"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712392+0000","last_change":"2024-09-15T23:56:20.704497+0000","last_active":"2024-09-15T23:56:20.712392+0000","last_peered":"2024-09-15T23:56:20.712392+0000","last_clean":"2024-09-15T23:56:20.712392+0000","last_became_active":"2024-09-15T23:56:20.703942+0000","last_became_peered":"2024-09-15T23:56:20.703942+0000","last_unstale":"2024-09-15T23:56:20.712392+0000","last_undegraded":"2024-09-15T23:56:20.712392+0000","last_fullsized":"2024-09-15T23:56:20.712392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:09.066332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722146+0000","last_change":"2024-09-15T23:56:20.715838+0000","last_active":"2024-09-15T23:56:20.722146+0000","last_peered":"2024-09-15T23:56:20.722146+0000","last_clean":"2024-09-15T23:56:20.722146+0000","last_became_active":"2024-09-15T23:56:20.715553+0000","last_became_peered":"2024-09-15T23:56:20.715553+0000","last_unstale":"2024-09-15T23:56:20.722146+0000","last_undegraded":"2024-09-15T23:56:20.722146+0000","last_fullsized":"2024-09-15T23:56:20.722146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:55.425122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717360+0000","last_change":"2024-09-15T23:56:20.712420+0000","last_active":"2024-09-15T23:56:20.717360+0000","last_peered":"2024-09-15T23:56:20.717360+0000","last_clean":"2024-09-15T23:56:20.717360+0000","last_became_active":"2024-09-15T23:56:20.711746+0000","last_became_peered":"2024-09-15T23:56:20.711746+0000","last_unstale":"2024-09-15T23:56:20.717360+0000","last_undegraded":"2024-09-15T23:56:20.717360+0000","last_fullsized":"2024-09-15T23:56:20.717360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:22.746891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713149+0000","last_change":"2024-09-15T23:56:20.706407+0000","last_active":"2024-09-15T23:56:20.713149+0000","last_peered":"2024-09-15T23:56:20.713149+0000","last_clean":"2024-09-15T23:56:20.713149+0000","last_became_active":"2024-09-15T23:56:20.706098+0000","last_became_peered":"2024-09-15T23:56:20.706098+0000","last_unstale":"2024-09-15T23:56:20.713149+0000","last_undegraded":"2024-09-15T23:56:20.713149+0000","last_fullsized":"2024-09-15T23:56:20.713149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:20.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702776+0000","last_change":"2024-09-15T23:56:20.694156+0000","last_active":"2024-09-15T23:56:20.702776+0000","last_peered":"2024-09-15T23:56:20.702776+0000","last_clean":"2024-09-15T23:56:20.702776+0000","last_became_active":"2024-09-15T23:56:20.693864+0000","last_became_peered":"2024-09-15T23:56:20.693864+0000","last_unstale":"2024-09-15T23:56:20.702776+0000","last_undegraded":"2024-09-15T23:56:20.702776+0000","last_fullsized":"2024-09-15T23:56:20.702776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:44.581099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704359+0000","last_change":"2024-09-15T23:56:20.693245+0000","last_active":"2024-09-15T23:56:20.704359+0000","last_peered":"2024-09-15T23:56:20.704359+0000","last_clean":"2024-09-15T23:56:20.704359+0000","last_became_active":"2024-09-15T23:56:20.692604+0000","last_became_peered":"2024-09-15T23:56:20.692604+0000","last_unstale":"2024-09-15T23:56:20.704359+0000","last_undegraded":"2024-09-15T23:56:20.704359+0000","last_fullsized":"2024-09-15T23:56:20.704359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:31.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.701204+0000","last_change":"2024-09-15T23:56:20.690748+0000","last_active":"2024-09-15T23:56:20.701204+0000","last_peered":"2024-09-15T23:56:20.701204+0000","last_clean":"2024-09-15T23:56:20.701204+0000","last_became_active":"2024-09-15T23:56:20.690331+0000","last_became_peered":"2024-09-15T23:56:20.690331+0000","last_unstale":"2024-09-15T23:56:20.701204+0000","last_undegraded":"2024-09-15T23:56:20.701204+0000","last_fullsized":"2024-09-15T23:56:20.701204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:13.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718240+0000","last_change":"2024-09-15T23:56:20.713004+0000","last_active":"2024-09-15T23:56:20.718240+0000","last_peered":"2024-09-15T23:56:20.718240+0000","last_clean":"2024-09-15T23:56:20.718240+0000","last_became_active":"2024-09-15T23:56:20.712725+0000","last_became_peered":"2024-09-15T23:56:20.712725+0000","last_unstale":"2024-09-15T23:56:20.718240+0000","last_undegraded":"2024-09-15T23:56:20.718240+0000","last_fullsized":"2024-09-15T23:56:20.718240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702997+0000","last_change":"2024-09-15T23:56:20.692345+0000","last_active":"2024-09-15T23:56:20.702997+0000","last_peered":"2024-09-15T23:56:20.702997+0000","last_clean":"2024-09-15T23:56:20.702997+0000","last_became_active":"2024-09-15T23:56:20.691997+0000","last_became_peered":"2024-09-15T23:56:20.691997+0000","last_unstale":"2024-09-15T23:56:20.702997+0000","last_undegraded":"2024-09-15T23:56:20.702997+0000","last_fullsized":"2024-09-15T23:56:20.702997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:28.745041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718051+0000","last_change":"2024-09-15T23:56:20.710594+0000","last_active":"2024-09-15T23:56:20.718051+0000","last_peered":"2024-09-15T23:56:20.718051+0000","last_clean":"2024-09-15T23:56:20.718051+0000","last_became_active":"2024-09-15T23:56:20.709407+0000","last_became_peered":"2024-09-15T23:56:20.709407+0000","last_unstale":"2024-09-15T23:56:20.718051+0000","last_undegraded":"2024-09-15T23:56:20.718051+0000","last_fullsized":"2024-09-15T23:56:20.718051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:35.608248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703841+0000","last_change":"2024-09-15T23:56:20.697597+0000","last_active":"2024-09-15T23:56:20.703841+0000","last_peered":"2024-09-15T23:56:20.703841+0000","last_clean":"2024-09-15T23:56:20.703841+0000","last_became_active":"2024-09-15T23:56:20.697269+0000","last_became_peered":"2024-09-15T23:56:20.697269+0000","last_unstale":"2024-09-15T23:56:20.703841+0000","last_undegraded":"2024-09-15T23:56:20.703841+0000","last_fullsized":"2024-09-15T23:56:20.703841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.910137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722306+0000","last_change":"2024-09-15T23:56:20.715787+0000","last_active":"2024-09-15T23:56:20.722306+0000","last_peered":"2024-09-15T23:56:20.722306+0000","last_clean":"2024-09-15T23:56:20.722306+0000","last_became_active":"2024-09-15T23:56:20.715520+0000","last_became_peered":"2024-09-15T23:56:20.715520+0000","last_unstale":"2024-09-15T23:56:20.722306+0000","last_undegraded":"2024-09-15T23:56:20.722306+0000","last_fullsized":"2024-09-15T23:56:20.722306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:37.922013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.708513+0000","last_change":"2024-09-15T23:56:20.707715+0000","last_active":"2024-09-15T23:56:20.708513+0000","last_peered":"2024-09-15T23:56:20.708513+0000","last_clean":"2024-09-15T23:56:20.708513+0000","last_became_active":"2024-09-15T23:56:20.707482+0000","last_became_peered":"2024-09-15T23:56:20.707482+0000","last_unstale":"2024-09-15T23:56:20.708513+0000","last_undegraded":"2024-09-15T23:56:20.708513+0000","last_fullsized":"2024-09-15T23:56:20.708513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:13.743332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704385+0000","last_change":"2024-09-15T23:56:20.693453+0000","last_active":"2024-09-15T23:56:20.704385+0000","last_peered":"2024-09-15T23:56:20.704385+0000","last_clean":"2024-09-15T23:56:20.704385+0000","last_became_active":"2024-09-15T23:56:20.692979+0000","last_became_peered":"2024-09-15T23:56:20.692979+0000","last_unstale":"2024-09-15T23:56:20.704385+0000","last_undegraded":"2024-09-15T23:56:20.704385+0000","last_fullsized":"2024-09-15T23:56:20.704385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:18.087012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.709299+0000","last_change":"2024-09-15T23:56:20.707737+0000","last_active":"2024-09-15T23:56:20.709299+0000","last_peered":"2024-09-15T23:56:20.709299+0000","last_clean":"2024-09-15T23:56:20.709299+0000","last_became_active":"2024-09-15T23:56:20.707475+0000","last_became_peered":"2024-09-15T23:56:20.707475+0000","last_unstale":"2024-09-15T23:56:20.709299+0000","last_undegraded":"2024-09-15T23:56:20.709299+0000","last_fullsized":"2024-09-15T23:56:20.709299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:35.021158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705454+0000","last_change":"2024-09-15T23:56:20.694911+0000","last_active":"2024-09-15T23:56:20.705454+0000","last_peered":"2024-09-15T23:56:20.705454+0000","last_clean":"2024-09-15T23:56:20.705454+0000","last_became_active":"2024-09-15T23:56:20.694301+0000","last_became_peered":"2024-09-15T23:56:20.694301+0000","last_unstale":"2024-09-15T23:56:20.705454+0000","last_undegraded":"2024-09-15T23:56:20.705454+0000","last_fullsized":"2024-09-15T23:56:20.705454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:00.802903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.706380+0000","last_change":"2024-09-15T23:56:20.702847+0000","last_active":"2024-09-15T23:56:20.706380+0000","last_peered":"2024-09-15T23:56:20.706380+0000","last_clean":"2024-09-15T23:56:20.706380+0000","last_became_active":"2024-09-15T23:56:20.702549+0000","last_became_peered":"2024-09-15T23:56:20.702549+0000","last_unstale":"2024-09-15T23:56:20.706380+0000","last_undegraded":"2024-09-15T23:56:20.706380+0000","last_fullsized":"2024-09-15T23:56:20.706380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:57.179950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704862+0000","last_change":"2024-09-15T23:56:20.698132+0000","last_active":"2024-09-15T23:56:20.704862+0000","last_peered":"2024-09-15T23:56:20.704862+0000","last_clean":"2024-09-15T23:56:20.704862+0000","last_became_active":"2024-09-15T23:56:20.697871+0000","last_became_peered":"2024-09-15T23:56:20.697871+0000","last_unstale":"2024-09-15T23:56:20.704862+0000","last_undegraded":"2024-09-15T23:56:20.704862+0000","last_fullsized":"2024-09-15T23:56:20.704862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:18.153134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703816+0000","last_change":"2024-09-15T23:56:20.695194+0000","last_active":"2024-09-15T23:56:20.703816+0000","last_peered":"2024-09-15T23:56:20.703816+0000","last_clean":"2024-09-15T23:56:20.703816+0000","last_became_active":"2024-09-15T23:56:20.694922+0000","last_became_peered":"2024-09-15T23:56:20.694922+0000","last_unstale":"2024-09-15T23:56:20.703816+0000","last_undegraded":"2024-09-15T23:56:20.703816+0000","last_fullsized":"2024-09-15T23:56:20.703816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:18.183850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722325+0000","last_change":"2024-09-15T23:56:20.716052+0000","last_active":"2024-09-15T23:56:20.722325+0000","last_peered":"2024-09-15T23:56:20.722325+0000","last_clean":"2024-09-15T23:56:20.722325+0000","last_became_active":"2024-09-15T23:56:20.715747+0000","last_became_peered":"2024-09-15T23:56:20.715747+0000","last_unstale":"2024-09-15T23:56:20.722325+0000","last_undegraded":"2024-09-15T23:56:20.722325+0000","last_fullsized":"2024-09-15T23:56:20.722325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:16.566163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722252+0000","last_change":"2024-09-15T23:56:20.719041+0000","last_active":"2024-09-15T23:56:20.722252+0000","last_peered":"2024-09-15T23:56:20.722252+0000","last_clean":"2024-09-15T23:56:20.722252+0000","last_became_active":"2024-09-15T23:56:20.718733+0000","last_became_peered":"2024-09-15T23:56:20.718733+0000","last_unstale":"2024-09-15T23:56:20.722252+0000","last_undegraded":"2024-09-15T23:56:20.722252+0000","last_fullsized":"2024-09-15T23:56:20.722252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:22.120885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704405+0000","last_change":"2024-09-15T23:56:20.693536+0000","last_active":"2024-09-15T23:56:20.704405+0000","last_peered":"2024-09-15T23:56:20.704405+0000","last_clean":"2024-09-15T23:56:20.704405+0000","last_became_active":"2024-09-15T23:56:20.691876+0000","last_became_peered":"2024-09-15T23:56:20.691876+0000","last_unstale":"2024-09-15T23:56:20.704405+0000","last_undegraded":"2024-09-15T23:56:20.704405+0000","last_fullsized":"2024-09-15T23:56:20.704405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:14.520707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704133+0000","last_change":"2024-09-15T23:56:20.696531+0000","last_active":"2024-09-15T23:56:20.704133+0000","last_peered":"2024-09-15T23:56:20.704133+0000","last_clean":"2024-09-15T23:56:20.704133+0000","last_became_active":"2024-09-15T23:56:20.694733+0000","last_became_peered":"2024-09-15T23:56:20.694733+0000","last_unstale":"2024-09-15T23:56:20.704133+0000","last_undegraded":"2024-09-15T23:56:20.704133+0000","last_fullsized":"2024-09-15T23:56:20.704133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.370510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713346+0000","last_change":"2024-09-15T23:56:20.709433+0000","last_active":"2024-09-15T23:56:20.713346+0000","last_peered":"2024-09-15T23:56:20.713346+0000","last_clean":"2024-09-15T23:56:20.713346+0000","last_became_active":"2024-09-15T23:56:20.708730+0000","last_became_peered":"2024-09-15T23:56:20.708730+0000","last_unstale":"2024-09-15T23:56:20.713346+0000","last_undegraded":"2024-09-15T23:56:20.713346+0000","last_fullsized":"2024-09-15T23:56:20.713346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:18.539727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.706960+0000","last_change":"2024-09-15T23:56:20.704206+0000","last_active":"2024-09-15T23:56:20.706960+0000","last_peered":"2024-09-15T23:56:20.706960+0000","last_clean":"2024-09-15T23:56:20.706960+0000","last_became_active":"2024-09-15T23:56:20.703587+0000","last_became_peered":"2024-09-15T23:56:20.703587+0000","last_unstale":"2024-09-15T23:56:20.706960+0000","last_undegraded":"2024-09-15T23:56:20.706960+0000","last_fullsized":"2024-09-15T23:56:20.706960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:58.042736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712677+0000","last_change":"2024-09-15T23:56:20.708903+0000","last_active":"2024-09-15T23:56:20.712677+0000","last_peered":"2024-09-15T23:56:20.712677+0000","last_clean":"2024-09-15T23:56:20.712677+0000","last_became_active":"2024-09-15T23:56:20.708615+0000","last_became_peered":"2024-09-15T23:56:20.708615+0000","last_unstale":"2024-09-15T23:56:20.712677+0000","last_undegraded":"2024-09-15T23:56:20.712677+0000","last_fullsized":"2024-09-15T23:56:20.712677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:21.075913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703862+0000","last_change":"2024-09-15T23:56:20.698003+0000","last_active":"2024-09-15T23:56:20.703862+0000","last_peered":"2024-09-15T23:56:20.703862+0000","last_clean":"2024-09-15T23:56:20.703862+0000","last_became_active":"2024-09-15T23:56:20.697750+0000","last_became_peered":"2024-09-15T23:56:20.697750+0000","last_unstale":"2024-09-15T23:56:20.703862+0000","last_undegraded":"2024-09-15T23:56:20.703862+0000","last_fullsized":"2024-09-15T23:56:20.703862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:01.784712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714117+0000","last_change":"2024-09-15T23:56:20.710738+0000","last_active":"2024-09-15T23:56:20.714117+0000","last_peered":"2024-09-15T23:56:20.714117+0000","last_clean":"2024-09-15T23:56:20.714117+0000","last_became_active":"2024-09-15T23:56:20.710350+0000","last_became_peered":"2024-09-15T23:56:20.710350+0000","last_unstale":"2024-09-15T23:56:20.714117+0000","last_undegraded":"2024-09-15T23:56:20.714117+0000","last_fullsized":"2024-09-15T23:56:20.714117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:04.925864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702752+0000","last_change":"2024-09-15T23:56:20.693934+0000","last_active":"2024-09-15T23:56:20.702752+0000","last_peered":"2024-09-15T23:56:20.702752+0000","last_clean":"2024-09-15T23:56:20.702752+0000","last_became_active":"2024-09-15T23:56:20.692241+0000","last_became_peered":"2024-09-15T23:56:20.692241+0000","last_unstale":"2024-09-15T23:56:20.702752+0000","last_undegraded":"2024-09-15T23:56:20.702752+0000","last_fullsized":"2024-09-15T23:56:20.702752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:55.818058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722163+0000","last_change":"2024-09-15T23:56:20.716888+0000","last_active":"2024-09-15T23:56:20.722163+0000","last_peered":"2024-09-15T23:56:20.722163+0000","last_clean":"2024-09-15T23:56:20.722163+0000","last_became_active":"2024-09-15T23:56:20.716614+0000","last_became_peered":"2024-09-15T23:56:20.716614+0000","last_unstale":"2024-09-15T23:56:20.722163+0000","last_undegraded":"2024-09-15T23:56:20.722163+0000","last_fullsized":"2024-09-15T23:56:20.722163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705044+0000","last_change":"2024-09-15T23:56:20.698982+0000","last_active":"2024-09-15T23:56:20.705044+0000","last_peered":"2024-09-15T23:56:20.705044+0000","last_clean":"2024-09-15T23:56:20.705044+0000","last_became_active":"2024-09-15T23:56:20.697467+0000","last_became_peered":"2024-09-15T23:56:20.697467+0000","last_unstale":"2024-09-15T23:56:20.705044+0000","last_undegraded":"2024-09-15T23:56:20.705044+0000","last_fullsized":"2024-09-15T23:56:20.705044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:53.944823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713368+0000","last_change":"2024-09-15T23:56:20.710057+0000","last_active":"2024-09-15T23:56:20.713368+0000","last_peered":"2024-09-15T23:56:20.713368+0000","last_clean":"2024-09-15T23:56:20.713368+0000","last_became_active":"2024-09-15T23:56:20.709097+0000","last_became_peered":"2024-09-15T23:56:20.709097+0000","last_unstale":"2024-09-15T23:56:20.713368+0000","last_undegraded":"2024-09-15T23:56:20.713368+0000","last_fullsized":"2024-09-15T23:56:20.713368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:23.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704710+0000","last_change":"2024-09-15T23:56:20.697033+0000","last_active":"2024-09-15T23:56:20.704710+0000","last_peered":"2024-09-15T23:56:20.704710+0000","last_clean":"2024-09-15T23:56:20.704710+0000","last_became_active":"2024-09-15T23:56:20.696772+0000","last_became_peered":"2024-09-15T23:56:20.696772+0000","last_unstale":"2024-09-15T23:56:20.704710+0000","last_undegraded":"2024-09-15T23:56:20.704710+0000","last_fullsized":"2024-09-15T23:56:20.704710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:51.650272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719774+0000","last_change":"2024-09-15T23:56:19.699159+0000","last_active":"2024-09-15T23:56:20.719774+0000","last_peered":"2024-09-15T23:56:20.719774+0000","last_clean":"2024-09-15T23:56:20.719774+0000","last_became_active":"2024-09-15T23:56:19.698923+0000","last_became_peered":"2024-09-15T23:56:19.698923+0000","last_unstale":"2024-09-15T23:56:20.719774+0000","last_undegraded":"2024-09-15T23:56:20.719774+0000","last_fullsized":"2024-09-15T23:56:20.719774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:27.036988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.700626+0000","last_change":"2024-09-15T23:56:20.691620+0000","last_active":"2024-09-15T23:56:20.700626+0000","last_peered":"2024-09-15T23:56:20.700626+0000","last_clean":"2024-09-15T23:56:20.700626+0000","last_became_active":"2024-09-15T23:56:20.690902+0000","last_became_peered":"2024-09-15T23:56:20.690902+0000","last_unstale":"2024-09-15T23:56:20.700626+0000","last_undegraded":"2024-09-15T23:56:20.700626+0000","last_fullsized":"2024-09-15T23:56:20.700626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:39.161482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719472+0000","last_change":"2024-09-15T23:56:19.686214+0000","last_active":"2024-09-15T23:56:20.719472+0000","last_peered":"2024-09-15T23:56:20.719472+0000","last_clean":"2024-09-15T23:56:20.719472+0000","last_became_active":"2024-09-15T23:56:19.685934+0000","last_became_peered":"2024-09-15T23:56:19.685934+0000","last_unstale":"2024-09-15T23:56:20.719472+0000","last_undegraded":"2024-09-15T23:56:20.719472+0000","last_fullsized":"2024-09-15T23:56:20.719472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:23.562336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714096+0000","last_change":"2024-09-15T23:56:20.710664+0000","last_active":"2024-09-15T23:56:20.714096+0000","last_peered":"2024-09-15T23:56:20.714096+0000","last_clean":"2024-09-15T23:56:20.714096+0000","last_became_active":"2024-09-15T23:56:20.710260+0000","last_became_peered":"2024-09-15T23:56:20.710260+0000","last_unstale":"2024-09-15T23:56:20.714096+0000","last_undegraded":"2024-09-15T23:56:20.714096+0000","last_fullsized":"2024-09-15T23:56:20.714096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:54.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719621+0000","last_change":"2024-09-15T23:56:19.694386+0000","last_active":"2024-09-15T23:56:20.719621+0000","last_peered":"2024-09-15T23:56:20.719621+0000","last_clean":"2024-09-15T23:56:20.719621+0000","last_became_active":"2024-09-15T23:56:19.693850+0000","last_became_peered":"2024-09-15T23:56:19.693850+0000","last_unstale":"2024-09-15T23:56:20.719621+0000","last_undegraded":"2024-09-15T23:56:20.719621+0000","last_fullsized":"2024-09-15T23:56:20.719621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:10.056160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717338+0000","last_change":"2024-09-15T23:56:20.712331+0000","last_active":"2024-09-15T23:56:20.717338+0000","last_peered":"2024-09-15T23:56:20.717338+0000","last_clean":"2024-09-15T23:56:20.717338+0000","last_became_active":"2024-09-15T23:56:20.711680+0000","last_became_peered":"2024-09-15T23:56:20.711680+0000","last_unstale":"2024-09-15T23:56:20.717338+0000","last_undegraded":"2024-09-15T23:56:20.717338+0000","last_fullsized":"2024-09-15T23:56:20.717338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:52.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719241+0000","last_change":"2024-09-15T23:56:19.689323+0000","last_active":"2024-09-15T23:56:20.719241+0000","last_peered":"2024-09-15T23:56:20.719241+0000","last_clean":"2024-09-15T23:56:20.719241+0000","last_became_active":"2024-09-15T23:56:19.688934+0000","last_became_peered":"2024-09-15T23:56:19.688934+0000","last_unstale":"2024-09-15T23:56:20.719241+0000","last_undegraded":"2024-09-15T23:56:20.719241+0000","last_fullsized":"2024-09-15T23:56:20.719241+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:23.699701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722247+0000","last_change":"2024-09-15T23:56:20.717899+0000","last_active":"2024-09-15T23:56:20.722247+0000","last_peered":"2024-09-15T23:56:20.722247+0000","last_clean":"2024-09-15T23:56:20.722247+0000","last_became_active":"2024-09-15T23:56:20.717637+0000","last_became_peered":"2024-09-15T23:56:20.717637+0000","last_unstale":"2024-09-15T23:56:20.722247+0000","last_undegraded":"2024-09-15T23:56:20.722247+0000","last_fullsized":"2024-09-15T23:56:20.722247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:30.028626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714681+0000","last_change":"2024-09-15T23:56:19.699217+0000","last_active":"2024-09-15T23:56:20.714681+0000","last_peered":"2024-09-15T23:56:20.714681+0000","last_clean":"2024-09-15T23:56:20.714681+0000","last_became_active":"2024-09-15T23:56:19.698869+0000","last_became_peered":"2024-09-15T23:56:19.698869+0000","last_unstale":"2024-09-15T23:56:20.714681+0000","last_undegraded":"2024-09-15T23:56:20.714681+0000","last_fullsized":"2024-09-15T23:56:20.714681+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:42.489872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719506+0000","last_change":"2024-09-15T23:56:20.714864+0000","last_active":"2024-09-15T23:56:20.719506+0000","last_peered":"2024-09-15T23:56:20.719506+0000","last_clean":"2024-09-15T23:56:20.719506+0000","last_became_active":"2024-09-15T23:56:20.713754+0000","last_became_peered":"2024-09-15T23:56:20.713754+0000","last_unstale":"2024-09-15T23:56:20.719506+0000","last_undegraded":"2024-09-15T23:56:20.719506+0000","last_fullsized":"2024-09-15T23:56:20.719506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:46.731512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.716871+0000","last_change":"2024-09-15T23:56:19.694496+0000","last_active":"2024-09-15T23:56:20.716871+0000","last_peered":"2024-09-15T23:56:20.716871+0000","last_clean":"2024-09-15T23:56:20.716871+0000","last_became_active":"2024-09-15T23:56:19.694220+0000","last_became_peered":"2024-09-15T23:56:19.694220+0000","last_unstale":"2024-09-15T23:56:20.716871+0000","last_undegraded":"2024-09-15T23:56:20.716871+0000","last_fullsized":"2024-09-15T23:56:20.716871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:37.594382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705434+0000","last_change":"2024-09-15T23:56:20.694489+0000","last_active":"2024-09-15T23:56:20.705434+0000","last_peered":"2024-09-15T23:56:20.705434+0000","last_clean":"2024-09-15T23:56:20.705434+0000","last_became_active":"2024-09-15T23:56:20.694192+0000","last_became_peered":"2024-09-15T23:56:20.694192+0000","last_unstale":"2024-09-15T23:56:20.705434+0000","last_undegraded":"2024-09-15T23:56:20.705434+0000","last_fullsized":"2024-09-15T23:56:20.705434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:46.874329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.684144+0000","last_change":"2024-09-15T23:56:19.686245+0000","last_active":"2024-09-15T23:56:20.684144+0000","last_peered":"2024-09-15T23:56:20.684144+0000","last_clean":"2024-09-15T23:56:20.684144+0000","last_became_active":"2024-09-15T23:56:19.685062+0000","last_became_peered":"2024-09-15T23:56:19.685062+0000","last_unstale":"2024-09-15T23:56:20.684144+0000","last_undegraded":"2024-09-15T23:56:20.684144+0000","last_fullsized":"2024-09-15T23:56:20.684144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:20.077992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.711019+0000","last_change":"2024-09-15T23:56:20.708879+0000","last_active":"2024-09-15T23:56:20.711019+0000","last_peered":"2024-09-15T23:56:20.711019+0000","last_clean":"2024-09-15T23:56:20.711019+0000","last_became_active":"2024-09-15T23:56:20.707893+0000","last_became_peered":"2024-09-15T23:56:20.707893+0000","last_unstale":"2024-09-15T23:56:20.711019+0000","last_undegraded":"2024-09-15T23:56:20.711019+0000","last_fullsized":"2024-09-15T23:56:20.711019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:58.595287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.687566+0000","last_change":"2024-09-15T23:56:19.696843+0000","last_active":"2024-09-15T23:56:20.687566+0000","last_peered":"2024-09-15T23:56:20.687566+0000","last_clean":"2024-09-15T23:56:20.687566+0000","last_became_active":"2024-09-15T23:56:19.695192+0000","last_became_peered":"2024-09-15T23:56:19.695192+0000","last_unstale":"2024-09-15T23:56:20.687566+0000","last_undegraded":"2024-09-15T23:56:20.687566+0000","last_fullsized":"2024-09-15T23:56:20.687566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:07.169275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.707428+0000","last_change":"2024-09-15T23:56:20.701720+0000","last_active":"2024-09-15T23:56:20.707428+0000","last_peered":"2024-09-15T23:56:20.707428+0000","last_clean":"2024-09-15T23:56:20.707428+0000","last_became_active":"2024-09-15T23:56:20.701136+0000","last_became_peered":"2024-09-15T23:56:20.701136+0000","last_unstale":"2024-09-15T23:56:20.707428+0000","last_undegraded":"2024-09-15T23:56:20.707428+0000","last_fullsized":"2024-09-15T23:56:20.707428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:52.175676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.679232+0000","last_change":"2024-09-15T23:56:19.690833+0000","last_active":"2024-09-15T23:56:20.679232+0000","last_peered":"2024-09-15T23:56:20.679232+0000","last_clean":"2024-09-15T23:56:20.679232+0000","last_became_active":"2024-09-15T23:56:19.690087+0000","last_became_peered":"2024-09-15T23:56:19.690087+0000","last_unstale":"2024-09-15T23:56:20.679232+0000","last_undegraded":"2024-09-15T23:56:20.679232+0000","last_fullsized":"2024-09-15T23:56:20.679232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:03.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712367+0000","last_change":"2024-09-15T23:56:20.705825+0000","last_active":"2024-09-15T23:56:20.712367+0000","last_peered":"2024-09-15T23:56:20.712367+0000","last_clean":"2024-09-15T23:56:20.712367+0000","last_became_active":"2024-09-15T23:56:20.705487+0000","last_became_peered":"2024-09-15T23:56:20.705487+0000","last_unstale":"2024-09-15T23:56:20.712367+0000","last_undegraded":"2024-09-15T23:56:20.712367+0000","last_fullsized":"2024-09-15T23:56:20.712367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:55.118141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.689919+0000","last_change":"2024-09-15T23:56:19.684971+0000","last_active":"2024-09-15T23:56:20.689919+0000","last_peered":"2024-09-15T23:56:20.689919+0000","last_clean":"2024-09-15T23:56:20.689919+0000","last_became_active":"2024-09-15T23:56:19.684181+0000","last_became_peered":"2024-09-15T23:56:19.684181+0000","last_unstale":"2024-09-15T23:56:20.689919+0000","last_undegraded":"2024-09-15T23:56:20.689919+0000","last_fullsized":"2024-09-15T23:56:20.689919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:43.447800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.710982+0000","last_change":"2024-09-15T23:56:20.708385+0000","last_active":"2024-09-15T23:56:20.710982+0000","last_peered":"2024-09-15T23:56:20.710982+0000","last_clean":"2024-09-15T23:56:20.710982+0000","last_became_active":"2024-09-15T23:56:20.708115+0000","last_became_peered":"2024-09-15T23:56:20.708115+0000","last_unstale":"2024-09-15T23:56:20.710982+0000","last_undegraded":"2024-09-15T23:56:20.710982+0000","last_fullsized":"2024-09-15T23:56:20.710982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:37.472013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719269+0000","last_change":"2024-09-15T23:56:19.701230+0000","last_active":"2024-09-15T23:56:20.719269+0000","last_peered":"2024-09-15T23:56:20.719269+0000","last_clean":"2024-09-15T23:56:20.719269+0000","last_became_active":"2024-09-15T23:56:19.700977+0000","last_became_peered":"2024-09-15T23:56:19.700977+0000","last_unstale":"2024-09-15T23:56:20.719269+0000","last_undegraded":"2024-09-15T23:56:20.719269+0000","last_fullsized":"2024-09-15T23:56:20.719269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:25.148499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712655+0000","last_change":"2024-09-15T23:56:20.709094+0000","last_active":"2024-09-15T23:56:20.712655+0000","last_peered":"2024-09-15T23:56:20.712655+0000","last_clean":"2024-09-15T23:56:20.712655+0000","last_became_active":"2024-09-15T23:56:20.708654+0000","last_became_peered":"2024-09-15T23:56:20.708654+0000","last_unstale":"2024-09-15T23:56:20.712655+0000","last_undegraded":"2024-09-15T23:56:20.712655+0000","last_fullsized":"2024-09-15T23:56:20.712655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:13.882687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.726639+0000","last_change":"2024-09-15T23:56:19.703061+0000","last_active":"2024-09-15T23:56:20.726639+0000","last_peered":"2024-09-15T23:56:20.726639+0000","last_clean":"2024-09-15T23:56:20.726639+0000","last_became_active":"2024-09-15T23:56:19.702750+0000","last_became_peered":"2024-09-15T23:56:19.702750+0000","last_unstale":"2024-09-15T23:56:20.726639+0000","last_undegraded":"2024-09-15T23:56:20.726639+0000","last_fullsized":"2024-09-15T23:56:20.726639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:23.575094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704776+0000","last_change":"2024-09-15T23:56:20.696227+0000","last_active":"2024-09-15T23:56:20.704776+0000","last_peered":"2024-09-15T23:56:20.704776+0000","last_clean":"2024-09-15T23:56:20.704776+0000","last_became_active":"2024-09-15T23:56:20.695959+0000","last_became_peered":"2024-09-15T23:56:20.695959+0000","last_unstale":"2024-09-15T23:56:20.704776+0000","last_undegraded":"2024-09-15T23:56:20.704776+0000","last_fullsized":"2024-09-15T23:56:20.704776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:08.200587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.720396+0000","last_change":"2024-09-15T23:56:19.696212+0000","last_active":"2024-09-15T23:56:20.720396+0000","last_peered":"2024-09-15T23:56:20.720396+0000","last_clean":"2024-09-15T23:56:20.720396+0000","last_became_active":"2024-09-15T23:56:19.695986+0000","last_became_peered":"2024-09-15T23:56:19.695986+0000","last_unstale":"2024-09-15T23:56:20.720396+0000","last_undegraded":"2024-09-15T23:56:20.720396+0000","last_fullsized":"2024-09-15T23:56:20.720396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.146610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714487+0000","last_change":"2024-09-15T23:56:20.708637+0000","last_active":"2024-09-15T23:56:20.714487+0000","last_peered":"2024-09-15T23:56:20.714487+0000","last_clean":"2024-09-15T23:56:20.714487+0000","last_became_active":"2024-09-15T23:56:20.708101+0000","last_became_peered":"2024-09-15T23:56:20.708101+0000","last_unstale":"2024-09-15T23:56:20.714487+0000","last_undegraded":"2024-09-15T23:56:20.714487+0000","last_fullsized":"2024-09-15T23:56:20.714487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:09.747796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683308+0000","last_change":"2024-09-15T23:56:19.700204+0000","last_active":"2024-09-15T23:56:20.683308+0000","last_peered":"2024-09-15T23:56:20.683308+0000","last_clean":"2024-09-15T23:56:20.683308+0000","last_became_active":"2024-09-15T23:56:19.699920+0000","last_became_peered":"2024-09-15T23:56:19.699920+0000","last_unstale":"2024-09-15T23:56:20.683308+0000","last_undegraded":"2024-09-15T23:56:20.683308+0000","last_fullsized":"2024-09-15T23:56:20.683308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:30.371927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.711485+0000","last_change":"2024-09-15T23:56:20.710055+0000","last_active":"2024-09-15T23:56:20.711485+0000","last_peered":"2024-09-15T23:56:20.711485+0000","last_clean":"2024-09-15T23:56:20.711485+0000","last_became_active":"2024-09-15T23:56:20.709780+0000","last_became_peered":"2024-09-15T23:56:20.709780+0000","last_unstale":"2024-09-15T23:56:20.711485+0000","last_undegraded":"2024-09-15T23:56:20.711485+0000","last_fullsized":"2024-09-15T23:56:20.711485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:05.445423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.691145+0000","last_change":"2024-09-15T23:56:19.699359+0000","last_active":"2024-09-15T23:56:20.691145+0000","last_peered":"2024-09-15T23:56:20.691145+0000","last_clean":"2024-09-15T23:56:20.691145+0000","last_became_active":"2024-09-15T23:56:19.698476+0000","last_became_peered":"2024-09-15T23:56:19.698476+0000","last_unstale":"2024-09-15T23:56:20.691145+0000","last_undegraded":"2024-09-15T23:56:20.691145+0000","last_fullsized":"2024-09-15T23:56:20.691145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:05.758453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721911+0000","last_change":"2024-09-15T23:56:20.716218+0000","last_active":"2024-09-15T23:56:20.721911+0000","last_peered":"2024-09-15T23:56:20.721911+0000","last_clean":"2024-09-15T23:56:20.721911+0000","last_became_active":"2024-09-15T23:56:20.715898+0000","last_became_peered":"2024-09-15T23:56:20.715898+0000","last_unstale":"2024-09-15T23:56:20.721911+0000","last_undegraded":"2024-09-15T23:56:20.721911+0000","last_fullsized":"2024-09-15T23:56:20.721911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:52.934578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.724156+0000","last_change":"2024-09-15T23:56:19.700486+0000","last_active":"2024-09-15T23:56:20.724156+0000","last_peered":"2024-09-15T23:56:20.724156+0000","last_clean":"2024-09-15T23:56:20.724156+0000","last_became_active":"2024-09-15T23:56:19.697214+0000","last_became_peered":"2024-09-15T23:56:19.697214+0000","last_unstale":"2024-09-15T23:56:20.724156+0000","last_undegraded":"2024-09-15T23:56:20.724156+0000","last_fullsized":"2024-09-15T23:56:20.724156+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:29.487850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714014+0000","last_change":"2024-09-15T23:56:20.710955+0000","last_active":"2024-09-15T23:56:20.714014+0000","last_peered":"2024-09-15T23:56:20.714014+0000","last_clean":"2024-09-15T23:56:20.714014+0000","last_became_active":"2024-09-15T23:56:20.710010+0000","last_became_peered":"2024-09-15T23:56:20.710010+0000","last_unstale":"2024-09-15T23:56:20.714014+0000","last_undegraded":"2024-09-15T23:56:20.714014+0000","last_fullsized":"2024-09-15T23:56:20.714014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:42.297691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721470+0000","last_change":"2024-09-15T23:56:19.698114+0000","last_active":"2024-09-15T23:56:20.721470+0000","last_peered":"2024-09-15T23:56:20.721470+0000","last_clean":"2024-09-15T23:56:20.721470+0000","last_became_active":"2024-09-15T23:56:19.697798+0000","last_became_peered":"2024-09-15T23:56:19.697798+0000","last_unstale":"2024-09-15T23:56:20.721470+0000","last_undegraded":"2024-09-15T23:56:20.721470+0000","last_fullsized":"2024-09-15T23:56:20.721470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:08.484696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703021+0000","last_change":"2024-09-15T23:56:20.694615+0000","last_active":"2024-09-15T23:56:20.703021+0000","last_peered":"2024-09-15T23:56:20.703021+0000","last_clean":"2024-09-15T23:56:20.703021+0000","last_became_active":"2024-09-15T23:56:20.692669+0000","last_became_peered":"2024-09-15T23:56:20.692669+0000","last_unstale":"2024-09-15T23:56:20.703021+0000","last_undegraded":"2024-09-15T23:56:20.703021+0000","last_fullsized":"2024-09-15T23:56:20.703021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:58.895172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.715056+0000","last_change":"2024-09-15T23:56:19.692305+0000","last_active":"2024-09-15T23:56:20.715056+0000","last_peered":"2024-09-15T23:56:20.715056+0000","last_clean":"2024-09-15T23:56:20.715056+0000","last_became_active":"2024-09-15T23:56:19.692025+0000","last_became_peered":"2024-09-15T23:56:19.692025+0000","last_unstale":"2024-09-15T23:56:20.715056+0000","last_undegraded":"2024-09-15T23:56:20.715056+0000","last_fullsized":"2024-09-15T23:56:20.715056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:32.822239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714074+0000","last_change":"2024-09-15T23:56:20.710525+0000","last_active":"2024-09-15T23:56:20.714074+0000","last_peered":"2024-09-15T23:56:20.714074+0000","last_clean":"2024-09-15T23:56:20.714074+0000","last_became_active":"2024-09-15T23:56:20.709915+0000","last_became_peered":"2024-09-15T23:56:20.709915+0000","last_unstale":"2024-09-15T23:56:20.714074+0000","last_undegraded":"2024-09-15T23:56:20.714074+0000","last_fullsized":"2024-09-15T23:56:20.714074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:41.091539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721794+0000","last_change":"2024-09-15T23:56:19.691077+0000","last_active":"2024-09-15T23:56:20.721794+0000","last_peered":"2024-09-15T23:56:20.721794+0000","last_clean":"2024-09-15T23:56:20.721794+0000","last_became_active":"2024-09-15T23:56:19.687845+0000","last_became_peered":"2024-09-15T23:56:19.687845+0000","last_unstale":"2024-09-15T23:56:20.721794+0000","last_undegraded":"2024-09-15T23:56:20.721794+0000","last_fullsized":"2024-09-15T23:56:20.721794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:04.973037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717706+0000","last_change":"2024-09-15T23:56:20.712560+0000","last_active":"2024-09-15T23:56:20.717706+0000","last_peered":"2024-09-15T23:56:20.717706+0000","last_clean":"2024-09-15T23:56:20.717706+0000","last_became_active":"2024-09-15T23:56:20.712104+0000","last_became_peered":"2024-09-15T23:56:20.712104+0000","last_unstale":"2024-09-15T23:56:20.717706+0000","last_undegraded":"2024-09-15T23:56:20.717706+0000","last_fullsized":"2024-09-15T23:56:20.717706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:35.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.678540+0000","last_change":"2024-09-15T23:56:19.689550+0000","last_active":"2024-09-15T23:56:20.678540+0000","last_peered":"2024-09-15T23:56:20.678540+0000","last_clean":"2024-09-15T23:56:20.678540+0000","last_became_active":"2024-09-15T23:56:19.689285+0000","last_became_peered":"2024-09-15T23:56:19.689285+0000","last_unstale":"2024-09-15T23:56:20.678540+0000","last_undegraded":"2024-09-15T23:56:20.678540+0000","last_fullsized":"2024-09-15T23:56:20.678540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:16.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722272+0000","last_change":"2024-09-15T23:56:20.718694+0000","last_active":"2024-09-15T23:56:20.722272+0000","last_peered":"2024-09-15T23:56:20.722272+0000","last_clean":"2024-09-15T23:56:20.722272+0000","last_became_active":"2024-09-15T23:56:20.718450+0000","last_became_peered":"2024-09-15T23:56:20.718450+0000","last_unstale":"2024-09-15T23:56:20.722272+0000","last_undegraded":"2024-09-15T23:56:20.722272+0000","last_fullsized":"2024-09-15T23:56:20.722272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:03.699902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719968+0000","last_change":"2024-09-15T23:56:19.693752+0000","last_active":"2024-09-15T23:56:20.719968+0000","last_peered":"2024-09-15T23:56:20.719968+0000","last_clean":"2024-09-15T23:56:20.719968+0000","last_became_active":"2024-09-15T23:56:19.693438+0000","last_became_peered":"2024-09-15T23:56:19.693438+0000","last_unstale":"2024-09-15T23:56:20.719968+0000","last_undegraded":"2024-09-15T23:56:20.719968+0000","last_fullsized":"2024-09-15T23:56:20.719968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:53.993520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704954+0000","last_change":"2024-09-15T23:56:20.699756+0000","last_active":"2024-09-15T23:56:20.704954+0000","last_peered":"2024-09-15T23:56:20.704954+0000","last_clean":"2024-09-15T23:56:20.704954+0000","last_became_active":"2024-09-15T23:56:20.699505+0000","last_became_peered":"2024-09-15T23:56:20.699505+0000","last_unstale":"2024-09-15T23:56:20.704954+0000","last_undegraded":"2024-09-15T23:56:20.704954+0000","last_fullsized":"2024-09-15T23:56:20.704954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:48.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683450+0000","last_change":"2024-09-15T23:56:19.684144+0000","last_active":"2024-09-15T23:56:20.683450+0000","last_peered":"2024-09-15T23:56:20.683450+0000","last_clean":"2024-09-15T23:56:20.683450+0000","last_became_active":"2024-09-15T23:56:19.683740+0000","last_became_peered":"2024-09-15T23:56:19.683740+0000","last_unstale":"2024-09-15T23:56:20.683450+0000","last_undegraded":"2024-09-15T23:56:20.683450+0000","last_fullsized":"2024-09-15T23:56:20.683450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:11.966919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713926+0000","last_change":"2024-09-15T23:56:20.710702+0000","last_active":"2024-09-15T23:56:20.713926+0000","last_peered":"2024-09-15T23:56:20.713926+0000","last_clean":"2024-09-15T23:56:20.713926+0000","last_became_active":"2024-09-15T23:56:20.710181+0000","last_became_peered":"2024-09-15T23:56:20.710181+0000","last_unstale":"2024-09-15T23:56:20.713926+0000","last_undegraded":"2024-09-15T23:56:20.713926+0000","last_fullsized":"2024-09-15T23:56:20.713926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:15.045401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.684290+0000","last_change":"2024-09-15T23:56:19.694797+0000","last_active":"2024-09-15T23:56:20.684290+0000","last_peered":"2024-09-15T23:56:20.684290+0000","last_clean":"2024-09-15T23:56:20.684290+0000","last_became_active":"2024-09-15T23:56:19.694510+0000","last_became_peered":"2024-09-15T23:56:19.694510+0000","last_unstale":"2024-09-15T23:56:20.684290+0000","last_undegraded":"2024-09-15T23:56:20.684290+0000","last_fullsized":"2024-09-15T23:56:20.684290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:20.863085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.701181+0000","last_change":"2024-09-15T23:56:20.690625+0000","last_active":"2024-09-15T23:56:20.701181+0000","last_peered":"2024-09-15T23:56:20.701181+0000","last_clean":"2024-09-15T23:56:20.701181+0000","last_became_active":"2024-09-15T23:56:20.690008+0000","last_became_peered":"2024-09-15T23:56:20.690008+0000","last_unstale":"2024-09-15T23:56:20.701181+0000","last_undegraded":"2024-09-15T23:56:20.701181+0000","last_fullsized":"2024-09-15T23:56:20.701181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:53.296657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.692812+0000","last_change":"2024-09-15T23:56:19.699847+0000","last_active":"2024-09-15T23:56:20.692812+0000","last_peered":"2024-09-15T23:56:20.692812+0000","last_clean":"2024-09-15T23:56:20.692812+0000","last_became_active":"2024-09-15T23:56:19.698457+0000","last_became_peered":"2024-09-15T23:56:19.698457+0000","last_unstale":"2024-09-15T23:56:20.692812+0000","last_undegraded":"2024-09-15T23:56:20.692812+0000","last_fullsized":"2024-09-15T23:56:20.692812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:46.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717425+0000","last_change":"2024-09-15T23:56:20.711902+0000","last_active":"2024-09-15T23:56:20.717425+0000","last_peered":"2024-09-15T23:56:20.717425+0000","last_clean":"2024-09-15T23:56:20.717425+0000","last_became_active":"2024-09-15T23:56:20.711592+0000","last_became_peered":"2024-09-15T23:56:20.711592+0000","last_unstale":"2024-09-15T23:56:20.717425+0000","last_undegraded":"2024-09-15T23:56:20.717425+0000","last_fullsized":"2024-09-15T23:56:20.717425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:46.163844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.679168+0000","last_change":"2024-09-15T23:56:19.690132+0000","last_active":"2024-09-15T23:56:20.679168+0000","last_peered":"2024-09-15T23:56:20.679168+0000","last_clean":"2024-09-15T23:56:20.679168+0000","last_became_active":"2024-09-15T23:56:19.689823+0000","last_became_peered":"2024-09-15T23:56:19.689823+0000","last_unstale":"2024-09-15T23:56:20.679168+0000","last_undegraded":"2024-09-15T23:56:20.679168+0000","last_fullsized":"2024-09-15T23:56:20.679168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:57.040079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.691758+0000","last_change":"2024-09-15T23:56:20.690224+0000","last_active":"2024-09-15T23:56:20.691758+0000","last_peered":"2024-09-15T23:56:20.691758+0000","last_clean":"2024-09-15T23:56:20.691758+0000","last_became_active":"2024-09-15T23:56:20.689916+0000","last_became_peered":"2024-09-15T23:56:20.689916+0000","last_unstale":"2024-09-15T23:56:20.691758+0000","last_undegraded":"2024-09-15T23:56:20.691758+0000","last_fullsized":"2024-09-15T23:56:20.691758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:06.655563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.682299+0000","last_change":"2024-09-15T23:56:19.684703+0000","last_active":"2024-09-15T23:56:20.682299+0000","last_peered":"2024-09-15T23:56:20.682299+0000","last_clean":"2024-09-15T23:56:20.682299+0000","last_became_active":"2024-09-15T23:56:19.684441+0000","last_became_peered":"2024-09-15T23:56:19.684441+0000","last_unstale":"2024-09-15T23:56:20.682299+0000","last_undegraded":"2024-09-15T23:56:20.682299+0000","last_fullsized":"2024-09-15T23:56:20.682299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:13.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721968+0000","last_change":"2024-09-15T23:56:20.714759+0000","last_active":"2024-09-15T23:56:20.721968+0000","last_peered":"2024-09-15T23:56:20.721968+0000","last_clean":"2024-09-15T23:56:20.721968+0000","last_became_active":"2024-09-15T23:56:20.714471+0000","last_became_peered":"2024-09-15T23:56:20.714471+0000","last_unstale":"2024-09-15T23:56:20.721968+0000","last_undegraded":"2024-09-15T23:56:20.721968+0000","last_fullsized":"2024-09-15T23:56:20.721968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:11.687702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.678994+0000","last_change":"2024-09-15T23:56:19.694373+0000","last_active":"2024-09-15T23:56:20.678994+0000","last_peered":"2024-09-15T23:56:20.678994+0000","last_clean":"2024-09-15T23:56:20.678994+0000","last_became_active":"2024-09-15T23:56:19.694083+0000","last_became_peered":"2024-09-15T23:56:19.694083+0000","last_unstale":"2024-09-15T23:56:20.678994+0000","last_undegraded":"2024-09-15T23:56:20.678994+0000","last_fullsized":"2024-09-15T23:56:20.678994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:26.777939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713291+0000","last_change":"2024-09-15T23:56:20.709982+0000","last_active":"2024-09-15T23:56:20.713291+0000","last_peered":"2024-09-15T23:56:20.713291+0000","last_clean":"2024-09-15T23:56:20.713291+0000","last_became_active":"2024-09-15T23:56:20.709656+0000","last_became_peered":"2024-09-15T23:56:20.709656+0000","last_unstale":"2024-09-15T23:56:20.713291+0000","last_undegraded":"2024-09-15T23:56:20.713291+0000","last_fullsized":"2024-09-15T23:56:20.713291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:21.403024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683784+0000","last_change":"2024-09-15T23:56:19.699142+0000","last_active":"2024-09-15T23:56:20.683784+0000","last_peered":"2024-09-15T23:56:20.683784+0000","last_clean":"2024-09-15T23:56:20.683784+0000","last_became_active":"2024-09-15T23:56:19.698665+0000","last_became_peered":"2024-09-15T23:56:19.698665+0000","last_unstale":"2024-09-15T23:56:20.683784+0000","last_undegraded":"2024-09-15T23:56:20.683784+0000","last_fullsized":"2024-09-15T23:56:20.683784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.527319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.715401+0000","last_change":"2024-09-15T23:56:20.708841+0000","last_active":"2024-09-15T23:56:20.715401+0000","last_peered":"2024-09-15T23:56:20.715401+0000","last_clean":"2024-09-15T23:56:20.715401+0000","last_became_active":"2024-09-15T23:56:20.708403+0000","last_became_peered":"2024-09-15T23:56:20.708403+0000","last_unstale":"2024-09-15T23:56:20.715401+0000","last_undegraded":"2024-09-15T23:56:20.715401+0000","last_fullsized":"2024-09-15T23:56:20.715401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:02.366385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677748+0000","last_change":"2024-09-15T23:56:19.684807+0000","last_active":"2024-09-15T23:56:20.677748+0000","last_peered":"2024-09-15T23:56:20.677748+0000","last_clean":"2024-09-15T23:56:20.677748+0000","last_became_active":"2024-09-15T23:56:19.684546+0000","last_became_peered":"2024-09-15T23:56:19.684546+0000","last_unstale":"2024-09-15T23:56:20.677748+0000","last_undegraded":"2024-09-15T23:56:20.677748+0000","last_fullsized":"2024-09-15T23:56:20.677748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713167+0000","last_change":"2024-09-15T23:56:20.712020+0000","last_active":"2024-09-15T23:56:20.713167+0000","last_peered":"2024-09-15T23:56:20.713167+0000","last_clean":"2024-09-15T23:56:20.713167+0000","last_became_active":"2024-09-15T23:56:20.709304+0000","last_became_peered":"2024-09-15T23:56:20.709304+0000","last_unstale":"2024-09-15T23:56:20.713167+0000","last_undegraded":"2024-09-15T23:56:20.713167+0000","last_fullsized":"2024-09-15T23:56:20.713167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:44.309259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677148+0000","last_change":"2024-09-15T23:56:19.682125+0000","last_active":"2024-09-15T23:56:20.677148+0000","last_peered":"2024-09-15T23:56:20.677148+0000","last_clean":"2024-09-15T23:56:20.677148+0000","last_became_active":"2024-09-15T23:56:19.681850+0000","last_became_peered":"2024-09-15T23:56:19.681850+0000","last_unstale":"2024-09-15T23:56:20.677148+0000","last_undegraded":"2024-09-15T23:56:20.677148+0000","last_fullsized":"2024-09-15T23:56:20.677148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:32.863735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712605+0000","last_change":"2024-09-15T23:56:20.708412+0000","last_active":"2024-09-15T23:56:20.712605+0000","last_peered":"2024-09-15T23:56:20.712605+0000","last_clean":"2024-09-15T23:56:20.712605+0000","last_became_active":"2024-09-15T23:56:20.708170+0000","last_became_peered":"2024-09-15T23:56:20.708170+0000","last_unstale":"2024-09-15T23:56:20.712605+0000","last_undegraded":"2024-09-15T23:56:20.712605+0000","last_fullsized":"2024-09-15T23:56:20.712605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:07.603573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.687193+0000","last_change":"2024-09-15T23:56:19.697356+0000","last_active":"2024-09-15T23:56:20.687193+0000","last_peered":"2024-09-15T23:56:20.687193+0000","last_clean":"2024-09-15T23:56:20.687193+0000","last_became_active":"2024-09-15T23:56:19.697077+0000","last_became_peered":"2024-09-15T23:56:19.697077+0000","last_unstale":"2024-09-15T23:56:20.687193+0000","last_undegraded":"2024-09-15T23:56:20.687193+0000","last_fullsized":"2024-09-15T23:56:20.687193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:11.467305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718028+0000","last_change":"2024-09-15T23:56:20.710375+0000","last_active":"2024-09-15T23:56:20.718028+0000","last_peered":"2024-09-15T23:56:20.718028+0000","last_clean":"2024-09-15T23:56:20.718028+0000","last_became_active":"2024-09-15T23:56:20.707708+0000","last_became_peered":"2024-09-15T23:56:20.707708+0000","last_unstale":"2024-09-15T23:56:20.718028+0000","last_undegraded":"2024-09-15T23:56:20.718028+0000","last_fullsized":"2024-09-15T23:56:20.718028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:44.535254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722477+0000","last_change":"2024-09-15T23:56:19.699207+0000","last_active":"2024-09-15T23:56:20.722477+0000","last_peered":"2024-09-15T23:56:20.722477+0000","last_clean":"2024-09-15T23:56:20.722477+0000","last_became_active":"2024-09-15T23:56:19.698960+0000","last_became_peered":"2024-09-15T23:56:19.698960+0000","last_unstale":"2024-09-15T23:56:20.722477+0000","last_undegraded":"2024-09-15T23:56:20.722477+0000","last_fullsized":"2024-09-15T23:56:20.722477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:18.018681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677022+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:56:20.677022+0000","last_peered":"2024-09-15T23:56:20.677022+0000","last_clean":"2024-09-15T23:56:20.677022+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:56:20.677022+0000","last_undegraded":"2024-09-15T23:56:20.677022+0000","last_fullsized":"2024-09-15T23:56:20.677022+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":119293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":942080,"data_stored":714252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":954368,"data_stored":716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:23.605 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.738+0000 7fd85667b640 1 Processor -- start 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.738+0000 7fd85667b640 1 -- start start 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd85667b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd850135f30 0x7fd85013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd85667b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8500a08c0 con 0x7fd850135b50 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd85667b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd85009b310 con 0x7fd850135f30 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd850135f30 0x7fd85013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd850135b50 0x7fd85009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56840/0 (socket says 172.21.15.121:56840) 2024-09-15T23:56:23.740 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84ffff640 1 -- 172.21.15.121:0/2784284754 learned_addr learned my addr 172.21.15.121:0/2784284754 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:23.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84f7fe640 1 -- 172.21.15.121:0/2784284754 >> v1:172.21.15.121:6789/0 conn(0x7fd850135b50 legacy=0x7fd85009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84f7fe640 1 -- 172.21.15.121:0/2784284754 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8500a2270 con 0x7fd850135f30 2024-09-15T23:56:23.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.739+0000 7fd84effd640 1 -- 172.21.15.121:0/2784284754 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203799586 0 0) 0x7fd8500a08c0 con 0x7fd850135b50 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd84f7fe640 1 --2- 172.21.15.121:0/2784284754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135f30 0x7fd85013bb80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd844009720 tx=0x7fd84402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a414e5b023346d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd84effd640 1 -- 172.21.15.121:0/2784284754 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844037070 con 0x7fd850135f30 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd84effd640 1 -- 172.21.15.121:0/2784284754 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84402ae20 con 0x7fd850135f30 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd84effd640 1 -- 172.21.15.121:0/2784284754 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd844032590 con 0x7fd850135f30 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd85667b640 1 -- 172.21.15.121:0/2784284754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135f30 msgr2=0x7fd85013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.740+0000 7fd85667b640 1 --2- 172.21.15.121:0/2784284754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135f30 0x7fd85013bb80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd844009720 tx=0x7fd84402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 -- 172.21.15.121:0/2784284754 shutdown_connections 2024-09-15T23:56:23.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 --2- 172.21.15.121:0/2784284754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135f30 0x7fd85013bb80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 -- 172.21.15.121:0/2784284754 >> 172.21.15.121:0/2784284754 conn(0x7fd8500a85e0 msgr2=0x7fd8500a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 -- 172.21.15.121:0/2784284754 shutdown_connections 2024-09-15T23:56:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 -- 172.21.15.121:0/2784284754 wait complete. 2024-09-15T23:56:23.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.741+0000 7fd85667b640 1 Processor -- start 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd85667b640 1 -- start start 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd85667b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd85667b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd850136350 con 0x7fd850135b50 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46016/0 (socket says 172.21.15.121:46016) 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd84ffff640 1 -- 172.21.15.121:0/252711990 learned_addr learned my addr 172.21.15.121:0/252711990 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd84ffff640 1 -- 172.21.15.121:0/252711990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850121310 con 0x7fd850135b50 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.742+0000 7fd84ffff640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c420 tx=0x7fd84000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd840018070 con 0x7fd850135b50 2024-09-15T23:56:23.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8400074d0 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd850122400 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd840004950 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8501205c0 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.743+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fd84001b070 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.744+0000 7fd84cff9640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 0x7fd83c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.744+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7fd84004a580 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.744+0000 7fd84f7fe640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 0x7fd83c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.744+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85009aae0 con 0x7fd850135b50 2024-09-15T23:56:23.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.744+0000 7fd84f7fe640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 0x7fd83c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd844034000 tx=0x7fd84402e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:23.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.748+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd840011980 con 0x7fd850135b50 2024-09-15T23:56:23.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.909+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 --> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8500a3090 con 0x7fd83c0382a0 2024-09-15T23:56:23.916 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.915+0000 7fd84cff9640 1 -- 172.21.15.121:0/252711990 <== mgr.4466 v2:172.21.15.121:6827/1410518606 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245911 (secure 0 0 0) 0x7fd844032660 con 0x7fd83c0382a0 2024-09-15T23:56:23.919 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:23.920 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:56:23.921 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 msgr2=0x7fd83c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 0x7fd83c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd844034000 tx=0x7fd84402e000 comp rx=0 tx=0).stop 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 msgr2=0x7fd850122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c420 tx=0x7fd84000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 shutdown_connections 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fd83c0382a0 0x7fd83c03a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 --2- 172.21.15.121:0/252711990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd850135b50 0x7fd850122e30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 >> 172.21.15.121:0/252711990 conn(0x7fd8500a85e0 msgr2=0x7fd85009d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 shutdown_connections 2024-09-15T23:56:23.922 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:23.918+0000 7fd85667b640 1 -- 172.21.15.121:0/252711990 wait complete. 2024-09-15T23:56:23.929 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-15T23:56:22.349956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":221,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87428,"kb_used_data":2172,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028092,"statfs":{"total":289910292480,"available":289820766208,"internally_reserved":0,"allocated":2224128,"data_stored":1550025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000795"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712392+0000","last_change":"2024-09-15T23:56:20.704497+0000","last_active":"2024-09-15T23:56:20.712392+0000","last_peered":"2024-09-15T23:56:20.712392+0000","last_clean":"2024-09-15T23:56:20.712392+0000","last_became_active":"2024-09-15T23:56:20.703942+0000","last_became_peered":"2024-09-15T23:56:20.703942+0000","last_unstale":"2024-09-15T23:56:20.712392+0000","last_undegraded":"2024-09-15T23:56:20.712392+0000","last_fullsized":"2024-09-15T23:56:20.712392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:09.066332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722146+0000","last_change":"2024-09-15T23:56:20.715838+0000","last_active":"2024-09-15T23:56:20.722146+0000","last_peered":"2024-09-15T23:56:20.722146+0000","last_clean":"2024-09-15T23:56:20.722146+0000","last_became_active":"2024-09-15T23:56:20.715553+0000","last_became_peered":"2024-09-15T23:56:20.715553+0000","last_unstale":"2024-09-15T23:56:20.722146+0000","last_undegraded":"2024-09-15T23:56:20.722146+0000","last_fullsized":"2024-09-15T23:56:20.722146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:55.425122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717360+0000","last_change":"2024-09-15T23:56:20.712420+0000","last_active":"2024-09-15T23:56:20.717360+0000","last_peered":"2024-09-15T23:56:20.717360+0000","last_clean":"2024-09-15T23:56:20.717360+0000","last_became_active":"2024-09-15T23:56:20.711746+0000","last_became_peered":"2024-09-15T23:56:20.711746+0000","last_unstale":"2024-09-15T23:56:20.717360+0000","last_undegraded":"2024-09-15T23:56:20.717360+0000","last_fullsized":"2024-09-15T23:56:20.717360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:22.746891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713149+0000","last_change":"2024-09-15T23:56:20.706407+0000","last_active":"2024-09-15T23:56:20.713149+0000","last_peered":"2024-09-15T23:56:20.713149+0000","last_clean":"2024-09-15T23:56:20.713149+0000","last_became_active":"2024-09-15T23:56:20.706098+0000","last_became_peered":"2024-09-15T23:56:20.706098+0000","last_unstale":"2024-09-15T23:56:20.713149+0000","last_undegraded":"2024-09-15T23:56:20.713149+0000","last_fullsized":"2024-09-15T23:56:20.713149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:20.712248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702776+0000","last_change":"2024-09-15T23:56:20.694156+0000","last_active":"2024-09-15T23:56:20.702776+0000","last_peered":"2024-09-15T23:56:20.702776+0000","last_clean":"2024-09-15T23:56:20.702776+0000","last_became_active":"2024-09-15T23:56:20.693864+0000","last_became_peered":"2024-09-15T23:56:20.693864+0000","last_unstale":"2024-09-15T23:56:20.702776+0000","last_undegraded":"2024-09-15T23:56:20.702776+0000","last_fullsized":"2024-09-15T23:56:20.702776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:53:44.581099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704359+0000","last_change":"2024-09-15T23:56:20.693245+0000","last_active":"2024-09-15T23:56:20.704359+0000","last_peered":"2024-09-15T23:56:20.704359+0000","last_clean":"2024-09-15T23:56:20.704359+0000","last_became_active":"2024-09-15T23:56:20.692604+0000","last_became_peered":"2024-09-15T23:56:20.692604+0000","last_unstale":"2024-09-15T23:56:20.704359+0000","last_undegraded":"2024-09-15T23:56:20.704359+0000","last_fullsized":"2024-09-15T23:56:20.704359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:31.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.701204+0000","last_change":"2024-09-15T23:56:20.690748+0000","last_active":"2024-09-15T23:56:20.701204+0000","last_peered":"2024-09-15T23:56:20.701204+0000","last_clean":"2024-09-15T23:56:20.701204+0000","last_became_active":"2024-09-15T23:56:20.690331+0000","last_became_peered":"2024-09-15T23:56:20.690331+0000","last_unstale":"2024-09-15T23:56:20.701204+0000","last_undegraded":"2024-09-15T23:56:20.701204+0000","last_fullsized":"2024-09-15T23:56:20.701204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:13.376320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718240+0000","last_change":"2024-09-15T23:56:20.713004+0000","last_active":"2024-09-15T23:56:20.718240+0000","last_peered":"2024-09-15T23:56:20.718240+0000","last_clean":"2024-09-15T23:56:20.718240+0000","last_became_active":"2024-09-15T23:56:20.712725+0000","last_became_peered":"2024-09-15T23:56:20.712725+0000","last_unstale":"2024-09-15T23:56:20.718240+0000","last_undegraded":"2024-09-15T23:56:20.718240+0000","last_fullsized":"2024-09-15T23:56:20.718240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:03.777529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702997+0000","last_change":"2024-09-15T23:56:20.692345+0000","last_active":"2024-09-15T23:56:20.702997+0000","last_peered":"2024-09-15T23:56:20.702997+0000","last_clean":"2024-09-15T23:56:20.702997+0000","last_became_active":"2024-09-15T23:56:20.691997+0000","last_became_peered":"2024-09-15T23:56:20.691997+0000","last_unstale":"2024-09-15T23:56:20.702997+0000","last_undegraded":"2024-09-15T23:56:20.702997+0000","last_fullsized":"2024-09-15T23:56:20.702997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:28.745041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718051+0000","last_change":"2024-09-15T23:56:20.710594+0000","last_active":"2024-09-15T23:56:20.718051+0000","last_peered":"2024-09-15T23:56:20.718051+0000","last_clean":"2024-09-15T23:56:20.718051+0000","last_became_active":"2024-09-15T23:56:20.709407+0000","last_became_peered":"2024-09-15T23:56:20.709407+0000","last_unstale":"2024-09-15T23:56:20.718051+0000","last_undegraded":"2024-09-15T23:56:20.718051+0000","last_fullsized":"2024-09-15T23:56:20.718051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:35.608248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703841+0000","last_change":"2024-09-15T23:56:20.697597+0000","last_active":"2024-09-15T23:56:20.703841+0000","last_peered":"2024-09-15T23:56:20.703841+0000","last_clean":"2024-09-15T23:56:20.703841+0000","last_became_active":"2024-09-15T23:56:20.697269+0000","last_became_peered":"2024-09-15T23:56:20.697269+0000","last_unstale":"2024-09-15T23:56:20.703841+0000","last_undegraded":"2024-09-15T23:56:20.703841+0000","last_fullsized":"2024-09-15T23:56:20.703841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:13.910137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722306+0000","last_change":"2024-09-15T23:56:20.715787+0000","last_active":"2024-09-15T23:56:20.722306+0000","last_peered":"2024-09-15T23:56:20.722306+0000","last_clean":"2024-09-15T23:56:20.722306+0000","last_became_active":"2024-09-15T23:56:20.715520+0000","last_became_peered":"2024-09-15T23:56:20.715520+0000","last_unstale":"2024-09-15T23:56:20.722306+0000","last_undegraded":"2024-09-15T23:56:20.722306+0000","last_fullsized":"2024-09-15T23:56:20.722306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:37.922013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.708513+0000","last_change":"2024-09-15T23:56:20.707715+0000","last_active":"2024-09-15T23:56:20.708513+0000","last_peered":"2024-09-15T23:56:20.708513+0000","last_clean":"2024-09-15T23:56:20.708513+0000","last_became_active":"2024-09-15T23:56:20.707482+0000","last_became_peered":"2024-09-15T23:56:20.707482+0000","last_unstale":"2024-09-15T23:56:20.708513+0000","last_undegraded":"2024-09-15T23:56:20.708513+0000","last_fullsized":"2024-09-15T23:56:20.708513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:13.743332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704385+0000","last_change":"2024-09-15T23:56:20.693453+0000","last_active":"2024-09-15T23:56:20.704385+0000","last_peered":"2024-09-15T23:56:20.704385+0000","last_clean":"2024-09-15T23:56:20.704385+0000","last_became_active":"2024-09-15T23:56:20.692979+0000","last_became_peered":"2024-09-15T23:56:20.692979+0000","last_unstale":"2024-09-15T23:56:20.704385+0000","last_undegraded":"2024-09-15T23:56:20.704385+0000","last_fullsized":"2024-09-15T23:56:20.704385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:18.087012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.709299+0000","last_change":"2024-09-15T23:56:20.707737+0000","last_active":"2024-09-15T23:56:20.709299+0000","last_peered":"2024-09-15T23:56:20.709299+0000","last_clean":"2024-09-15T23:56:20.709299+0000","last_became_active":"2024-09-15T23:56:20.707475+0000","last_became_peered":"2024-09-15T23:56:20.707475+0000","last_unstale":"2024-09-15T23:56:20.709299+0000","last_undegraded":"2024-09-15T23:56:20.709299+0000","last_fullsized":"2024-09-15T23:56:20.709299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:35.021158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705454+0000","last_change":"2024-09-15T23:56:20.694911+0000","last_active":"2024-09-15T23:56:20.705454+0000","last_peered":"2024-09-15T23:56:20.705454+0000","last_clean":"2024-09-15T23:56:20.705454+0000","last_became_active":"2024-09-15T23:56:20.694301+0000","last_became_peered":"2024-09-15T23:56:20.694301+0000","last_unstale":"2024-09-15T23:56:20.705454+0000","last_undegraded":"2024-09-15T23:56:20.705454+0000","last_fullsized":"2024-09-15T23:56:20.705454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:00.802903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.706380+0000","last_change":"2024-09-15T23:56:20.702847+0000","last_active":"2024-09-15T23:56:20.706380+0000","last_peered":"2024-09-15T23:56:20.706380+0000","last_clean":"2024-09-15T23:56:20.706380+0000","last_became_active":"2024-09-15T23:56:20.702549+0000","last_became_peered":"2024-09-15T23:56:20.702549+0000","last_unstale":"2024-09-15T23:56:20.706380+0000","last_undegraded":"2024-09-15T23:56:20.706380+0000","last_fullsized":"2024-09-15T23:56:20.706380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:57.179950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704862+0000","last_change":"2024-09-15T23:56:20.698132+0000","last_active":"2024-09-15T23:56:20.704862+0000","last_peered":"2024-09-15T23:56:20.704862+0000","last_clean":"2024-09-15T23:56:20.704862+0000","last_became_active":"2024-09-15T23:56:20.697871+0000","last_became_peered":"2024-09-15T23:56:20.697871+0000","last_unstale":"2024-09-15T23:56:20.704862+0000","last_undegraded":"2024-09-15T23:56:20.704862+0000","last_fullsized":"2024-09-15T23:56:20.704862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:18.153134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703816+0000","last_change":"2024-09-15T23:56:20.695194+0000","last_active":"2024-09-15T23:56:20.703816+0000","last_peered":"2024-09-15T23:56:20.703816+0000","last_clean":"2024-09-15T23:56:20.703816+0000","last_became_active":"2024-09-15T23:56:20.694922+0000","last_became_peered":"2024-09-15T23:56:20.694922+0000","last_unstale":"2024-09-15T23:56:20.703816+0000","last_undegraded":"2024-09-15T23:56:20.703816+0000","last_fullsized":"2024-09-15T23:56:20.703816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:18.183850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722325+0000","last_change":"2024-09-15T23:56:20.716052+0000","last_active":"2024-09-15T23:56:20.722325+0000","last_peered":"2024-09-15T23:56:20.722325+0000","last_clean":"2024-09-15T23:56:20.722325+0000","last_became_active":"2024-09-15T23:56:20.715747+0000","last_became_peered":"2024-09-15T23:56:20.715747+0000","last_unstale":"2024-09-15T23:56:20.722325+0000","last_undegraded":"2024-09-15T23:56:20.722325+0000","last_fullsized":"2024-09-15T23:56:20.722325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:16.566163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722252+0000","last_change":"2024-09-15T23:56:20.719041+0000","last_active":"2024-09-15T23:56:20.722252+0000","last_peered":"2024-09-15T23:56:20.722252+0000","last_clean":"2024-09-15T23:56:20.722252+0000","last_became_active":"2024-09-15T23:56:20.718733+0000","last_became_peered":"2024-09-15T23:56:20.718733+0000","last_unstale":"2024-09-15T23:56:20.722252+0000","last_undegraded":"2024-09-15T23:56:20.722252+0000","last_fullsized":"2024-09-15T23:56:20.722252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:22.120885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704405+0000","last_change":"2024-09-15T23:56:20.693536+0000","last_active":"2024-09-15T23:56:20.704405+0000","last_peered":"2024-09-15T23:56:20.704405+0000","last_clean":"2024-09-15T23:56:20.704405+0000","last_became_active":"2024-09-15T23:56:20.691876+0000","last_became_peered":"2024-09-15T23:56:20.691876+0000","last_unstale":"2024-09-15T23:56:20.704405+0000","last_undegraded":"2024-09-15T23:56:20.704405+0000","last_fullsized":"2024-09-15T23:56:20.704405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:14.520707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704133+0000","last_change":"2024-09-15T23:56:20.696531+0000","last_active":"2024-09-15T23:56:20.704133+0000","last_peered":"2024-09-15T23:56:20.704133+0000","last_clean":"2024-09-15T23:56:20.704133+0000","last_became_active":"2024-09-15T23:56:20.694733+0000","last_became_peered":"2024-09-15T23:56:20.694733+0000","last_unstale":"2024-09-15T23:56:20.704133+0000","last_undegraded":"2024-09-15T23:56:20.704133+0000","last_fullsized":"2024-09-15T23:56:20.704133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.370510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713346+0000","last_change":"2024-09-15T23:56:20.709433+0000","last_active":"2024-09-15T23:56:20.713346+0000","last_peered":"2024-09-15T23:56:20.713346+0000","last_clean":"2024-09-15T23:56:20.713346+0000","last_became_active":"2024-09-15T23:56:20.708730+0000","last_became_peered":"2024-09-15T23:56:20.708730+0000","last_unstale":"2024-09-15T23:56:20.713346+0000","last_undegraded":"2024-09-15T23:56:20.713346+0000","last_fullsized":"2024-09-15T23:56:20.713346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:18.539727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.706960+0000","last_change":"2024-09-15T23:56:20.704206+0000","last_active":"2024-09-15T23:56:20.706960+0000","last_peered":"2024-09-15T23:56:20.706960+0000","last_clean":"2024-09-15T23:56:20.706960+0000","last_became_active":"2024-09-15T23:56:20.703587+0000","last_became_peered":"2024-09-15T23:56:20.703587+0000","last_unstale":"2024-09-15T23:56:20.706960+0000","last_undegraded":"2024-09-15T23:56:20.706960+0000","last_fullsized":"2024-09-15T23:56:20.706960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:58.042736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712677+0000","last_change":"2024-09-15T23:56:20.708903+0000","last_active":"2024-09-15T23:56:20.712677+0000","last_peered":"2024-09-15T23:56:20.712677+0000","last_clean":"2024-09-15T23:56:20.712677+0000","last_became_active":"2024-09-15T23:56:20.708615+0000","last_became_peered":"2024-09-15T23:56:20.708615+0000","last_unstale":"2024-09-15T23:56:20.712677+0000","last_undegraded":"2024-09-15T23:56:20.712677+0000","last_fullsized":"2024-09-15T23:56:20.712677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:21.075913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703862+0000","last_change":"2024-09-15T23:56:20.698003+0000","last_active":"2024-09-15T23:56:20.703862+0000","last_peered":"2024-09-15T23:56:20.703862+0000","last_clean":"2024-09-15T23:56:20.703862+0000","last_became_active":"2024-09-15T23:56:20.697750+0000","last_became_peered":"2024-09-15T23:56:20.697750+0000","last_unstale":"2024-09-15T23:56:20.703862+0000","last_undegraded":"2024-09-15T23:56:20.703862+0000","last_fullsized":"2024-09-15T23:56:20.703862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:01.784712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714117+0000","last_change":"2024-09-15T23:56:20.710738+0000","last_active":"2024-09-15T23:56:20.714117+0000","last_peered":"2024-09-15T23:56:20.714117+0000","last_clean":"2024-09-15T23:56:20.714117+0000","last_became_active":"2024-09-15T23:56:20.710350+0000","last_became_peered":"2024-09-15T23:56:20.710350+0000","last_unstale":"2024-09-15T23:56:20.714117+0000","last_undegraded":"2024-09-15T23:56:20.714117+0000","last_fullsized":"2024-09-15T23:56:20.714117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:04.925864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.702752+0000","last_change":"2024-09-15T23:56:20.693934+0000","last_active":"2024-09-15T23:56:20.702752+0000","last_peered":"2024-09-15T23:56:20.702752+0000","last_clean":"2024-09-15T23:56:20.702752+0000","last_became_active":"2024-09-15T23:56:20.692241+0000","last_became_peered":"2024-09-15T23:56:20.692241+0000","last_unstale":"2024-09-15T23:56:20.702752+0000","last_undegraded":"2024-09-15T23:56:20.702752+0000","last_fullsized":"2024-09-15T23:56:20.702752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:42:55.818058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722163+0000","last_change":"2024-09-15T23:56:20.716888+0000","last_active":"2024-09-15T23:56:20.722163+0000","last_peered":"2024-09-15T23:56:20.722163+0000","last_clean":"2024-09-15T23:56:20.722163+0000","last_became_active":"2024-09-15T23:56:20.716614+0000","last_became_peered":"2024-09-15T23:56:20.716614+0000","last_unstale":"2024-09-15T23:56:20.722163+0000","last_undegraded":"2024-09-15T23:56:20.722163+0000","last_fullsized":"2024-09-15T23:56:20.722163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:04.251828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705044+0000","last_change":"2024-09-15T23:56:20.698982+0000","last_active":"2024-09-15T23:56:20.705044+0000","last_peered":"2024-09-15T23:56:20.705044+0000","last_clean":"2024-09-15T23:56:20.705044+0000","last_became_active":"2024-09-15T23:56:20.697467+0000","last_became_peered":"2024-09-15T23:56:20.697467+0000","last_unstale":"2024-09-15T23:56:20.705044+0000","last_undegraded":"2024-09-15T23:56:20.705044+0000","last_fullsized":"2024-09-15T23:56:20.705044+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:53.944823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713368+0000","last_change":"2024-09-15T23:56:20.710057+0000","last_active":"2024-09-15T23:56:20.713368+0000","last_peered":"2024-09-15T23:56:20.713368+0000","last_clean":"2024-09-15T23:56:20.713368+0000","last_became_active":"2024-09-15T23:56:20.709097+0000","last_became_peered":"2024-09-15T23:56:20.709097+0000","last_unstale":"2024-09-15T23:56:20.713368+0000","last_undegraded":"2024-09-15T23:56:20.713368+0000","last_fullsized":"2024-09-15T23:56:20.713368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:23.288295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704710+0000","last_change":"2024-09-15T23:56:20.697033+0000","last_active":"2024-09-15T23:56:20.704710+0000","last_peered":"2024-09-15T23:56:20.704710+0000","last_clean":"2024-09-15T23:56:20.704710+0000","last_became_active":"2024-09-15T23:56:20.696772+0000","last_became_peered":"2024-09-15T23:56:20.696772+0000","last_unstale":"2024-09-15T23:56:20.704710+0000","last_undegraded":"2024-09-15T23:56:20.704710+0000","last_fullsized":"2024-09-15T23:56:20.704710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:51.650272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719774+0000","last_change":"2024-09-15T23:56:19.699159+0000","last_active":"2024-09-15T23:56:20.719774+0000","last_peered":"2024-09-15T23:56:20.719774+0000","last_clean":"2024-09-15T23:56:20.719774+0000","last_became_active":"2024-09-15T23:56:19.698923+0000","last_became_peered":"2024-09-15T23:56:19.698923+0000","last_unstale":"2024-09-15T23:56:20.719774+0000","last_undegraded":"2024-09-15T23:56:20.719774+0000","last_fullsized":"2024-09-15T23:56:20.719774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:27.036988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.700626+0000","last_change":"2024-09-15T23:56:20.691620+0000","last_active":"2024-09-15T23:56:20.700626+0000","last_peered":"2024-09-15T23:56:20.700626+0000","last_clean":"2024-09-15T23:56:20.700626+0000","last_became_active":"2024-09-15T23:56:20.690902+0000","last_became_peered":"2024-09-15T23:56:20.690902+0000","last_unstale":"2024-09-15T23:56:20.700626+0000","last_undegraded":"2024-09-15T23:56:20.700626+0000","last_fullsized":"2024-09-15T23:56:20.700626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:39.161482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719472+0000","last_change":"2024-09-15T23:56:19.686214+0000","last_active":"2024-09-15T23:56:20.719472+0000","last_peered":"2024-09-15T23:56:20.719472+0000","last_clean":"2024-09-15T23:56:20.719472+0000","last_became_active":"2024-09-15T23:56:19.685934+0000","last_became_peered":"2024-09-15T23:56:19.685934+0000","last_unstale":"2024-09-15T23:56:20.719472+0000","last_undegraded":"2024-09-15T23:56:20.719472+0000","last_fullsized":"2024-09-15T23:56:20.719472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:23.562336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714096+0000","last_change":"2024-09-15T23:56:20.710664+0000","last_active":"2024-09-15T23:56:20.714096+0000","last_peered":"2024-09-15T23:56:20.714096+0000","last_clean":"2024-09-15T23:56:20.714096+0000","last_became_active":"2024-09-15T23:56:20.710260+0000","last_became_peered":"2024-09-15T23:56:20.710260+0000","last_unstale":"2024-09-15T23:56:20.714096+0000","last_undegraded":"2024-09-15T23:56:20.714096+0000","last_fullsized":"2024-09-15T23:56:20.714096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:54.253764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719621+0000","last_change":"2024-09-15T23:56:19.694386+0000","last_active":"2024-09-15T23:56:20.719621+0000","last_peered":"2024-09-15T23:56:20.719621+0000","last_clean":"2024-09-15T23:56:20.719621+0000","last_became_active":"2024-09-15T23:56:19.693850+0000","last_became_peered":"2024-09-15T23:56:19.693850+0000","last_unstale":"2024-09-15T23:56:20.719621+0000","last_undegraded":"2024-09-15T23:56:20.719621+0000","last_fullsized":"2024-09-15T23:56:20.719621+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:10.056160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717338+0000","last_change":"2024-09-15T23:56:20.712331+0000","last_active":"2024-09-15T23:56:20.717338+0000","last_peered":"2024-09-15T23:56:20.717338+0000","last_clean":"2024-09-15T23:56:20.717338+0000","last_became_active":"2024-09-15T23:56:20.711680+0000","last_became_peered":"2024-09-15T23:56:20.711680+0000","last_unstale":"2024-09-15T23:56:20.717338+0000","last_undegraded":"2024-09-15T23:56:20.717338+0000","last_fullsized":"2024-09-15T23:56:20.717338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:52.023399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719241+0000","last_change":"2024-09-15T23:56:19.689323+0000","last_active":"2024-09-15T23:56:20.719241+0000","last_peered":"2024-09-15T23:56:20.719241+0000","last_clean":"2024-09-15T23:56:20.719241+0000","last_became_active":"2024-09-15T23:56:19.688934+0000","last_became_peered":"2024-09-15T23:56:19.688934+0000","last_unstale":"2024-09-15T23:56:20.719241+0000","last_undegraded":"2024-09-15T23:56:20.719241+0000","last_fullsized":"2024-09-15T23:56:20.719241+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:23.699701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722247+0000","last_change":"2024-09-15T23:56:20.717899+0000","last_active":"2024-09-15T23:56:20.722247+0000","last_peered":"2024-09-15T23:56:20.722247+0000","last_clean":"2024-09-15T23:56:20.722247+0000","last_became_active":"2024-09-15T23:56:20.717637+0000","last_became_peered":"2024-09-15T23:56:20.717637+0000","last_unstale":"2024-09-15T23:56:20.722247+0000","last_undegraded":"2024-09-15T23:56:20.722247+0000","last_fullsized":"2024-09-15T23:56:20.722247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:30.028626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714681+0000","last_change":"2024-09-15T23:56:19.699217+0000","last_active":"2024-09-15T23:56:20.714681+0000","last_peered":"2024-09-15T23:56:20.714681+0000","last_clean":"2024-09-15T23:56:20.714681+0000","last_became_active":"2024-09-15T23:56:19.698869+0000","last_became_peered":"2024-09-15T23:56:19.698869+0000","last_unstale":"2024-09-15T23:56:20.714681+0000","last_undegraded":"2024-09-15T23:56:20.714681+0000","last_fullsized":"2024-09-15T23:56:20.714681+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:42.489872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719506+0000","last_change":"2024-09-15T23:56:20.714864+0000","last_active":"2024-09-15T23:56:20.719506+0000","last_peered":"2024-09-15T23:56:20.719506+0000","last_clean":"2024-09-15T23:56:20.719506+0000","last_became_active":"2024-09-15T23:56:20.713754+0000","last_became_peered":"2024-09-15T23:56:20.713754+0000","last_unstale":"2024-09-15T23:56:20.719506+0000","last_undegraded":"2024-09-15T23:56:20.719506+0000","last_fullsized":"2024-09-15T23:56:20.719506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:46.731512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.716871+0000","last_change":"2024-09-15T23:56:19.694496+0000","last_active":"2024-09-15T23:56:20.716871+0000","last_peered":"2024-09-15T23:56:20.716871+0000","last_clean":"2024-09-15T23:56:20.716871+0000","last_became_active":"2024-09-15T23:56:19.694220+0000","last_became_peered":"2024-09-15T23:56:19.694220+0000","last_unstale":"2024-09-15T23:56:20.716871+0000","last_undegraded":"2024-09-15T23:56:20.716871+0000","last_fullsized":"2024-09-15T23:56:20.716871+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:37.594382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.705434+0000","last_change":"2024-09-15T23:56:20.694489+0000","last_active":"2024-09-15T23:56:20.705434+0000","last_peered":"2024-09-15T23:56:20.705434+0000","last_clean":"2024-09-15T23:56:20.705434+0000","last_became_active":"2024-09-15T23:56:20.694192+0000","last_became_peered":"2024-09-15T23:56:20.694192+0000","last_unstale":"2024-09-15T23:56:20.705434+0000","last_undegraded":"2024-09-15T23:56:20.705434+0000","last_fullsized":"2024-09-15T23:56:20.705434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:46.874329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.684144+0000","last_change":"2024-09-15T23:56:19.686245+0000","last_active":"2024-09-15T23:56:20.684144+0000","last_peered":"2024-09-15T23:56:20.684144+0000","last_clean":"2024-09-15T23:56:20.684144+0000","last_became_active":"2024-09-15T23:56:19.685062+0000","last_became_peered":"2024-09-15T23:56:19.685062+0000","last_unstale":"2024-09-15T23:56:20.684144+0000","last_undegraded":"2024-09-15T23:56:20.684144+0000","last_fullsized":"2024-09-15T23:56:20.684144+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:20.077992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.711019+0000","last_change":"2024-09-15T23:56:20.708879+0000","last_active":"2024-09-15T23:56:20.711019+0000","last_peered":"2024-09-15T23:56:20.711019+0000","last_clean":"2024-09-15T23:56:20.711019+0000","last_became_active":"2024-09-15T23:56:20.707893+0000","last_became_peered":"2024-09-15T23:56:20.707893+0000","last_unstale":"2024-09-15T23:56:20.711019+0000","last_undegraded":"2024-09-15T23:56:20.711019+0000","last_fullsized":"2024-09-15T23:56:20.711019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:58.595287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.687566+0000","last_change":"2024-09-15T23:56:19.696843+0000","last_active":"2024-09-15T23:56:20.687566+0000","last_peered":"2024-09-15T23:56:20.687566+0000","last_clean":"2024-09-15T23:56:20.687566+0000","last_became_active":"2024-09-15T23:56:19.695192+0000","last_became_peered":"2024-09-15T23:56:19.695192+0000","last_unstale":"2024-09-15T23:56:20.687566+0000","last_undegraded":"2024-09-15T23:56:20.687566+0000","last_fullsized":"2024-09-15T23:56:20.687566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:07.169275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.707428+0000","last_change":"2024-09-15T23:56:20.701720+0000","last_active":"2024-09-15T23:56:20.707428+0000","last_peered":"2024-09-15T23:56:20.707428+0000","last_clean":"2024-09-15T23:56:20.707428+0000","last_became_active":"2024-09-15T23:56:20.701136+0000","last_became_peered":"2024-09-15T23:56:20.701136+0000","last_unstale":"2024-09-15T23:56:20.707428+0000","last_undegraded":"2024-09-15T23:56:20.707428+0000","last_fullsized":"2024-09-15T23:56:20.707428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:52.175676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.679232+0000","last_change":"2024-09-15T23:56:19.690833+0000","last_active":"2024-09-15T23:56:20.679232+0000","last_peered":"2024-09-15T23:56:20.679232+0000","last_clean":"2024-09-15T23:56:20.679232+0000","last_became_active":"2024-09-15T23:56:19.690087+0000","last_became_peered":"2024-09-15T23:56:19.690087+0000","last_unstale":"2024-09-15T23:56:20.679232+0000","last_undegraded":"2024-09-15T23:56:20.679232+0000","last_fullsized":"2024-09-15T23:56:20.679232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:03.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712367+0000","last_change":"2024-09-15T23:56:20.705825+0000","last_active":"2024-09-15T23:56:20.712367+0000","last_peered":"2024-09-15T23:56:20.712367+0000","last_clean":"2024-09-15T23:56:20.712367+0000","last_became_active":"2024-09-15T23:56:20.705487+0000","last_became_peered":"2024-09-15T23:56:20.705487+0000","last_unstale":"2024-09-15T23:56:20.712367+0000","last_undegraded":"2024-09-15T23:56:20.712367+0000","last_fullsized":"2024-09-15T23:56:20.712367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:55.118141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.689919+0000","last_change":"2024-09-15T23:56:19.684971+0000","last_active":"2024-09-15T23:56:20.689919+0000","last_peered":"2024-09-15T23:56:20.689919+0000","last_clean":"2024-09-15T23:56:20.689919+0000","last_became_active":"2024-09-15T23:56:19.684181+0000","last_became_peered":"2024-09-15T23:56:19.684181+0000","last_unstale":"2024-09-15T23:56:20.689919+0000","last_undegraded":"2024-09-15T23:56:20.689919+0000","last_fullsized":"2024-09-15T23:56:20.689919+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:43.447800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.710982+0000","last_change":"2024-09-15T23:56:20.708385+0000","last_active":"2024-09-15T23:56:20.710982+0000","last_peered":"2024-09-15T23:56:20.710982+0000","last_clean":"2024-09-15T23:56:20.710982+0000","last_became_active":"2024-09-15T23:56:20.708115+0000","last_became_peered":"2024-09-15T23:56:20.708115+0000","last_unstale":"2024-09-15T23:56:20.710982+0000","last_undegraded":"2024-09-15T23:56:20.710982+0000","last_fullsized":"2024-09-15T23:56:20.710982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:37.472013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719269+0000","last_change":"2024-09-15T23:56:19.701230+0000","last_active":"2024-09-15T23:56:20.719269+0000","last_peered":"2024-09-15T23:56:20.719269+0000","last_clean":"2024-09-15T23:56:20.719269+0000","last_became_active":"2024-09-15T23:56:19.700977+0000","last_became_peered":"2024-09-15T23:56:19.700977+0000","last_unstale":"2024-09-15T23:56:20.719269+0000","last_undegraded":"2024-09-15T23:56:20.719269+0000","last_fullsized":"2024-09-15T23:56:20.719269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:25.148499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712655+0000","last_change":"2024-09-15T23:56:20.709094+0000","last_active":"2024-09-15T23:56:20.712655+0000","last_peered":"2024-09-15T23:56:20.712655+0000","last_clean":"2024-09-15T23:56:20.712655+0000","last_became_active":"2024-09-15T23:56:20.708654+0000","last_became_peered":"2024-09-15T23:56:20.708654+0000","last_unstale":"2024-09-15T23:56:20.712655+0000","last_undegraded":"2024-09-15T23:56:20.712655+0000","last_fullsized":"2024-09-15T23:56:20.712655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:13.882687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.726639+0000","last_change":"2024-09-15T23:56:19.703061+0000","last_active":"2024-09-15T23:56:20.726639+0000","last_peered":"2024-09-15T23:56:20.726639+0000","last_clean":"2024-09-15T23:56:20.726639+0000","last_became_active":"2024-09-15T23:56:19.702750+0000","last_became_peered":"2024-09-15T23:56:19.702750+0000","last_unstale":"2024-09-15T23:56:20.726639+0000","last_undegraded":"2024-09-15T23:56:20.726639+0000","last_fullsized":"2024-09-15T23:56:20.726639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:23.575094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704776+0000","last_change":"2024-09-15T23:56:20.696227+0000","last_active":"2024-09-15T23:56:20.704776+0000","last_peered":"2024-09-15T23:56:20.704776+0000","last_clean":"2024-09-15T23:56:20.704776+0000","last_became_active":"2024-09-15T23:56:20.695959+0000","last_became_peered":"2024-09-15T23:56:20.695959+0000","last_unstale":"2024-09-15T23:56:20.704776+0000","last_undegraded":"2024-09-15T23:56:20.704776+0000","last_fullsized":"2024-09-15T23:56:20.704776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:08.200587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.720396+0000","last_change":"2024-09-15T23:56:19.696212+0000","last_active":"2024-09-15T23:56:20.720396+0000","last_peered":"2024-09-15T23:56:20.720396+0000","last_clean":"2024-09-15T23:56:20.720396+0000","last_became_active":"2024-09-15T23:56:19.695986+0000","last_became_peered":"2024-09-15T23:56:19.695986+0000","last_unstale":"2024-09-15T23:56:20.720396+0000","last_undegraded":"2024-09-15T23:56:20.720396+0000","last_fullsized":"2024-09-15T23:56:20.720396+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.146610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714487+0000","last_change":"2024-09-15T23:56:20.708637+0000","last_active":"2024-09-15T23:56:20.714487+0000","last_peered":"2024-09-15T23:56:20.714487+0000","last_clean":"2024-09-15T23:56:20.714487+0000","last_became_active":"2024-09-15T23:56:20.708101+0000","last_became_peered":"2024-09-15T23:56:20.708101+0000","last_unstale":"2024-09-15T23:56:20.714487+0000","last_undegraded":"2024-09-15T23:56:20.714487+0000","last_fullsized":"2024-09-15T23:56:20.714487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:09.747796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683308+0000","last_change":"2024-09-15T23:56:19.700204+0000","last_active":"2024-09-15T23:56:20.683308+0000","last_peered":"2024-09-15T23:56:20.683308+0000","last_clean":"2024-09-15T23:56:20.683308+0000","last_became_active":"2024-09-15T23:56:19.699920+0000","last_became_peered":"2024-09-15T23:56:19.699920+0000","last_unstale":"2024-09-15T23:56:20.683308+0000","last_undegraded":"2024-09-15T23:56:20.683308+0000","last_fullsized":"2024-09-15T23:56:20.683308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:30.371927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.711485+0000","last_change":"2024-09-15T23:56:20.710055+0000","last_active":"2024-09-15T23:56:20.711485+0000","last_peered":"2024-09-15T23:56:20.711485+0000","last_clean":"2024-09-15T23:56:20.711485+0000","last_became_active":"2024-09-15T23:56:20.709780+0000","last_became_peered":"2024-09-15T23:56:20.709780+0000","last_unstale":"2024-09-15T23:56:20.711485+0000","last_undegraded":"2024-09-15T23:56:20.711485+0000","last_fullsized":"2024-09-15T23:56:20.711485+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:18:05.445423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.691145+0000","last_change":"2024-09-15T23:56:19.699359+0000","last_active":"2024-09-15T23:56:20.691145+0000","last_peered":"2024-09-15T23:56:20.691145+0000","last_clean":"2024-09-15T23:56:20.691145+0000","last_became_active":"2024-09-15T23:56:19.698476+0000","last_became_peered":"2024-09-15T23:56:19.698476+0000","last_unstale":"2024-09-15T23:56:20.691145+0000","last_undegraded":"2024-09-15T23:56:20.691145+0000","last_fullsized":"2024-09-15T23:56:20.691145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:05.758453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721911+0000","last_change":"2024-09-15T23:56:20.716218+0000","last_active":"2024-09-15T23:56:20.721911+0000","last_peered":"2024-09-15T23:56:20.721911+0000","last_clean":"2024-09-15T23:56:20.721911+0000","last_became_active":"2024-09-15T23:56:20.715898+0000","last_became_peered":"2024-09-15T23:56:20.715898+0000","last_unstale":"2024-09-15T23:56:20.721911+0000","last_undegraded":"2024-09-15T23:56:20.721911+0000","last_fullsized":"2024-09-15T23:56:20.721911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:52.934578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.724156+0000","last_change":"2024-09-15T23:56:19.700486+0000","last_active":"2024-09-15T23:56:20.724156+0000","last_peered":"2024-09-15T23:56:20.724156+0000","last_clean":"2024-09-15T23:56:20.724156+0000","last_became_active":"2024-09-15T23:56:19.697214+0000","last_became_peered":"2024-09-15T23:56:19.697214+0000","last_unstale":"2024-09-15T23:56:20.724156+0000","last_undegraded":"2024-09-15T23:56:20.724156+0000","last_fullsized":"2024-09-15T23:56:20.724156+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:29.487850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714014+0000","last_change":"2024-09-15T23:56:20.710955+0000","last_active":"2024-09-15T23:56:20.714014+0000","last_peered":"2024-09-15T23:56:20.714014+0000","last_clean":"2024-09-15T23:56:20.714014+0000","last_became_active":"2024-09-15T23:56:20.710010+0000","last_became_peered":"2024-09-15T23:56:20.710010+0000","last_unstale":"2024-09-15T23:56:20.714014+0000","last_undegraded":"2024-09-15T23:56:20.714014+0000","last_fullsized":"2024-09-15T23:56:20.714014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:42.297691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721470+0000","last_change":"2024-09-15T23:56:19.698114+0000","last_active":"2024-09-15T23:56:20.721470+0000","last_peered":"2024-09-15T23:56:20.721470+0000","last_clean":"2024-09-15T23:56:20.721470+0000","last_became_active":"2024-09-15T23:56:19.697798+0000","last_became_peered":"2024-09-15T23:56:19.697798+0000","last_unstale":"2024-09-15T23:56:20.721470+0000","last_undegraded":"2024-09-15T23:56:20.721470+0000","last_fullsized":"2024-09-15T23:56:20.721470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:08.484696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.703021+0000","last_change":"2024-09-15T23:56:20.694615+0000","last_active":"2024-09-15T23:56:20.703021+0000","last_peered":"2024-09-15T23:56:20.703021+0000","last_clean":"2024-09-15T23:56:20.703021+0000","last_became_active":"2024-09-15T23:56:20.692669+0000","last_became_peered":"2024-09-15T23:56:20.692669+0000","last_unstale":"2024-09-15T23:56:20.703021+0000","last_undegraded":"2024-09-15T23:56:20.703021+0000","last_fullsized":"2024-09-15T23:56:20.703021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:58.895172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.715056+0000","last_change":"2024-09-15T23:56:19.692305+0000","last_active":"2024-09-15T23:56:20.715056+0000","last_peered":"2024-09-15T23:56:20.715056+0000","last_clean":"2024-09-15T23:56:20.715056+0000","last_became_active":"2024-09-15T23:56:19.692025+0000","last_became_peered":"2024-09-15T23:56:19.692025+0000","last_unstale":"2024-09-15T23:56:20.715056+0000","last_undegraded":"2024-09-15T23:56:20.715056+0000","last_fullsized":"2024-09-15T23:56:20.715056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:32.822239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.714074+0000","last_change":"2024-09-15T23:56:20.710525+0000","last_active":"2024-09-15T23:56:20.714074+0000","last_peered":"2024-09-15T23:56:20.714074+0000","last_clean":"2024-09-15T23:56:20.714074+0000","last_became_active":"2024-09-15T23:56:20.709915+0000","last_became_peered":"2024-09-15T23:56:20.709915+0000","last_unstale":"2024-09-15T23:56:20.714074+0000","last_undegraded":"2024-09-15T23:56:20.714074+0000","last_fullsized":"2024-09-15T23:56:20.714074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:41.091539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721794+0000","last_change":"2024-09-15T23:56:19.691077+0000","last_active":"2024-09-15T23:56:20.721794+0000","last_peered":"2024-09-15T23:56:20.721794+0000","last_clean":"2024-09-15T23:56:20.721794+0000","last_became_active":"2024-09-15T23:56:19.687845+0000","last_became_peered":"2024-09-15T23:56:19.687845+0000","last_unstale":"2024-09-15T23:56:20.721794+0000","last_undegraded":"2024-09-15T23:56:20.721794+0000","last_fullsized":"2024-09-15T23:56:20.721794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:04.973037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717706+0000","last_change":"2024-09-15T23:56:20.712560+0000","last_active":"2024-09-15T23:56:20.717706+0000","last_peered":"2024-09-15T23:56:20.717706+0000","last_clean":"2024-09-15T23:56:20.717706+0000","last_became_active":"2024-09-15T23:56:20.712104+0000","last_became_peered":"2024-09-15T23:56:20.712104+0000","last_unstale":"2024-09-15T23:56:20.717706+0000","last_undegraded":"2024-09-15T23:56:20.717706+0000","last_fullsized":"2024-09-15T23:56:20.717706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:35.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.678540+0000","last_change":"2024-09-15T23:56:19.689550+0000","last_active":"2024-09-15T23:56:20.678540+0000","last_peered":"2024-09-15T23:56:20.678540+0000","last_clean":"2024-09-15T23:56:20.678540+0000","last_became_active":"2024-09-15T23:56:19.689285+0000","last_became_peered":"2024-09-15T23:56:19.689285+0000","last_unstale":"2024-09-15T23:56:20.678540+0000","last_undegraded":"2024-09-15T23:56:20.678540+0000","last_fullsized":"2024-09-15T23:56:20.678540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:16.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722272+0000","last_change":"2024-09-15T23:56:20.718694+0000","last_active":"2024-09-15T23:56:20.722272+0000","last_peered":"2024-09-15T23:56:20.722272+0000","last_clean":"2024-09-15T23:56:20.722272+0000","last_became_active":"2024-09-15T23:56:20.718450+0000","last_became_peered":"2024-09-15T23:56:20.718450+0000","last_unstale":"2024-09-15T23:56:20.722272+0000","last_undegraded":"2024-09-15T23:56:20.722272+0000","last_fullsized":"2024-09-15T23:56:20.722272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:03.699902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.719968+0000","last_change":"2024-09-15T23:56:19.693752+0000","last_active":"2024-09-15T23:56:20.719968+0000","last_peered":"2024-09-15T23:56:20.719968+0000","last_clean":"2024-09-15T23:56:20.719968+0000","last_became_active":"2024-09-15T23:56:19.693438+0000","last_became_peered":"2024-09-15T23:56:19.693438+0000","last_unstale":"2024-09-15T23:56:20.719968+0000","last_undegraded":"2024-09-15T23:56:20.719968+0000","last_fullsized":"2024-09-15T23:56:20.719968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:53.993520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.704954+0000","last_change":"2024-09-15T23:56:20.699756+0000","last_active":"2024-09-15T23:56:20.704954+0000","last_peered":"2024-09-15T23:56:20.704954+0000","last_clean":"2024-09-15T23:56:20.704954+0000","last_became_active":"2024-09-15T23:56:20.699505+0000","last_became_peered":"2024-09-15T23:56:20.699505+0000","last_unstale":"2024-09-15T23:56:20.704954+0000","last_undegraded":"2024-09-15T23:56:20.704954+0000","last_fullsized":"2024-09-15T23:56:20.704954+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:48.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683450+0000","last_change":"2024-09-15T23:56:19.684144+0000","last_active":"2024-09-15T23:56:20.683450+0000","last_peered":"2024-09-15T23:56:20.683450+0000","last_clean":"2024-09-15T23:56:20.683450+0000","last_became_active":"2024-09-15T23:56:19.683740+0000","last_became_peered":"2024-09-15T23:56:19.683740+0000","last_unstale":"2024-09-15T23:56:20.683450+0000","last_undegraded":"2024-09-15T23:56:20.683450+0000","last_fullsized":"2024-09-15T23:56:20.683450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:11.966919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713926+0000","last_change":"2024-09-15T23:56:20.710702+0000","last_active":"2024-09-15T23:56:20.713926+0000","last_peered":"2024-09-15T23:56:20.713926+0000","last_clean":"2024-09-15T23:56:20.713926+0000","last_became_active":"2024-09-15T23:56:20.710181+0000","last_became_peered":"2024-09-15T23:56:20.710181+0000","last_unstale":"2024-09-15T23:56:20.713926+0000","last_undegraded":"2024-09-15T23:56:20.713926+0000","last_fullsized":"2024-09-15T23:56:20.713926+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:15.045401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.684290+0000","last_change":"2024-09-15T23:56:19.694797+0000","last_active":"2024-09-15T23:56:20.684290+0000","last_peered":"2024-09-15T23:56:20.684290+0000","last_clean":"2024-09-15T23:56:20.684290+0000","last_became_active":"2024-09-15T23:56:19.694510+0000","last_became_peered":"2024-09-15T23:56:19.694510+0000","last_unstale":"2024-09-15T23:56:20.684290+0000","last_undegraded":"2024-09-15T23:56:20.684290+0000","last_fullsized":"2024-09-15T23:56:20.684290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:20.863085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.701181+0000","last_change":"2024-09-15T23:56:20.690625+0000","last_active":"2024-09-15T23:56:20.701181+0000","last_peered":"2024-09-15T23:56:20.701181+0000","last_clean":"2024-09-15T23:56:20.701181+0000","last_became_active":"2024-09-15T23:56:20.690008+0000","last_became_peered":"2024-09-15T23:56:20.690008+0000","last_unstale":"2024-09-15T23:56:20.701181+0000","last_undegraded":"2024-09-15T23:56:20.701181+0000","last_fullsized":"2024-09-15T23:56:20.701181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:53.296657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.692812+0000","last_change":"2024-09-15T23:56:19.699847+0000","last_active":"2024-09-15T23:56:20.692812+0000","last_peered":"2024-09-15T23:56:20.692812+0000","last_clean":"2024-09-15T23:56:20.692812+0000","last_became_active":"2024-09-15T23:56:19.698457+0000","last_became_peered":"2024-09-15T23:56:19.698457+0000","last_unstale":"2024-09-15T23:56:20.692812+0000","last_undegraded":"2024-09-15T23:56:20.692812+0000","last_fullsized":"2024-09-15T23:56:20.692812+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:46.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.717425+0000","last_change":"2024-09-15T23:56:20.711902+0000","last_active":"2024-09-15T23:56:20.717425+0000","last_peered":"2024-09-15T23:56:20.717425+0000","last_clean":"2024-09-15T23:56:20.717425+0000","last_became_active":"2024-09-15T23:56:20.711592+0000","last_became_peered":"2024-09-15T23:56:20.711592+0000","last_unstale":"2024-09-15T23:56:20.717425+0000","last_undegraded":"2024-09-15T23:56:20.717425+0000","last_fullsized":"2024-09-15T23:56:20.717425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:46.163844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.679168+0000","last_change":"2024-09-15T23:56:19.690132+0000","last_active":"2024-09-15T23:56:20.679168+0000","last_peered":"2024-09-15T23:56:20.679168+0000","last_clean":"2024-09-15T23:56:20.679168+0000","last_became_active":"2024-09-15T23:56:19.689823+0000","last_became_peered":"2024-09-15T23:56:19.689823+0000","last_unstale":"2024-09-15T23:56:20.679168+0000","last_undegraded":"2024-09-15T23:56:20.679168+0000","last_fullsized":"2024-09-15T23:56:20.679168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:57.040079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.691758+0000","last_change":"2024-09-15T23:56:20.690224+0000","last_active":"2024-09-15T23:56:20.691758+0000","last_peered":"2024-09-15T23:56:20.691758+0000","last_clean":"2024-09-15T23:56:20.691758+0000","last_became_active":"2024-09-15T23:56:20.689916+0000","last_became_peered":"2024-09-15T23:56:20.689916+0000","last_unstale":"2024-09-15T23:56:20.691758+0000","last_undegraded":"2024-09-15T23:56:20.691758+0000","last_fullsized":"2024-09-15T23:56:20.691758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:06.655563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.682299+0000","last_change":"2024-09-15T23:56:19.684703+0000","last_active":"2024-09-15T23:56:20.682299+0000","last_peered":"2024-09-15T23:56:20.682299+0000","last_clean":"2024-09-15T23:56:20.682299+0000","last_became_active":"2024-09-15T23:56:19.684441+0000","last_became_peered":"2024-09-15T23:56:19.684441+0000","last_unstale":"2024-09-15T23:56:20.682299+0000","last_undegraded":"2024-09-15T23:56:20.682299+0000","last_fullsized":"2024-09-15T23:56:20.682299+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:13.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.721968+0000","last_change":"2024-09-15T23:56:20.714759+0000","last_active":"2024-09-15T23:56:20.721968+0000","last_peered":"2024-09-15T23:56:20.721968+0000","last_clean":"2024-09-15T23:56:20.721968+0000","last_became_active":"2024-09-15T23:56:20.714471+0000","last_became_peered":"2024-09-15T23:56:20.714471+0000","last_unstale":"2024-09-15T23:56:20.721968+0000","last_undegraded":"2024-09-15T23:56:20.721968+0000","last_fullsized":"2024-09-15T23:56:20.721968+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:11.687702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.678994+0000","last_change":"2024-09-15T23:56:19.694373+0000","last_active":"2024-09-15T23:56:20.678994+0000","last_peered":"2024-09-15T23:56:20.678994+0000","last_clean":"2024-09-15T23:56:20.678994+0000","last_became_active":"2024-09-15T23:56:19.694083+0000","last_became_peered":"2024-09-15T23:56:19.694083+0000","last_unstale":"2024-09-15T23:56:20.678994+0000","last_undegraded":"2024-09-15T23:56:20.678994+0000","last_fullsized":"2024-09-15T23:56:20.678994+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:26.777939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713291+0000","last_change":"2024-09-15T23:56:20.709982+0000","last_active":"2024-09-15T23:56:20.713291+0000","last_peered":"2024-09-15T23:56:20.713291+0000","last_clean":"2024-09-15T23:56:20.713291+0000","last_became_active":"2024-09-15T23:56:20.709656+0000","last_became_peered":"2024-09-15T23:56:20.709656+0000","last_unstale":"2024-09-15T23:56:20.713291+0000","last_undegraded":"2024-09-15T23:56:20.713291+0000","last_fullsized":"2024-09-15T23:56:20.713291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:21.403024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.683784+0000","last_change":"2024-09-15T23:56:19.699142+0000","last_active":"2024-09-15T23:56:20.683784+0000","last_peered":"2024-09-15T23:56:20.683784+0000","last_clean":"2024-09-15T23:56:20.683784+0000","last_became_active":"2024-09-15T23:56:19.698665+0000","last_became_peered":"2024-09-15T23:56:19.698665+0000","last_unstale":"2024-09-15T23:56:20.683784+0000","last_undegraded":"2024-09-15T23:56:20.683784+0000","last_fullsized":"2024-09-15T23:56:20.683784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.527319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.715401+0000","last_change":"2024-09-15T23:56:20.708841+0000","last_active":"2024-09-15T23:56:20.715401+0000","last_peered":"2024-09-15T23:56:20.715401+0000","last_clean":"2024-09-15T23:56:20.715401+0000","last_became_active":"2024-09-15T23:56:20.708403+0000","last_became_peered":"2024-09-15T23:56:20.708403+0000","last_unstale":"2024-09-15T23:56:20.715401+0000","last_undegraded":"2024-09-15T23:56:20.715401+0000","last_fullsized":"2024-09-15T23:56:20.715401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:02.366385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677748+0000","last_change":"2024-09-15T23:56:19.684807+0000","last_active":"2024-09-15T23:56:20.677748+0000","last_peered":"2024-09-15T23:56:20.677748+0000","last_clean":"2024-09-15T23:56:20.677748+0000","last_became_active":"2024-09-15T23:56:19.684546+0000","last_became_peered":"2024-09-15T23:56:19.684546+0000","last_unstale":"2024-09-15T23:56:20.677748+0000","last_undegraded":"2024-09-15T23:56:20.677748+0000","last_fullsized":"2024-09-15T23:56:20.677748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.713167+0000","last_change":"2024-09-15T23:56:20.712020+0000","last_active":"2024-09-15T23:56:20.713167+0000","last_peered":"2024-09-15T23:56:20.713167+0000","last_clean":"2024-09-15T23:56:20.713167+0000","last_became_active":"2024-09-15T23:56:20.709304+0000","last_became_peered":"2024-09-15T23:56:20.709304+0000","last_unstale":"2024-09-15T23:56:20.713167+0000","last_undegraded":"2024-09-15T23:56:20.713167+0000","last_fullsized":"2024-09-15T23:56:20.713167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:44.309259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677148+0000","last_change":"2024-09-15T23:56:19.682125+0000","last_active":"2024-09-15T23:56:20.677148+0000","last_peered":"2024-09-15T23:56:20.677148+0000","last_clean":"2024-09-15T23:56:20.677148+0000","last_became_active":"2024-09-15T23:56:19.681850+0000","last_became_peered":"2024-09-15T23:56:19.681850+0000","last_unstale":"2024-09-15T23:56:20.677148+0000","last_undegraded":"2024-09-15T23:56:20.677148+0000","last_fullsized":"2024-09-15T23:56:20.677148+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:32.863735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.712605+0000","last_change":"2024-09-15T23:56:20.708412+0000","last_active":"2024-09-15T23:56:20.712605+0000","last_peered":"2024-09-15T23:56:20.712605+0000","last_clean":"2024-09-15T23:56:20.712605+0000","last_became_active":"2024-09-15T23:56:20.708170+0000","last_became_peered":"2024-09-15T23:56:20.708170+0000","last_unstale":"2024-09-15T23:56:20.712605+0000","last_undegraded":"2024-09-15T23:56:20.712605+0000","last_fullsized":"2024-09-15T23:56:20.712605+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:07.603573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.687193+0000","last_change":"2024-09-15T23:56:19.697356+0000","last_active":"2024-09-15T23:56:20.687193+0000","last_peered":"2024-09-15T23:56:20.687193+0000","last_clean":"2024-09-15T23:56:20.687193+0000","last_became_active":"2024-09-15T23:56:19.697077+0000","last_became_peered":"2024-09-15T23:56:19.697077+0000","last_unstale":"2024-09-15T23:56:20.687193+0000","last_undegraded":"2024-09-15T23:56:20.687193+0000","last_fullsized":"2024-09-15T23:56:20.687193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:11.467305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.718028+0000","last_change":"2024-09-15T23:56:20.710375+0000","last_active":"2024-09-15T23:56:20.718028+0000","last_peered":"2024-09-15T23:56:20.718028+0000","last_clean":"2024-09-15T23:56:20.718028+0000","last_became_active":"2024-09-15T23:56:20.707708+0000","last_became_peered":"2024-09-15T23:56:20.707708+0000","last_unstale":"2024-09-15T23:56:20.718028+0000","last_undegraded":"2024-09-15T23:56:20.718028+0000","last_fullsized":"2024-09-15T23:56:20.718028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:44.535254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.722477+0000","last_change":"2024-09-15T23:56:19.699207+0000","last_active":"2024-09-15T23:56:20.722477+0000","last_peered":"2024-09-15T23:56:20.722477+0000","last_clean":"2024-09-15T23:56:20.722477+0000","last_became_active":"2024-09-15T23:56:19.698960+0000","last_became_peered":"2024-09-15T23:56:19.698960+0000","last_unstale":"2024-09-15T23:56:20.722477+0000","last_undegraded":"2024-09-15T23:56:20.722477+0000","last_fullsized":"2024-09-15T23:56:20.722477+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:18.018681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":264,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T23:56:20.677022+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:56:20.677022+0000","last_peered":"2024-09-15T23:56:20.677022+0000","last_clean":"2024-09-15T23:56:20.677022+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:56:20.677022+0000","last_undegraded":"2024-09-15T23:56:20.677022+0000","last_fullsized":"2024-09-15T23:56:20.677022+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705682,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":119293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705682,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":942080,"data_stored":714252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705682,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":954368,"data_stored":716480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:23.934 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:56:23.934 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:56:24.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cce51f640 1 Processor -- start 2024-09-15T23:56:24.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cce51f640 1 -- start start 2024-09-15T23:56:24.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cce51f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2cc80a3b90 0x7f2cc80a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cce51f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc80a4560 con 0x7f2cc80a37b0 2024-09-15T23:56:24.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cce51f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc809b4f0 con 0x7f2cc80a3b90 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cc77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2cc80a3b90 0x7f2cc80a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cc7fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2cc80a37b0 0x7f2cc809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56842/0 (socket says 172.21.15.121:56842) 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.075+0000 7f2cc7fff640 1 -- 172.21.15.121:0/1867088098 learned_addr learned my addr 172.21.15.121:0/1867088098 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.076+0000 7f2cc77fe640 1 -- 172.21.15.121:0/1867088098 >> v1:172.21.15.121:6789/0 conn(0x7f2cc80a37b0 legacy=0x7f2cc809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.076+0000 7f2cc77fe640 1 -- 172.21.15.121:0/1867088098 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80a1c90 con 0x7f2cc80a3b90 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.076+0000 7f2cc77fe640 1 --2- 172.21.15.121:0/1867088098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a3b90 0x7f2cc80a4020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009720 tx=0x7f2cbc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859deb7fef2ae79a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.076+0000 7f2cc6ffd640 1 -- 172.21.15.121:0/1867088098 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc037070 con 0x7f2cc80a3b90 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cc6ffd640 1 -- 172.21.15.121:0/1867088098 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc02ad90 con 0x7f2cc80a3b90 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cc6ffd640 1 -- 172.21.15.121:0/1867088098 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc032590 con 0x7f2cc80a3b90 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 -- 172.21.15.121:0/1867088098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a3b90 msgr2=0x7f2cc80a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 --2- 172.21.15.121:0/1867088098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a3b90 0x7f2cc80a4020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009720 tx=0x7f2cbc02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:24.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 -- 172.21.15.121:0/1867088098 shutdown_connections 2024-09-15T23:56:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 --2- 172.21.15.121:0/1867088098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a3b90 0x7f2cc80a4020 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 -- 172.21.15.121:0/1867088098 >> 172.21.15.121:0/1867088098 conn(0x7f2cc80a8430 msgr2=0x7f2cc80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 -- 172.21.15.121:0/1867088098 shutdown_connections 2024-09-15T23:56:24.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.077+0000 7f2cce51f640 1 -- 172.21.15.121:0/1867088098 wait complete. 2024-09-15T23:56:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.078+0000 7f2cce51f640 1 Processor -- start 2024-09-15T23:56:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.078+0000 7f2cce51f640 1 -- start start 2024-09-15T23:56:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.078+0000 7f2cce51f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cce51f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc80a5220 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46030/0 (socket says 172.21.15.121:46030) 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc7fff640 1 -- 172.21.15.121:0/530924136 learned_addr learned my addr 172.21.15.121:0/530924136 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc7fff640 1 -- 172.21.15.121:0/530924136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc8138420 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc7fff640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800c4a0 tx=0x7f2cb800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb8017070 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8005c10 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc813ac20 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb8007070 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.079+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc8138140 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.080+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f2cb801a070 con 0x7f2cc80a37b0 2024-09-15T23:56:24.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.080+0000 7f2cc4ff9640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 0x7f2cb403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.080+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc8139c70 con 0x7f2cc80a37b0 2024-09-15T23:56:24.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.080+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f2cb804a430 con 0x7f2cc80a37b0 2024-09-15T23:56:24.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.080+0000 7f2cc77fe640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 0x7f2cb403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.084 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.081+0000 7f2cc77fe640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 0x7f2cb403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009720 tx=0x7f2cbc02e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.085 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.085+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cb8012400 con 0x7f2cc80a37b0 2024-09-15T23:56:24.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.311+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2cc80a4020 con 0x7f2cc80a37b0 2024-09-15T23:56:24.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.312+0000 7f2cc4ff9640 1 -- 172.21.15.121:0/530924136 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7f2cb8005450 con 0x7f2cc80a37b0 2024-09-15T23:56:24.313 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-15T23:56:24.313 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg== 2024-09-15T23:56:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-15T23:56:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-15T23:56:24.314 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:56:24.314 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 msgr2=0x7f2cb403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 0x7f2cb403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009720 tx=0x7f2cbc02e000 comp rx=0 tx=0).stop 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 msgr2=0x7f2cc8139540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800c4a0 tx=0x7f2cb800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 shutdown_connections 2024-09-15T23:56:24.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f2cb40382a0 0x7f2cb403a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 --2- 172.21.15.121:0/530924136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc80a37b0 0x7f2cc8139540 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 >> 172.21.15.121:0/530924136 conn(0x7f2cc80a8430 msgr2=0x7f2cc80a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 shutdown_connections 2024-09-15T23:56:24.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.315+0000 7f2cce51f640 1 -- 172.21.15.121:0/530924136 wait complete. 2024-09-15T23:56:24.326 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:24.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.424+0000 7fdd73035640 1 Processor -- start 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.424+0000 7fdd73035640 1 -- start start 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd73035640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd6c135b50 0x7fdd6c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd73035640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c09b020 con 0x7fdd6c135f30 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd73035640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6c09b310 con 0x7fdd6c135b50 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd70dd1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd6c135b50 0x7fdd6c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd6bfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdd6c135f30 0x7fdd6c0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56848/0 (socket says 172.21.15.121:56848) 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd6bfff640 1 -- 172.21.15.121:0/2731558094 learned_addr learned my addr 172.21.15.121:0/2731558094 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd70dd1640 1 -- 172.21.15.121:0/2731558094 >> v1:172.21.15.121:6789/0 conn(0x7fdd6c135f30 legacy=0x7fdd6c0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.425+0000 7fdd70dd1640 1 -- 172.21.15.121:0/2731558094 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c0a08c0 con 0x7fdd6c135b50 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd70dd1640 1 --2- 172.21.15.121:0/2731558094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c09aae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009d90 tx=0x7fdd6402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bd199e8cc7e874 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd6b7fe640 1 -- 172.21.15.121:0/2731558094 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd64007670 con 0x7fdd6c135b50 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd6b7fe640 1 -- 172.21.15.121:0/2731558094 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd64007810 con 0x7fdd6c135b50 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd6b7fe640 1 -- 172.21.15.121:0/2731558094 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd64007b10 con 0x7fdd6c135b50 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd73035640 1 -- 172.21.15.121:0/2731558094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 msgr2=0x7fdd6c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd73035640 1 --2- 172.21.15.121:0/2731558094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c09aae0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009d90 tx=0x7fdd6402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd73035640 1 -- 172.21.15.121:0/2731558094 shutdown_connections 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd73035640 1 --2- 172.21.15.121:0/2731558094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c09aae0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.426+0000 7fdd73035640 1 -- 172.21.15.121:0/2731558094 >> 172.21.15.121:0/2731558094 conn(0x7fdd6c0a85e0 msgr2=0x7fdd6c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.427+0000 7fdd73035640 1 -- 172.21.15.121:0/2731558094 shutdown_connections 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.427+0000 7fdd73035640 1 -- 172.21.15.121:0/2731558094 wait complete. 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.427+0000 7fdd73035640 1 Processor -- start 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.427+0000 7fdd73035640 1 -- start start 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd73035640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd73035640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c0a5430 con 0x7fdd6c135b50 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd70dd1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd70dd1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46052/0 (socket says 172.21.15.121:46052) 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd70dd1640 1 -- 172.21.15.121:0/3578734863 learned_addr learned my addr 172.21.15.121:0/3578734863 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.428+0000 7fdd70dd1640 1 -- 172.21.15.121:0/3578734863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c0a4330 con 0x7fdd6c135b50 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd70dd1640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009d90 tx=0x7fdd64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd64040070 con 0x7fdd6c135b50 2024-09-15T23:56:24.431 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd64031a90 con 0x7fdd6c135b50 2024-09-15T23:56:24.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd64031d70 con 0x7fdd6c135b50 2024-09-15T23:56:24.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c09d0f0 con 0x7fdd6c135b50 2024-09-15T23:56:24.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c1213d0 con 0x7fdd6c135b50 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.429+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fdd64039040 con 0x7fdd6c135b50 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.430+0000 7fdd697fa640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 0x7fdd5803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.430+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7fdd6406ce20 con 0x7fdd6c135b50 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.430+0000 7fdd6bfff640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 0x7fdd5803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.430+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c136350 con 0x7fdd6c135b50 2024-09-15T23:56:24.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.430+0000 7fdd6bfff640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 0x7fdd5803a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007fd0 tx=0x7fdd60007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.434+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd6403adc0 con 0x7fdd6c135b50 2024-09-15T23:56:24.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.631+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd6c0a1f10 con 0x7fdd6c135b50 2024-09-15T23:56:24.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.631+0000 7fdd697fa640 1 -- 172.21.15.121:0/3578734863 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3573 (secure 0 0 0) 0x7fdd64044e30 con 0x7fdd6c135b50 2024-09-15T23:56:24.633 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:24.633 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":18,"btime":"2024-09-15T23:56:22:681699+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4536,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3}]} 2024-09-15T23:56:24.633 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 18 2024-09-15T23:56:24.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 msgr2=0x7fdd5803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 0x7fdd5803a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007fd0 tx=0x7fdd60007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 msgr2=0x7fdd6c1351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009d90 tx=0x7fdd64004a40 comp rx=0 tx=0).stop 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 shutdown_connections 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fdd580382a0 0x7fdd5803a760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 --2- 172.21.15.121:0/3578734863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd6c135b50 0x7fdd6c1351e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.633+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 >> 172.21.15.121:0/3578734863 conn(0x7fdd6c0a85e0 msgr2=0x7fdd6c0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.634+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 shutdown_connections 2024-09-15T23:56:24.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.634+0000 7fdd73035640 1 -- 172.21.15.121:0/3578734863 wait complete. 2024-09-15T23:56:24.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:56:20.014531+0000', 'modified': '2024-09-15T23:56:22.003662+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4537}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4537': {'gid': 4537, 'name': 'a', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6828/469179342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6825', 'nonce': 469179342}, {'type': 'v1', 'addr': '172.21.15.121:6828', 'nonce': 469179342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4537, 'qdb_cluster': [4537]} 2024-09-15T23:56:24.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:56:24.847 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:56:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.945+0000 7f7c9b34b640 1 Processor -- start 2024-09-15T23:56:24.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.945+0000 7f7c9b34b640 1 -- start start 2024-09-15T23:56:24.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.945+0000 7f7c9b34b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c94133640 0x7f7c9413b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.945+0000 7f7c9b34b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c940a16c0 con 0x7f7c940a39c0 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.945+0000 7f7c9b34b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7c940a1490 con 0x7f7c94133640 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c988e6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c94133640 0x7f7c9413b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c990e7640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f7c940a39c0 0x7f7c94132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56854/0 (socket says 172.21.15.121:56854) 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c988e6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7c94133640 0x7f7c9413b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46064/0 (socket says 172.21.15.121:46064) 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c990e7640 1 -- 172.21.15.121:0/2417619499 learned_addr learned my addr 172.21.15.121:0/2417619499 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c988e6640 1 -- 172.21.15.121:0/2417619499 >> v1:172.21.15.121:6789/0 conn(0x7f7c940a39c0 legacy=0x7f7c94132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.946+0000 7f7c988e6640 1 -- 172.21.15.121:0/2417619499 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c940a4010 con 0x7f7c94133640 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c988e6640 1 --2- 172.21.15.121:0/2417619499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c94133640 0x7f7c9413b270 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009720 tx=0x7f7c8402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92644915226540c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c8bfff640 1 -- 172.21.15.121:0/2417619499 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84037070 con 0x7f7c94133640 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c8bfff640 1 -- 172.21.15.121:0/2417619499 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8402ad90 con 0x7f7c94133640 2024-09-15T23:56:24.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c8bfff640 1 -- 172.21.15.121:0/2417619499 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84032590 con 0x7f7c94133640 2024-09-15T23:56:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2417619499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c94133640 msgr2=0x7f7c9413b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2417619499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c94133640 0x7f7c9413b270 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009720 tx=0x7f7c8402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2417619499 shutdown_connections 2024-09-15T23:56:24.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2417619499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c94133640 0x7f7c9413b270 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2417619499 >> 172.21.15.121:0/2417619499 conn(0x7f7c940a85e0 msgr2=0x7f7c940a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2417619499 shutdown_connections 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.947+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2417619499 wait complete. 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.948+0000 7f7c9b34b640 1 Processor -- start 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.948+0000 7f7c9b34b640 1 -- start start 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c9b34b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c9b34b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c941329c0 con 0x7f7c940a39c0 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46076/0 (socket says 172.21.15.121:46076) 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c990e7640 1 -- 172.21.15.121:0/2523789942 learned_addr learned my addr 172.21.15.121:0/2523789942 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c990e7640 1 -- 172.21.15.121:0/2523789942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c94071440 con 0x7f7c940a39c0 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c990e7640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c480 tx=0x7f7c9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c89ffb640 1 -- 172.21.15.121:0/2523789942 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c90017070 con 0x7f7c940a39c0 2024-09-15T23:56:24.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c89ffb640 1 -- 172.21.15.121:0/2523789942 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90005c10 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c94072200 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.949+0000 7f7c89ffb640 1 -- 172.21.15.121:0/2523789942 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c900070d0 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.950+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c940733b0 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.950+0000 7f7c89ffb640 1 -- 172.21.15.121:0/2523789942 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f7c9001a070 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.950+0000 7f7c89ffb640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 0x7f7c7803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.951+0000 7f7c89ffb640 1 -- 172.21.15.121:0/2523789942 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f7c9004a4a0 con 0x7f7c940a39c0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.951+0000 7f7c988e6640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 0x7f7c7803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.951+0000 7f7c988e6640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 0x7f7c7803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c8402e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.952+0000 7f7c9dd22740 1 Processor -- start 2024-09-15T23:56:24.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.952+0000 7f7c9dd22740 1 -- start start 2024-09-15T23:56:24.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.952+0000 7f7c9dd22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.952+0000 7f7c9dd22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ee678d520 con 0x561ee684b4e0 2024-09-15T23:56:24.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.952+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46084/0 (socket says 172.21.15.121:46084) 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c990e7640 1 -- 172.21.15.121:0/3983520244 learned_addr learned my addr 172.21.15.121:0/3983520244 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c990e7640 1 -- 172.21.15.121:0/3983520244 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ee67502f0 con 0x561ee684b4e0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c990e7640 1 --2- 172.21.15.121:0/3983520244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cee0 tx=0x7f7c90007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30534d9698f5831 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c7effd640 1 -- 172.21.15.121:0/3983520244 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c90042070 con 0x561ee684b4e0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c7effd640 1 -- 172.21.15.121:0/3983520244 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c7effd640 1 -- 172.21.15.121:0/3983520244 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c90019ae0 con 0x561ee684b4e0 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c9dd22740 1 -- 172.21.15.121:0/3983520244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 msgr2=0x561ee6845f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/3983520244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cee0 tx=0x7f7c90007330 comp rx=0 tx=0).stop 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.953+0000 7f7c9dd22740 1 -- 172.21.15.121:0/3983520244 shutdown_connections 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/3983520244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6845f10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 -- 172.21.15.121:0/3983520244 >> 172.21.15.121:0/3983520244 conn(0x561ee68281d0 msgr2=0x561ee6828f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 -- 172.21.15.121:0/3983520244 shutdown_connections 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 -- 172.21.15.121:0/3983520244 wait complete. 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 -- start start 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.954+0000 7f7c9dd22740 1 Processor -- start 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ee67894e0 con 0x561ee684b4e0 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 10 client.0 _ll_register_callbacks cb 0x561ee649fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46088/0 (socket says 172.21.15.121:46088) 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c990e7640 1 -- 172.21.15.121:0/2418923076 learned_addr learned my addr 172.21.15.121:0/2418923076 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c990e7640 1 -- 172.21.15.121:0/2418923076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ee64a02d0 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c990e7640 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7c90019840 tx=0x7f7c9001bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab1920d5514f3b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c9002e060 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f7c90043070 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c90042030 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 10 client.4590 fetch_fsmap learned FSMap version 18 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561ee656a6b0 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.955+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 18) ==== 2292+0+0 (secure 0 0 0) 0x7f7c900109c0 con 0x561ee684b4e0 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 10 client.4590 fetch_fsmap finished waiting for FSMap version 18 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 10 client.4590 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 20 client.4590 populate_metadata read hostname 'smithi121' 2024-09-15T23:56:24.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee684d890 0x561ee6860f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 4 client.4590 mds_command: new command op to 4537 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 --> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ee679ac50 con 0x561ee684d890 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c988e6640 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee684d890 0x561ee6860f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c73fff640 10 client.4590 ms_handle_connect on v2:172.21.15.121:6825/469179342 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.956+0000 7f7c988e6640 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee684d890 0x561ee6860f30 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c86d260dca12403 server_cookie=92bb8bd5e2c74fea in_seq=0 out_seq=0 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c73fff640 1 -- 172.21.15.121:0/2418923076 <== mds.0 v2:172.21.15.121:6825/469179342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ee679ac50 con 0x561ee684d890 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c73fff640 10 client.4590 handle_command_reply: tid=0 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 client.4590 shutdown 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 msgr2=0x561ee684cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7c90019840 tx=0x7f7c9001bf10 comp rx=0 tx=0).stop 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 shutdown_connections 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee684d890 0x561ee6860f30 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2418923076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee684cde0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c73fff640 0 client.4590 ms_handle_reset on v2:172.21.15.121:6825/469179342 2024-09-15T23:56:24.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 >> 172.21.15.121:0/2418923076 conn(0x561ee68281d0 msgr2=0x561ee6845b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 shutdown_connections 2024-09-15T23:56:24.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2418923076 wait complete. 2024-09-15T23:56:24.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.957+0000 7f7c9dd22740 20 client.4590 trim_cache size 0 max 16384 2024-09-15T23:56:24.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.974+0000 7f7c9dd22740 1 Processor -- start 2024-09-15T23:56:24.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.974+0000 7f7c9dd22740 1 -- start start 2024-09-15T23:56:24.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c9dd22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c9dd22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7c941cd320 con 0x561ee684b4e0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46092/0 (socket says 172.21.15.121:46092) 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c990e7640 1 -- 172.21.15.121:0/2016841223 learned_addr learned my addr 172.21.15.121:0/2016841223 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c990e7640 1 -- 172.21.15.121:0/2016841223 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ee684cae0 con 0x561ee684b4e0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.975+0000 7f7c990e7640 1 --2- 172.21.15.121:0/2016841223 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cee0 tx=0x7f7c90026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874919d1835b8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c7e7fc640 1 -- 172.21.15.121:0/2016841223 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c90019680 con 0x561ee684b4e0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c7e7fc640 1 -- 172.21.15.121:0/2016841223 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c7e7fc640 1 -- 172.21.15.121:0/2016841223 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c9001b4f0 con 0x561ee684b4e0 2024-09-15T23:56:24.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2016841223 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 msgr2=0x561ee6820ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2016841223 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000cee0 tx=0x7f7c90026000 comp rx=0 tx=0).stop 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2016841223 shutdown_connections 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/2016841223 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6820ef0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2016841223 >> 172.21.15.121:0/2016841223 conn(0x561ee68281d0 msgr2=0x561ee6840640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2016841223 shutdown_connections 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- 172.21.15.121:0/2016841223 wait complete. 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.976+0000 7f7c9dd22740 1 -- start start 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c9dd22740 1 Processor -- start 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c9dd22740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c9dd22740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ee67353e0 con 0x561ee684b4e0 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c9dd22740 10 client.0 _ll_register_callbacks cb 0x7f7c90040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c990e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46098/0 (socket says 172.21.15.121:46098) 2024-09-15T23:56:24.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.977+0000 7f7c990e7640 1 -- 172.21.15.121:0/1834646594 learned_addr learned my addr 172.21.15.121:0/1834646594 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c990e7640 1 -- 172.21.15.121:0/1834646594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ee68640c0 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c990e7640 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c90019a70 tx=0x7f7c900194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449cd5ce96bfc62b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c900192c0 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f7c9004f070 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f7c9002e070 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 10 client.4592 fetch_fsmap learned FSMap version 18 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x561ee68640c0 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c90045040 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 18) ==== 2292+0+0 (secure 0 0 0) 0x7f7c9003c650 con 0x561ee684b4e0 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 10 client.4592 fetch_fsmap finished waiting for FSMap version 18 2024-09-15T23:56:24.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 10 client.4592 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 20 client.4592 populate_metadata read hostname 'smithi121' 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee6861680 0x561ee68c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 4 client.4592 mds_command: new command op to 4537 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 --> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] -- command(tid 0: {"prefix": "status"}) -- 0x561ee6794fa0 con 0x561ee6861680 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.978+0000 7f7c988e6640 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee6861680 0x561ee68c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c988e6640 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee6861680 0x561ee68c3520 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e155cef38bb82629 server_cookie=2d039f665d9e389a in_seq=0 out_seq=0 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c73fff640 10 client.4592 ms_handle_connect on v2:172.21.15.121:6825/469179342 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c73fff640 1 -- 172.21.15.121:0/1834646594 <== mds.0 v2:172.21.15.121:6825/469179342 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x561ee6794fa0 con 0x561ee6861680 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c73fff640 10 client.4592 handle_command_reply: tid=0 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 client.4592 shutdown 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 msgr2=0x561ee6860f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c90019a70 tx=0x7f7c900194a0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 shutdown_connections 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:6825/469179342,v1:172.21.15.121:6828/469179342] conn(0x561ee6861680 0x561ee68c3520 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 --2- 172.21.15.121:0/1834646594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561ee684b4e0 0x561ee6860f30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c73fff640 0 client.4592 ms_handle_reset on v2:172.21.15.121:6825/469179342 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 >> 172.21.15.121:0/1834646594 conn(0x561ee68281d0 msgr2=0x561ee6851090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 shutdown_connections 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 1 -- 172.21.15.121:0/1834646594 wait complete. 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.979+0000 7f7c9dd22740 20 client.4592 trim_cache size 0 max 16384 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:24.985 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "822f5905-71ec-4c9e-8017-14fcc3976ad1", 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4537, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 4.3009488749999996, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 18, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 39, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 39, 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 8.3585984960000008 2024-09-15T23:56:24.986 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 msgr2=0x7f7c7803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 0x7f7c7803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c84034000 tx=0x7f7c8402e000 comp rx=0 tx=0).stop 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 msgr2=0x7f7c9412fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c480 tx=0x7f7c9000c940 comp rx=0 tx=0).stop 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 shutdown_connections 2024-09-15T23:56:24.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7c780382a0 0x7f7c7803a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 --2- 172.21.15.121:0/2523789942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7c940a39c0 0x7f7c9412fa60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:24.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 >> 172.21.15.121:0/2523789942 conn(0x7f7c940a85e0 msgr2=0x7f7c940a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:24.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 shutdown_connections 2024-09-15T23:56:24.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:24.980+0000 7f7c9b34b640 1 -- 172.21.15.121:0/2523789942 wait complete. 2024-09-15T23:56:24.991 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:25.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.087+0000 7fa81471a640 1 Processor -- start 2024-09-15T23:56:25.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.087+0000 7fa81471a640 1 -- start start 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa81471a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa80c133640 0x7fa80c13b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa81471a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80c0a16c0 con 0x7fa80c0a39c0 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa81471a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa80c0a1490 con 0x7fa80c133640 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa811cb5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa80c133640 0x7fa80c13b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa8124b6640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa80c0a39c0 0x7fa80c132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56868/0 (socket says 172.21.15.121:56868) 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa8124b6640 1 -- 172.21.15.121:0/3064220441 learned_addr learned my addr 172.21.15.121:0/3064220441 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:25.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa811cb5640 1 --2- 172.21.15.121:0/3064220441 >> v2:172.21.15.121:3300/0 conn(0x7fa80c133640 0x7fa80c13b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46114/0 (socket says 172.21.15.121:46114) 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.088+0000 7fa811cb5640 1 -- 172.21.15.121:0/3064220441 >> v1:172.21.15.121:6789/0 conn(0x7fa80c0a39c0 legacy=0x7fa80c132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.089+0000 7fa811cb5640 1 -- 172.21.15.121:0/3064220441 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c0a4010 con 0x7fa80c133640 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.089+0000 7fa811cb5640 1 --2- 172.21.15.121:0/3064220441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c133640 0x7fa80c13b270 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009720 tx=0x7fa7fc02b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24a8e981088ba31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.089+0000 7fa8114b4640 1 -- 172.21.15.121:0/3064220441 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc038070 con 0x7fa80c133640 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.089+0000 7fa8114b4640 1 -- 172.21.15.121:0/3064220441 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc033440 con 0x7fa80c133640 2024-09-15T23:56:25.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.089+0000 7fa8114b4640 1 -- 172.21.15.121:0/3064220441 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc033740 con 0x7fa80c133640 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 -- 172.21.15.121:0/3064220441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c133640 msgr2=0x7fa80c13b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 --2- 172.21.15.121:0/3064220441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c133640 0x7fa80c13b270 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009720 tx=0x7fa7fc02b220 comp rx=0 tx=0).stop 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 -- 172.21.15.121:0/3064220441 shutdown_connections 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 --2- 172.21.15.121:0/3064220441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c133640 0x7fa80c13b270 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 -- 172.21.15.121:0/3064220441 >> 172.21.15.121:0/3064220441 conn(0x7fa80c0a85e0 msgr2=0x7fa80c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 -- 172.21.15.121:0/3064220441 shutdown_connections 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.090+0000 7fa81471a640 1 -- 172.21.15.121:0/3064220441 wait complete. 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa81471a640 1 Processor -- start 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa81471a640 1 -- start start 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa81471a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:25.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa81471a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c1329c0 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa8124b6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa8124b6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46122/0 (socket says 172.21.15.121:46122) 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.091+0000 7fa8124b6640 1 -- 172.21.15.121:0/2238448019 learned_addr learned my addr 172.21.15.121:0/2238448019 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa8124b6640 1 -- 172.21.15.121:0/2238448019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c09d000 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa8124b6640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c480 tx=0x7fa80800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa808017070 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa808005c10 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8080070d0 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c09c680 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.092+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c09ea30 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7fa80801a070 con 0x7fa80c0a39c0 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa802ffd640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 0x7fa7f003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:25.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c09c400 con 0x7fa80c0a39c0 2024-09-15T23:56:25.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7fa80804a4a0 con 0x7fa80c0a39c0 2024-09-15T23:56:25.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa811cb5640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 0x7fa7f003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:25.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.093+0000 7fa811cb5640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 0x7fa7f003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc035000 tx=0x7fa7fc02f000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:25.098 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.098+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa808010700 con 0x7fa80c0a39c0 2024-09-15T23:56:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.296+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa80c0a22d0 con 0x7fa80c0a39c0 2024-09-15T23:56:25.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.296+0000 7fa802ffd640 1 -- 172.21.15.121:0/2238448019 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fa808007270 con 0x7fa80c0a39c0 2024-09-15T23:56:25.297 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:25.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 msgr2=0x7fa7f003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:25.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 0x7fa7f003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc035000 tx=0x7fa7fc02f000 comp rx=0 tx=0).stop 2024-09-15T23:56:25.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 msgr2=0x7fa80c1cc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:25.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c480 tx=0x7fa80800c940 comp rx=0 tx=0).stop 2024-09-15T23:56:25.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 shutdown_connections 2024-09-15T23:56:25.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7fa7f00382a0 0x7fa7f003a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:25.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 --2- 172.21.15.121:0/2238448019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa80c0a39c0 0x7fa80c1cc7e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:25.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 >> 172.21.15.121:0/2238448019 conn(0x7fa80c0a85e0 msgr2=0x7fa80c0a6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:25.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 shutdown_connections 2024-09-15T23:56:25.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25.298+0000 7fa81471a640 1 -- 172.21.15.121:0/2238448019 wait complete. 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:25.310 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:25.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.311 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:25.327 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:25.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.330 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:25.390 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:56:25.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.392 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:56:25.447 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:56:25.447 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:25.448 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:25.448 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:25.448 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:25.448 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:56:25.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:25.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:25.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.573 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:56:25.588 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:56:25.588 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:25.589 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:25.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-15T23:56:25.653 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:56:25.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:25.654 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:25.709 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:56:25.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:25.709 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:25.765 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:25.829 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:25.886 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:25.887 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:25.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:25.889 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:25.941 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:56:25.942 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:56:25.984 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:26.008 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:26.064 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:26.065 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:26.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.066 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:26.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-09-15T23:56:26.064+0000 7fa99f94c480 -1 init, newargv = 0x5569fab1cce0 newargc=15 2024-09-15T23:56:26.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[48282]: starting ceph client 2024-09-15T23:56:26.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[48282]: starting fuse 2024-09-15T23:56:26.082 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:26.082 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:26.083 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:26.084 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:26.085 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:26.086 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:26.086 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:26.086 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:56:26.086 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:26.200 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.48282.asok 2024-09-15T23:56:26.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:26.210 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48282.asok 2024-09-15T23:56:26.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48282.asok status 2024-09-15T23:56:26.343 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:26.343 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "48282", 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4598, 2024-09-15T23:56:26.344 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4598 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3474262320 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:26.345 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3474262320 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4598 192.168.0.1:0/3474262320", 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/3474262320", 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 18, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 39, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:56:26.346 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:26.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.353 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:56:26.353 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:26.369 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:56:26.369 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:26.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.369 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:26.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.572+0000 7f8500a4c640 1 Processor -- start 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.572+0000 7f8500a4c640 1 -- start start 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f8500a4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84fc09ee30 0x7f84fc13ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f8500a4c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84fc0a2280 con 0x7f84fc0a39c0 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f8500a4c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84fc09e6e0 con 0x7f84fc09ee30 2024-09-15T23:56:26.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84f9d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84fc09ee30 0x7f84fc13ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:26.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84f9d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84fc09ee30 0x7f84fc13ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46134/0 (socket says 172.21.15.121:46134) 2024-09-15T23:56:26.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84fa59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84fc0a39c0 0x7f84fc0a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56872/0 (socket says 172.21.15.121:56872) 2024-09-15T23:56:26.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84f9d9b640 1 -- 172.21.15.121:0/4176842907 learned_addr learned my addr 172.21.15.121:0/4176842907 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:26.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84f9d9b640 1 -- 172.21.15.121:0/4176842907 >> v1:172.21.15.121:6789/0 conn(0x7f84fc0a39c0 legacy=0x7f84fc0a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:26.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.573+0000 7f84f9d9b640 1 -- 172.21.15.121:0/4176842907 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc09e3d0 con 0x7f84fc09ee30 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f84f9d9b640 1 --2- 172.21.15.121:0/4176842907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc13ced0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097f0 tx=0x7f84f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37645d31deb44292 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f84f959a640 1 -- 172.21.15.121:0/4176842907 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84f0037070 con 0x7f84fc09ee30 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f84f959a640 1 -- 172.21.15.121:0/4176842907 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f0032440 con 0x7f84fc09ee30 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f84f959a640 1 -- 172.21.15.121:0/4176842907 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84f002ae60 con 0x7f84fc09ee30 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f8500a4c640 1 -- 172.21.15.121:0/4176842907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 msgr2=0x7f84fc13ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.574+0000 7f8500a4c640 1 --2- 172.21.15.121:0/4176842907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc13ced0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097f0 tx=0x7f84f002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.575+0000 7f8500a4c640 1 -- 172.21.15.121:0/4176842907 shutdown_connections 2024-09-15T23:56:26.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.575+0000 7f8500a4c640 1 --2- 172.21.15.121:0/4176842907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc13ced0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.575+0000 7f8500a4c640 1 -- 172.21.15.121:0/4176842907 >> 172.21.15.121:0/4176842907 conn(0x7f84fc0a85e0 msgr2=0x7f84fc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.575+0000 7f8500a4c640 1 -- 172.21.15.121:0/4176842907 shutdown_connections 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.575+0000 7f8500a4c640 1 -- 172.21.15.121:0/4176842907 wait complete. 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f8500a4c640 1 Processor -- start 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f8500a4c640 1 -- start start 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f8500a4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f8500a4c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84fc0a1ed0 con 0x7f84fc09ee30 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f84fa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f84fa59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46150/0 (socket says 172.21.15.121:46150) 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f84fa59c640 1 -- 172.21.15.121:0/360120936 learned_addr learned my addr 172.21.15.121:0/360120936 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.576+0000 7f84fa59c640 1 -- 172.21.15.121:0/360120936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84fc073310 con 0x7f84fc09ee30 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f84fa59c640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c450 tx=0x7f84ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:26.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84ec007410 con 0x7f84fc09ee30 2024-09-15T23:56:26.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ec0075b0 con 0x7f84fc09ee30 2024-09-15T23:56:26.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84ec004910 con 0x7f84fc09ee30 2024-09-15T23:56:26.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84fc0717b0 con 0x7f84fc09ee30 2024-09-15T23:56:26.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.577+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84fc072090 con 0x7f84fc09ee30 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f84ec01a020 con 0x7f84fc09ee30 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84fc0008d0 con 0x7f84fc09ee30 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f84eaffd640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 0x7f84dc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f84ec04aa00 con 0x7f84fc09ee30 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f84f9d9b640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 0x7f84dc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:26.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.578+0000 7f84f9d9b640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 0x7f84dc03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034000 tx=0x7f84f002e000 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:26.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.582+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84ec01b9f0 con 0x7f84fc09ee30 2024-09-15T23:56:26.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.782+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84fc0714d0 con 0x7f84fc09ee30 2024-09-15T23:56:26.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.782+0000 7f84eaffd640 1 -- 172.21.15.121:0/360120936 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f84ec01bc50 con 0x7f84fc09ee30 2024-09-15T23:56:26.784 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:26.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 msgr2=0x7f84dc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:26.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 0x7f84dc03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034000 tx=0x7f84f002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 msgr2=0x7f84fc1cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c450 tx=0x7f84ec00c910 comp rx=0 tx=0).stop 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 shutdown_connections 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f84dc0382a0 0x7f84dc03a760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 --2- 172.21.15.121:0/360120936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84fc09ee30 0x7f84fc1cc590 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 >> 172.21.15.121:0/360120936 conn(0x7f84fc0a85e0 msgr2=0x7f84fc0a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 shutdown_connections 2024-09-15T23:56:26.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:26.784+0000 7f8500a4c640 1 -- 172.21.15.121:0/360120936 wait complete. 2024-09-15T23:56:26.796 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:56:26.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:26.797 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:26.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.798 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:56:26.818 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:26.819 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:26.819 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:26.819 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.819 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:26.820 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:26.821 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.822 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:26.823 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:26.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.824 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:26.882 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:56:26.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:26.884 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:56:26.940 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:56:26.940 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:26.941 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:26.941 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:26.941 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:26.941 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:26.941 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:56:26.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:26.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:26.942 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:26.942 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:56:27.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:27.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:27.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.066 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:56:27.082 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:56:27.082 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:27.082 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:27.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:56:27.146 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:56:27.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:27.147 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:27.203 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:27.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:27.204 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:27.259 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:27.324 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:27.379 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:27.380 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:27.381 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:27.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.382 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:27.435 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:27.435 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:56:27.435 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:56:27.477 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:27.501 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:27.557 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:27.558 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:27.559 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:27.560 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:27.560 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:27.560 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:27.560 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:27.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.561 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:27.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:56:27.557+0000 7f6cbfa22480 -1 init, newargv = 0x55aa1061df80 newargc=15 2024-09-15T23:56:27.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[48699]: starting ceph client 2024-09-15T23:56:27.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[48699]: starting fuse 2024-09-15T23:56:27.576 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:27.577 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:56:27.577 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:27.577 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:27.578 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:27.579 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:27.695 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.48699.asok 2024-09-15T23:56:27.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:27.706 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48699.asok 2024-09-15T23:56:27.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48699.asok status 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "48699", 2024-09-15T23:56:27.840 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4604, 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4604 2024-09-15T23:56:27.841 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3006389898 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:27.842 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3006389898 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4604 192.168.0.2:0/3006389898", 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/3006389898", 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 18, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 39, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:56:27.843 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:27.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.848 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:56:27.848 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:27.865 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:56:27.865 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:27.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:27.865 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:27.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-15T23:56:28.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.068+0000 7f327a0b7640 1 Processor -- start 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.068+0000 7f327a0b7640 1 -- start start 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f327a0b7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3274133020 0x7f32740a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f327a0b7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327409abc0 con 0x7f3274133400 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f327a0b7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f32740a2310 con 0x7f3274133020 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f32737fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3274133020 0x7f32740a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f3272ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3274133400 0x7f3274135fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56878/0 (socket says 172.21.15.121:56878) 2024-09-15T23:56:28.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f3272ffd640 1 -- 172.21.15.121:0/3266580000 learned_addr learned my addr 172.21.15.121:0/3266580000 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:28.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f32737fe640 1 -- 172.21.15.121:0/3266580000 >> v1:172.21.15.121:6789/0 conn(0x7f3274133400 legacy=0x7f3274135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.069+0000 7f32737fe640 1 -- 172.21.15.121:0/3266580000 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3274132bf0 con 0x7f3274133020 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f32737fe640 1 --2- 172.21.15.121:0/3266580000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740a04b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f326402b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b541ef6922acd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f32727fc640 1 -- 172.21.15.121:0/3266580000 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264007670 con 0x7f3274133020 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f32727fc640 1 -- 172.21.15.121:0/3266580000 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3264007810 con 0x7f3274133020 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f32727fc640 1 -- 172.21.15.121:0/3266580000 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264007b10 con 0x7f3274133020 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 -- 172.21.15.121:0/3266580000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 msgr2=0x7f32740a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 --2- 172.21.15.121:0/3266580000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740a04b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f326402b770 comp rx=0 tx=0).stop 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 -- 172.21.15.121:0/3266580000 shutdown_connections 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 --2- 172.21.15.121:0/3266580000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740a04b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 -- 172.21.15.121:0/3266580000 >> 172.21.15.121:0/3266580000 conn(0x7f32740a8430 msgr2=0x7f32740a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 -- 172.21.15.121:0/3266580000 shutdown_connections 2024-09-15T23:56:28.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.070+0000 7f327a0b7640 1 -- 172.21.15.121:0/3266580000 wait complete. 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.071+0000 7f327a0b7640 1 Processor -- start 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f327a0b7640 1 -- start start 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f327a0b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f327a0b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32740a19c0 con 0x7f3274133020 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f32737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f32737fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46168/0 (socket says 172.21.15.121:46168) 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f32737fe640 1 -- 172.21.15.121:0/2381635985 learned_addr learned my addr 172.21.15.121:0/2381635985 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f32737fe640 1 -- 172.21.15.121:0/2381635985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327409e800 con 0x7f3274133020 2024-09-15T23:56:28.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.072+0000 7f32737fe640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f3264004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264041070 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3264032a90 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3274070eb0 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264032d70 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327406fe40 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.073+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 45737+0+0 (secure 0 0 0) 0x7f326403a040 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.074+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3274133830 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.074+0000 7f325bfff640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 0x7f326003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.074+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f326406dcb0 con 0x7f3274133020 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.074+0000 7f3272ffd640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 0x7f326003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:28.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.074+0000 7f3272ffd640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 0x7f326003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3268007fd0 tx=0x7f3268007ac0 comp rx=0 tx=0).ready entity=mgr.4466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:28.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.079+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f326403b3b0 con 0x7f3274133020 2024-09-15T23:56:28.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.290+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7f327406bbb0 con 0x7f3274133020 2024-09-15T23:56:28.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.699+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v16) ==== 84+0+0 (secure 0 0 0) 0x7f326406cbb0 con 0x7f3274133020 2024-09-15T23:56:28.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f325bfff640 1 -- 172.21.15.121:0/2381635985 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f326403cb00 con 0x7f3274133020 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 msgr2=0x7f326003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 0x7f326003a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3268007fd0 tx=0x7f3268007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 msgr2=0x7f32740705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3264009d90 tx=0x7f3264004a40 comp rx=0 tx=0).stop 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 shutdown_connections 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f32600382a0 0x7f326003a760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:28.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 --2- 172.21.15.121:0/2381635985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3274133020 0x7f32740705d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:28.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 >> 172.21.15.121:0/2381635985 conn(0x7f32740a8430 msgr2=0x7f32740a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:28.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 shutdown_connections 2024-09-15T23:56:28.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.703+0000 7f327a0b7640 1 -- 172.21.15.121:0/2381635985 wait complete. 2024-09-15T23:56:28.719 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:28.719 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:28.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:28.827 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:28.826+0000 7f1307e0e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:56:28.870 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:28.869+0000 7f1307e0e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:28.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.876+0000 7f41058dd640 1 Processor -- start 2024-09-15T23:56:28.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.876+0000 7f41058dd640 1 -- start start 2024-09-15T23:56:28.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f41058dd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f410013a280 0x7f410013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f41058dd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410013a080 con 0x7f41000a4c20 2024-09-15T23:56:28.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f41058dd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f41000a3d50 con 0x7f410013a280 2024-09-15T23:56:28.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f40feffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f410013a280 0x7f410013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:28.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f40fe7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f41000a4c20 0x7f41000a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56900/0 (socket says 172.21.15.121:56900) 2024-09-15T23:56:28.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f40fe7fc640 1 -- 172.21.15.121:0/330156040 learned_addr learned my addr 172.21.15.121:0/330156040 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:28.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f40feffd640 1 -- 172.21.15.121:0/330156040 >> v1:172.21.15.121:6789/0 conn(0x7f41000a4c20 legacy=0x7f41000a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.877+0000 7f40feffd640 1 -- 172.21.15.121:0/330156040 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41000a3f80 con 0x7f410013a280 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.878+0000 7f40feffd640 1 --2- 172.21.15.121:0/330156040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410013a280 0x7f410013a660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009720 tx=0x7f40f002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a392e422f3369018 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.878+0000 7f40fdffb640 1 -- 172.21.15.121:0/330156040 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0037070 con 0x7f410013a280 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.878+0000 7f40fdffb640 1 -- 172.21.15.121:0/330156040 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f002ad90 con 0x7f410013a280 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.878+0000 7f40fdffb640 1 -- 172.21.15.121:0/330156040 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0032590 con 0x7f410013a280 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 -- 172.21.15.121:0/330156040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410013a280 msgr2=0x7f410013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 --2- 172.21.15.121:0/330156040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410013a280 0x7f410013a660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009720 tx=0x7f40f002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:28.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 -- 172.21.15.121:0/330156040 shutdown_connections 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 --2- 172.21.15.121:0/330156040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f410013a280 0x7f410013a660 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 -- 172.21.15.121:0/330156040 >> 172.21.15.121:0/330156040 conn(0x7f41000ac3e0 msgr2=0x7f41000ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 -- 172.21.15.121:0/330156040 shutdown_connections 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.879+0000 7f41058dd640 1 -- 172.21.15.121:0/330156040 wait complete. 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.880+0000 7f41058dd640 1 Processor -- start 2024-09-15T23:56:28.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f41058dd640 1 -- start start 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f41058dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f41058dd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4100139d40 con 0x7f41000a4c20 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f40feffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f40feffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46204/0 (socket says 172.21.15.121:46204) 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.881+0000 7f40feffd640 1 -- 172.21.15.121:0/383086139 learned_addr learned my addr 172.21.15.121:0/383086139 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f40feffd640 1 -- 172.21.15.121:0/383086139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100124ff0 con 0x7f41000a4c20 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f40feffd640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009840 tx=0x7f40f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0041020 con 0x7f41000a4c20 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f003d550 con 0x7f41000a4c20 2024-09-15T23:56:28.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4100125270 con 0x7f41000a4c20 2024-09-15T23:56:28.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0037040 con 0x7f41000a4c20 2024-09-15T23:56:28.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.882+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4100138290 con 0x7f41000a4c20 2024-09-15T23:56:28.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.883+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410006dab0 con 0x7f41000a4c20 2024-09-15T23:56:28.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.883+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f40f0044020 con 0x7f41000a4c20 2024-09-15T23:56:28.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.883+0000 7f40e7fff640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 0x7f40ec03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:28.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.884+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f40f006b910 con 0x7f41000a4c20 2024-09-15T23:56:28.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.884+0000 7f40fe7fc640 1 -- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 msgr2=0x7f40ec03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:28.885 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.884+0000 7f40fe7fc640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 0x7f40ec03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:28.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:28.888+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40f004b030 con 0x7f41000a4c20 2024-09-15T23:56:29.005 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.004+0000 7f1307e0e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:56:29.053 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.053+0000 7f1307e0e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:56:29.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.068+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41000a2f50 con 0x7f41000a4c20 2024-09-15T23:56:29.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.069+0000 7f40e7fff640 1 -- 172.21.15.121:0/383086139 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f4100124ff0 con 0x7f41000a4c20 2024-09-15T23:56:29.070 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 msgr2=0x7f40ec03a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 0x7f40ec03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 msgr2=0x7f41000a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009840 tx=0x7f40f00046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 shutdown_connections 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f40ec0382f0 0x7f40ec03a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 --2- 172.21.15.121:0/383086139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41000a4c20 0x7f41000a1150 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 >> 172.21.15.121:0/383086139 conn(0x7f41000ac3e0 msgr2=0x7f41000aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 shutdown_connections 2024-09-15T23:56:29.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.071+0000 7f41058dd640 1 -- 172.21.15.121:0/383086139 wait complete. 2024-09-15T23:56:29.083 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:29.083 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:29.099 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:29.168 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.167+0000 7f1307e0e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.238+0000 7f7bf7ca5640 1 Processor -- start 2024-09-15T23:56:29.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.238+0000 7f7bf7ca5640 1 -- start start 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf7ca5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bf00a4c20 0x7f7bf013f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf7ca5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf013a080 con 0x7f7bf013a280 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf7ca5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf00a3d50 con 0x7f7bf00a4c20 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf5240640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bf00a4c20 0x7f7bf013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf5240640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f7bf00a4c20 0x7f7bf013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46206/0 (socket says 172.21.15.121:46206) 2024-09-15T23:56:29.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf5240640 1 -- 172.21.15.121:0/813173062 learned_addr learned my addr 172.21.15.121:0/813173062 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf5240640 1 -- 172.21.15.121:0/813173062 >> v1:172.21.15.121:6789/0 conn(0x7f7bf013a280 legacy=0x7f7bf013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.239+0000 7f7bf5240640 1 -- 172.21.15.121:0/813173062 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00a3f80 con 0x7f7bf00a4c20 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.240+0000 7f7bf5240640 1 --2- 172.21.15.121:0/813173062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf013f060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097f0 tx=0x7f7be402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817effe56baa7791 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.240+0000 7f7bf4a3f640 1 -- 172.21.15.121:0/813173062 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be4037070 con 0x7f7bf00a4c20 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.240+0000 7f7bf4a3f640 1 -- 172.21.15.121:0/813173062 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be4032440 con 0x7f7bf00a4c20 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.240+0000 7f7bf4a3f640 1 -- 172.21.15.121:0/813173062 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be402ae60 con 0x7f7bf00a4c20 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/813173062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 msgr2=0x7f7bf013f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/813173062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf013f060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097f0 tx=0x7f7be402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/813173062 shutdown_connections 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/813173062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf013f060 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/813173062 >> 172.21.15.121:0/813173062 conn(0x7f7bf00ac3e0 msgr2=0x7f7bf00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/813173062 shutdown_connections 2024-09-15T23:56:29.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.241+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/813173062 wait complete. 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf7ca5640 1 Processor -- start 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf7ca5640 1 -- start start 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf7ca5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf7ca5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf00a7ec0 con 0x7f7bf00a4c20 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf5a41640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf5a41640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46216/0 (socket says 172.21.15.121:46216) 2024-09-15T23:56:29.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.242+0000 7f7bf5a41640 1 -- 172.21.15.121:0/689327827 learned_addr learned my addr 172.21.15.121:0/689327827 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7bf5a41640 1 -- 172.21.15.121:0/689327827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf0125070 con 0x7f7bf00a4c20 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7bf5a41640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c450 tx=0x7f7bec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bec017070 con 0x7f7bf00a4c20 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf0124780 con 0x7f7bf00a4c20 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec005220 con 0x7f7bf00a4c20 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bec0035f0 con 0x7f7bf00a4c20 2024-09-15T23:56:29.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.243+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf0124470 con 0x7f7bf00a4c20 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f7bec01a070 con 0x7f7bf00a4c20 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7be27fc640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 0x7f7bd403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf0122c20 con 0x7f7bf00a4c20 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7bf5240640 1 -- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 msgr2=0x7f7bd403a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f7bec04a690 con 0x7f7bf00a4c20 2024-09-15T23:56:29.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.244+0000 7f7bf5240640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 0x7f7bd403a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:29.249 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.249+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bec01ac60 con 0x7f7bf00a4c20 2024-09-15T23:56:29.266 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.265+0000 7f1307e0e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:56:29.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.428+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7bf0124950 con 0x7f7bf00a4c20 2024-09-15T23:56:29.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.429+0000 7f7be27fc640 1 -- 172.21.15.121:0/689327827 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f7bec01a9a0 con 0x7f7bf00a4c20 2024-09-15T23:56:29.429 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 msgr2=0x7f7bd403a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 0x7f7bd403a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 msgr2=0x7f7bf00a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c450 tx=0x7f7bec00c910 comp rx=0 tx=0).stop 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 shutdown_connections 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f7bd40382a0 0x7f7bd403a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 --2- 172.21.15.121:0/689327827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7bf00a4c20 0x7f7bf00a0ff0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 >> 172.21.15.121:0/689327827 conn(0x7f7bf00ac3e0 msgr2=0x7f7bf00aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 shutdown_connections 2024-09-15T23:56:29.432 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.431+0000 7f7bf7ca5640 1 -- 172.21.15.121:0/689327827 wait complete. 2024-09-15T23:56:29.442 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:29.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:29.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:29.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[48699]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:29.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:29.539 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.538+0000 7f1307e0e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:56:29.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:29.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:29.548 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:56:29.584 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.583+0000 7f1307e0e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:56:29.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-15T23:56:29.707 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:29.706+0000 7f1307e0e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:56:29.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.742+0000 7f29f190a640 1 Processor -- start 2024-09-15T23:56:29.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.742+0000 7f29f190a640 1 -- start start 2024-09-15T23:56:29.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29f190a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f29ec0a4ab0 0x7f29ec13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29f190a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29ec0a6d10 con 0x7f29ec0a7140 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29f190a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f29ec06e230 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29ea7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f29ec0a4ab0 0x7f29ec13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29ea7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f29ec0a4ab0 0x7f29ec13eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46230/0 (socket says 172.21.15.121:46230) 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29eaffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f29ec0a7140 0x7f29ec0a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56918/0 (socket says 172.21.15.121:56918) 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29ea7fc640 1 -- 172.21.15.121:0/3544424205 learned_addr learned my addr 172.21.15.121:0/3544424205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29ea7fc640 1 -- 172.21.15.121:0/3544424205 >> v1:172.21.15.121:6789/0 conn(0x7f29ec0a7140 legacy=0x7f29ec0a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.743+0000 7f29ea7fc640 1 -- 172.21.15.121:0/3544424205 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec0a3ae0 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.744+0000 7f29ea7fc640 1 --2- 172.21.15.121:0/3544424205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec13eef0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939e99065428f258 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.744+0000 7f29e9ffb640 1 -- 172.21.15.121:0/3544424205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e0037070 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.744+0000 7f29e9ffb640 1 -- 172.21.15.121:0/3544424205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e0032440 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.744+0000 7f29e9ffb640 1 -- 172.21.15.121:0/3544424205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e002ae60 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 -- 172.21.15.121:0/3544424205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 msgr2=0x7f29ec13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 --2- 172.21.15.121:0/3544424205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec13eef0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 -- 172.21.15.121:0/3544424205 shutdown_connections 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 --2- 172.21.15.121:0/3544424205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec13eef0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 -- 172.21.15.121:0/3544424205 >> 172.21.15.121:0/3544424205 conn(0x7f29ec0ac370 msgr2=0x7f29ec0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:29.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 -- 172.21.15.121:0/3544424205 shutdown_connections 2024-09-15T23:56:29.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.745+0000 7f29f190a640 1 -- 172.21.15.121:0/3544424205 wait complete. 2024-09-15T23:56:29.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.746+0000 7f29f190a640 1 Processor -- start 2024-09-15T23:56:29.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.746+0000 7f29f190a640 1 -- start start 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29f190a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29f190a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec0a7fc0 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29eaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29eaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46240/0 (socket says 172.21.15.121:46240) 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29eaffd640 1 -- 172.21.15.121:0/269857632 learned_addr learned my addr 172.21.15.121:0/269857632 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29eaffd640 1 -- 172.21.15.121:0/269857632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec125000 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29eaffd640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c450 tx=0x7f29e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:29.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4007410 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40075b0 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec124710 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e4004910 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.747+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec123490 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f29e401a020 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ec122bb0 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29d3fff640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f29e404aa50 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29ea7fc640 1 -- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 msgr2=0x7f29d803a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:29.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.748+0000 7f29ea7fc640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:29.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.753+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29e401b9c0 con 0x7f29ec0a4ab0 2024-09-15T23:56:29.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.949+0000 7f29ea7fc640 1 -- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 msgr2=0x7f29d803a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:29.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.949+0000 7f29ea7fc640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:29.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:29.957+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f29ec0732e0 con 0x7f29ec0a4ab0 2024-09-15T23:56:30.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.350+0000 7f29ea7fc640 1 -- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 msgr2=0x7f29d803a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:30.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.350+0000 7f29ea7fc640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:56:30.414 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:30.413+0000 7f1307e0e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:56:30.457 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:30.456+0000 7f1307e0e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:56:30.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.698+0000 7f29d3fff640 1 -- 172.21.15.121:0/269857632 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v19) ==== 136+0+0 (secure 0 0 0) 0x7f29e401bc20 con 0x7f29ec0a4ab0 2024-09-15T23:56:30.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 msgr2=0x7f29d803a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:30.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 msgr2=0x7f29ec0a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c450 tx=0x7f29e400c910 comp rx=0 tx=0).stop 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 shutdown_connections 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f29d80382f0 0x7f29d803a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 --2- 172.21.15.121:0/269857632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29ec0a4ab0 0x7f29ec0a1040 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 >> 172.21.15.121:0/269857632 conn(0x7f29ec0ac370 msgr2=0x7f29ec0aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 shutdown_connections 2024-09-15T23:56:30.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.700+0000 7f29f190a640 1 -- 172.21.15.121:0/269857632 wait complete. 2024-09-15T23:56:30.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:56:30.776 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:30.775+0000 7f1307e0e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:56:30.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.810+0000 7ff89f3e4640 1 Processor -- start 2024-09-15T23:56:30.811 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.810+0000 7ff89f3e4640 1 -- start start 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89f3e4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff8980a4c20 0x7ff89813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89f3e4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89813a080 con 0x7ff89813a280 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89f3e4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff8980a3d50 con 0x7ff8980a4c20 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89c97f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff8980a4c20 0x7ff89813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89d180640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff89813a280 0x7ff89813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56920/0 (socket says 172.21.15.121:56920) 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89d180640 1 -- 172.21.15.121:0/3139706272 learned_addr learned my addr 172.21.15.121:0/3139706272 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89c97f640 1 -- 172.21.15.121:0/3139706272 >> v1:172.21.15.121:6789/0 conn(0x7ff89813a280 legacy=0x7ff89813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff88bfff640 1 -- 172.21.15.121:0/3139706272 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766384066 0 0) 0x7ff89813a080 con 0x7ff89813a280 2024-09-15T23:56:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.811+0000 7ff89c97f640 1 -- 172.21.15.121:0/3139706272 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8980a3f80 con 0x7ff8980a4c20 2024-09-15T23:56:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.812+0000 7ff89c97f640 1 --2- 172.21.15.121:0/3139706272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff89813f060 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009720 tx=0x7ff88c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b2f415baa287aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.812+0000 7ff88bfff640 1 -- 172.21.15.121:0/3139706272 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88c037070 con 0x7ff8980a4c20 2024-09-15T23:56:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.812+0000 7ff88bfff640 1 -- 172.21.15.121:0/3139706272 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c02ad90 con 0x7ff8980a4c20 2024-09-15T23:56:30.814 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.812+0000 7ff88bfff640 1 -- 172.21.15.121:0/3139706272 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88c032590 con 0x7ff8980a4c20 2024-09-15T23:56:30.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 -- 172.21.15.121:0/3139706272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 msgr2=0x7ff89813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:30.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/3139706272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff89813f060 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009720 tx=0x7ff88c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:30.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 -- 172.21.15.121:0/3139706272 shutdown_connections 2024-09-15T23:56:30.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/3139706272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff89813f060 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:30.816 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 -- 172.21.15.121:0/3139706272 >> 172.21.15.121:0/3139706272 conn(0x7ff8980ac3e0 msgr2=0x7ff8980ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 -- 172.21.15.121:0/3139706272 shutdown_connections 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.813+0000 7ff89f3e4640 1 -- 172.21.15.121:0/3139706272 wait complete. 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89f3e4640 1 Processor -- start 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89f3e4640 1 -- start start 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89f3e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89f3e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8980a7ec0 con 0x7ff8980a4c20 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89d180640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89d180640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46248/0 (socket says 172.21.15.121:46248) 2024-09-15T23:56:30.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.814+0000 7ff89d180640 1 -- 172.21.15.121:0/4215702342 learned_addr learned my addr 172.21.15.121:0/4215702342 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff89d180640 1 -- 172.21.15.121:0/4215702342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff898124f10 con 0x7ff8980a4c20 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff89d180640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff89400c420 tx=0x7ff89400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff894018070 con 0x7ff8980a4c20 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8940074d0 con 0x7ff8980a4c20 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff898124690 con 0x7ff8980a4c20 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff894004950 con 0x7ff8980a4c20 2024-09-15T23:56:30.818 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.815+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8981238a0 con 0x7ff8980a4c20 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.816+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff898122b30 con 0x7ff8980a4c20 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.817+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7ff89401b070 con 0x7ff8980a4c20 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.817+0000 7ff889ffb640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 0x7ff87c03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.817+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7ff89404a990 con 0x7ff8980a4c20 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.817+0000 7ff89c97f640 1 -- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 msgr2=0x7ff87c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:30.819 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.817+0000 7ff89c97f640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 0x7ff87c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:30.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.821+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff894022080 con 0x7ff8980a4c20 2024-09-15T23:56:30.864 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:30.863+0000 7f1307e0e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:56:30.976 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:30.974+0000 7f1307e0e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:30.995 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.995+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff8980a2f50 con 0x7ff8980a4c20 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.995+0000 7ff889ffb640 1 -- 172.21.15.121:0/4215702342 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) ==== 84+0+207 (secure 0 0 0) 0x7ff89401ae10 con 0x7ff8980a4c20 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:56:30.996 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 6, 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_metadata" 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 7, 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": "cephfs_data" 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 msgr2=0x7ff87c03a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 0x7ff87c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 msgr2=0x7ff8980a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff89400c420 tx=0x7ff89400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 shutdown_connections 2024-09-15T23:56:31.003 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7ff87c0382f0 0x7ff87c03a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 --2- 172.21.15.121:0/4215702342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8980a4c20 0x7ff8980a1080 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 >> 172.21.15.121:0/4215702342 conn(0x7ff8980ac3e0 msgr2=0x7ff898139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:31.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 shutdown_connections 2024-09-15T23:56:31.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:30.997+0000 7ff89f3e4640 1 -- 172.21.15.121:0/4215702342 wait complete. 2024-09-15T23:56:31.009 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs_b' 2024-09-15T23:56:31.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_b_metadata --pg_num_min 64 2024-09-15T23:56:31.022 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.020+0000 7f1307e0e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:56:31.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.112+0000 7f098098d640 1 Processor -- start 2024-09-15T23:56:31.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.112+0000 7f098098d640 1 -- start start 2024-09-15T23:56:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f098098d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f097c0a4ab0 0x7f097c13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f098098d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f097c0a6d10 con 0x7f097c0a7140 2024-09-15T23:56:31.120 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f098098d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f097c06e230 con 0x7f097c0a4ab0 2024-09-15T23:56:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f0979d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f097c0a4ab0 0x7f097c13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f097a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f097c0a7140 0x7f097c0a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56924/0 (socket says 172.21.15.121:56924) 2024-09-15T23:56:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f097a59c640 1 -- 172.21.15.121:0/3323650819 learned_addr learned my addr 172.21.15.121:0/3323650819 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:31.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f0979d9b640 1 -- 172.21.15.121:0/3323650819 >> v1:172.21.15.121:6789/0 conn(0x7f097c0a7140 legacy=0x7f097c0a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f0979d9b640 1 -- 172.21.15.121:0/3323650819 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0a3ae0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.113+0000 7f097959a640 1 -- 172.21.15.121:0/3323650819 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000423925 0 0) 0x7f097c0a6d10 con 0x7f097c0a7140 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.114+0000 7f0979d9b640 1 --2- 172.21.15.121:0/3323650819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c13eef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0964009720 tx=0x7f096402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c25f7ecf0ff7be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.114+0000 7f097959a640 1 -- 172.21.15.121:0/3323650819 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0964037070 con 0x7f097c0a4ab0 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.114+0000 7f097959a640 1 -- 172.21.15.121:0/3323650819 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096402ad90 con 0x7f097c0a4ab0 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.114+0000 7f097959a640 1 -- 172.21.15.121:0/3323650819 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0964032590 con 0x7f097c0a4ab0 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 -- 172.21.15.121:0/3323650819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 msgr2=0x7f097c13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 --2- 172.21.15.121:0/3323650819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c13eef0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0964009720 tx=0x7f096402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 -- 172.21.15.121:0/3323650819 shutdown_connections 2024-09-15T23:56:31.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 --2- 172.21.15.121:0/3323650819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c13eef0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 -- 172.21.15.121:0/3323650819 >> 172.21.15.121:0/3323650819 conn(0x7f097c0ac370 msgr2=0x7f097c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 -- 172.21.15.121:0/3323650819 shutdown_connections 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.115+0000 7f098098d640 1 -- 172.21.15.121:0/3323650819 wait complete. 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.116+0000 7f098098d640 1 Processor -- start 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.116+0000 7f098098d640 1 -- start start 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f098098d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f098098d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0a7fc0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f097a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f097a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46256/0 (socket says 172.21.15.121:46256) 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f097a59c640 1 -- 172.21.15.121:0/4230145750 learned_addr learned my addr 172.21.15.121:0/4230145750 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f097a59c640 1 -- 172.21.15.121:0/4230145750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0a1b60 con 0x7f097c0a4ab0 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f097a59c640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f097400c420 tx=0x7f097400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:31.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974018070 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09740074d0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.117+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c1366c0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.118+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0974004950 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.118+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c136ab0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.118+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f097401b070 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.118+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097c0a1e40 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.119+0000 7f0972ffd640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 0x7f095c03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.119+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 3439+0+0 (secure 0 0 0) 0x7f097404a610 con 0x7f097c0a4ab0 2024-09-15T23:56:31.124 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.119+0000 7f0979d9b640 1 -- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 msgr2=0x7f095c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:31.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.119+0000 7f0979d9b640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 0x7f095c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:31.126 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.123+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0974011950 con 0x7f097c0a4ab0 2024-09-15T23:56:31.139 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.138+0000 7f1307e0e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:56:31.191 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.190+0000 7f1307e0e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:56:31.233 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.232+0000 7f1307e0e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:56:31.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.294+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_b_metadata", "pg_num_min": 64} v 0) -- 0x7f097c0a2720 con 0x7f097c0a4ab0 2024-09-15T23:56:31.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.320+0000 7f0979d9b640 1 -- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 msgr2=0x7f095c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:31.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.320+0000 7f0979d9b640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 0x7f095c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:31.348 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.347+0000 7f1307e0e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:56:31.397 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.395+0000 7f1307e0e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:56:31.444 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.443+0000 7f1307e0e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:56:31.496 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.495+0000 7f1307e0e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:31.538 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.537+0000 7f1307e0e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:56:31.579 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:31.578+0000 7f1307e0e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:56:31.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.702+0000 7f0972ffd640 1 -- 172.21.15.121:0/4230145750 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_b_metadata", "pg_num_min": 64}]=0 pool 'cephfs_b_metadata' created v40) ==== 142+0+0 (secure 0 0 0) 0x7f0974011bb0 con 0x7f097c0a4ab0 2024-09-15T23:56:31.703 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_b_metadata' created 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 msgr2=0x7f095c03a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 0x7f095c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 msgr2=0x7f097c09fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f097400c420 tx=0x7f097400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 shutdown_connections 2024-09-15T23:56:31.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f095c0382f0 0x7f095c03a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 --2- 172.21.15.121:0/4230145750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f097c0a4ab0 0x7f097c09fec0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 >> 172.21.15.121:0/4230145750 conn(0x7f097c0ac370 msgr2=0x7f097c0ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:31.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 shutdown_connections 2024-09-15T23:56:31.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.706+0000 7f098098d640 1 -- 172.21.15.121:0/4230145750 wait complete. 2024-09-15T23:56:31.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:56:31.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.871+0000 7f007338d640 1 Processor -- start 2024-09-15T23:56:31.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f007338d640 1 -- start start 2024-09-15T23:56:31.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f007338d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f006c0a2ac0 0x7f006c13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f007338d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006c0a03f0 con 0x7f006c0a4940 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f007338d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f006c0a4510 con 0x7f006c0a2ac0 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0070928640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f006c0a2ac0 0x7f006c13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0070928640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f006c0a2ac0 0x7f006c13bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46262/0 (socket says 172.21.15.121:46262) 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0070928640 1 -- 172.21.15.121:0/3488863677 learned_addr learned my addr 172.21.15.121:0/3488863677 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0071129640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f006c0a4940 0x7f006c0a4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:56932/0 (socket says 172.21.15.121:56932) 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0070928640 1 -- 172.21.15.121:0/3488863677 >> v1:172.21.15.121:6789/0 conn(0x7f006c0a4940 legacy=0x7f006c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0070928640 1 -- 172.21.15.121:0/3488863677 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c0a2ef0 con 0x7f006c0a2ac0 2024-09-15T23:56:31.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.872+0000 7f0063fff640 1 -- 172.21.15.121:0/3488863677 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346484423 0 0) 0x7f006c0a03f0 con 0x7f006c0a4940 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.873+0000 7f0070928640 1 --2- 172.21.15.121:0/3488863677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c13bad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f00680097f0 tx=0x7f006802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8415feb26fb34a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.873+0000 7f0063fff640 1 -- 172.21.15.121:0/3488863677 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0068037070 con 0x7f006c0a2ac0 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.873+0000 7f0063fff640 1 -- 172.21.15.121:0/3488863677 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0068032440 con 0x7f006c0a2ac0 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.873+0000 7f0063fff640 1 -- 172.21.15.121:0/3488863677 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f006802ae60 con 0x7f006c0a2ac0 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 -- 172.21.15.121:0/3488863677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 msgr2=0x7f006c13bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 --2- 172.21.15.121:0/3488863677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c13bad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f00680097f0 tx=0x7f006802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 -- 172.21.15.121:0/3488863677 shutdown_connections 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 --2- 172.21.15.121:0/3488863677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c13bad0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 -- 172.21.15.121:0/3488863677 >> 172.21.15.121:0/3488863677 conn(0x7f006c0a9260 msgr2=0x7f006c0a9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 -- 172.21.15.121:0/3488863677 shutdown_connections 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.874+0000 7f007338d640 1 -- 172.21.15.121:0/3488863677 wait complete. 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.875+0000 7f007338d640 1 Processor -- start 2024-09-15T23:56:31.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.875+0000 7f007338d640 1 -- start start 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.875+0000 7f007338d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.875+0000 7f007338d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f006c0a2330 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.875+0000 7f0071129640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0071129640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:46276/0 (socket says 172.21.15.121:46276) 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0071129640 1 -- 172.21.15.121:0/1475040969 learned_addr learned my addr 172.21.15.121:0/1475040969 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0071129640 1 -- 172.21.15.121:0/1475040969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c122370 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0071129640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c420 tx=0x7f005c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c018070 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f005c0074d0 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c122bf0 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f005c004950 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.876+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c120530 con 0x7f006c0a2ac0 2024-09-15T23:56:31.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.877+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006c120810 con 0x7f006c0a2ac0 2024-09-15T23:56:31.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.877+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 45746+0+0 (secure 0 0 0) 0x7f005c01b070 con 0x7f006c0a2ac0 2024-09-15T23:56:31.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.878+0000 7f0061ffb640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 0x7f005003a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:31.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.878+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 3811+0+0 (secure 0 0 0) 0x7f005c04a760 con 0x7f006c0a2ac0 2024-09-15T23:56:31.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.878+0000 7f0070928640 1 -- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 msgr2=0x7f005003a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:31.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.878+0000 7f0070928640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 0x7f005003a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:31.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:31.882+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f005c01ca00 con 0x7f006c0a2ac0 2024-09-15T23:56:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.055+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f006c06ccc0 con 0x7f006c0a2ac0 2024-09-15T23:56:32.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.079+0000 7f0070928640 1 -- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 msgr2=0x7f005003a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/1410518606 2024-09-15T23:56:32.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.079+0000 7f0070928640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 0x7f005003a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:32.171 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.170+0000 7f1307e0e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:56:32.174 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.174+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_b_data' created v41) ==== 174+0+0 (secure 0 0 0) 0x7f005c01cc60 con 0x7f006c0a2ac0 2024-09-15T23:56:32.175 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_b_data' created 2024-09-15T23:56:32.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.179+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 17) ==== 45457+0+0 (secure 0 0 0) 0x7f005c01b880 con 0x7f006c0a2ac0 2024-09-15T23:56:32.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.179+0000 7f0061ffb640 1 -- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 msgr2=0x7f005003a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:32.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.179+0000 7f0061ffb640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 0x7f005003a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.179+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 msgr2=0x7f006c11f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:32.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.179+0000 7f007338d640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c420 tx=0x7f005c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.180+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 shutdown_connections 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.180+0000 7f007338d640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:6827/1410518606,v1:172.21.15.121:6829/1410518606] conn(0x7f00500382f0 0x7f005003a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.180+0000 7f007338d640 1 --2- 172.21.15.121:0/1475040969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f006c0a2ac0 0x7f006c11f490 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.180+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 >> 172.21.15.121:0/1475040969 conn(0x7f006c0a9260 msgr2=0x7f006c06bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.184+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 shutdown_connections 2024-09-15T23:56:32.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.185+0000 7f007338d640 1 -- 172.21.15.121:0/1475040969 wait complete. 2024-09-15T23:56:32.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs_b cephfs_b_metadata cephfs_b_data 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f12870d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f12870d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f12870d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f12870d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f12870d5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f128a0db640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f128a0db640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.315 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f128a0db640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.316 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f128a0db640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.316 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:32.244+0000 7f128a0db640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.415+0000 7ff73ae27640 1 Processor -- start 2024-09-15T23:56:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.415+0000 7ff73ae27640 1 -- start start 2024-09-15T23:56:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff73ae27640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7340a5a40 0x7ff7340a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff73ae27640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73406d9d0 con 0x7ff7340a5360 2024-09-15T23:56:32.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff73ae27640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff73406cd00 con 0x7ff7340a5a40 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff738bc3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7340a5a40 0x7ff7340a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff733fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff7340a5360 0x7ff734139bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59344/0 (socket says 172.21.15.121:59344) 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff733fff640 1 -- 172.21.15.121:0/3832771864 learned_addr learned my addr 172.21.15.121:0/3832771864 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff738bc3640 1 -- 172.21.15.121:0/3832771864 >> v1:172.21.15.121:6789/0 conn(0x7ff7340a5360 legacy=0x7ff734139bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff7337fe640 1 -- 172.21.15.121:0/3832771864 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288203254 0 0) 0x7ff73406d9d0 con 0x7ff7340a5360 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.416+0000 7ff738bc3640 1 -- 172.21.15.121:0/3832771864 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7340a5820 con 0x7ff7340a5a40 2024-09-15T23:56:32.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.417+0000 7ff738bc3640 1 --2- 172.21.15.121:0/3832771864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5a40 0x7ff7340a5e20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff724009720 tx=0x7ff72402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5610db7c013144b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:32.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.417+0000 7ff7337fe640 1 -- 172.21.15.121:0/3832771864 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724037070 con 0x7ff7340a5a40 2024-09-15T23:56:32.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.417+0000 7ff7337fe640 1 -- 172.21.15.121:0/3832771864 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72402ae20 con 0x7ff7340a5a40 2024-09-15T23:56:32.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.417+0000 7ff7337fe640 1 -- 172.21.15.121:0/3832771864 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724032590 con 0x7ff7340a5a40 2024-09-15T23:56:32.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 -- 172.21.15.121:0/3832771864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5a40 msgr2=0x7ff7340a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:32.435 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 --2- 172.21.15.121:0/3832771864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5a40 0x7ff7340a5e20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff724009720 tx=0x7ff72402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 -- 172.21.15.121:0/3832771864 shutdown_connections 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 --2- 172.21.15.121:0/3832771864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5a40 0x7ff7340a5e20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 -- 172.21.15.121:0/3832771864 >> 172.21.15.121:0/3832771864 conn(0x7ff7340aa380 msgr2=0x7ff7340aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 -- 172.21.15.121:0/3832771864 shutdown_connections 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.418+0000 7ff73ae27640 1 -- 172.21.15.121:0/3832771864 wait complete. 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff73ae27640 1 Processor -- start 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff73ae27640 1 -- start start 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff73ae27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff73ae27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff73409f3d0 con 0x7ff7340a5360 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff738bc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff738bc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39132/0 (socket says 172.21.15.121:39132) 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.419+0000 7ff738bc3640 1 -- 172.21.15.121:0/280277139 learned_addr learned my addr 172.21.15.121:0/280277139 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff738bc3640 1 -- 172.21.15.121:0/280277139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff734124d70 con 0x7ff7340a5360 2024-09-15T23:56:32.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff738bc3640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff72402a1e0 tx=0x7ff7240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724037040 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff724004030 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff734124480 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff724004310 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.420+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff734124170 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.421+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 17) ==== 45457+0+0 (secure 0 0 0) 0x7ff72403a040 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.421+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4453+0+0 (secure 0 0 0) 0x7ff72406be70 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.421+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73406e950 con 0x7ff7340a5360 2024-09-15T23:56:32.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.426+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff72402ae20 con 0x7ff7340a5360 2024-09-15T23:56:32.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:32.623+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs_b", "metadata": "cephfs_b_metadata", "data": "cephfs_b_data"} v 0) -- 0x7ff7340a1140 con 0x7ff7340a5360 2024-09-15T23:56:33.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.178+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 18) ==== 45584+0+0 (secure 0 0 0) 0x7ff724003820 con 0x7ff7340a5360 2024-09-15T23:56:33.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.178+0000 7ff7317fa640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 0x7ff720040ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.179 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.178+0000 7ff733fff640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 0x7ff720040ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.179+0000 7ff733fff640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 0x7ff720040ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff728000c00 tx=0x7ff728007910 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.180+0000 7ff7317fa640 1 -- 172.21.15.121:0/280277139 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs_b", "metadata": "cephfs_b_metadata", "data": "cephfs_b_data"}]=0 new fs with metadata pool 8 and data pool 9 v20) ==== 178+0+0 (secure 0 0 0) 0x7ff724042020 con 0x7ff7340a5360 2024-09-15T23:56:33.182 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 8 and data pool 9 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 msgr2=0x7ff720040ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 0x7ff720040ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff728000c00 tx=0x7ff728007910 comp rx=0 tx=0).stop 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 msgr2=0x7ff734120a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff72402a1e0 tx=0x7ff7240046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 shutdown_connections 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7ff72003eab0 0x7ff720040ea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 --2- 172.21.15.121:0/280277139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7340a5360 0x7ff734120a60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 >> 172.21.15.121:0/280277139 conn(0x7ff7340aa380 msgr2=0x7ff734072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 shutdown_connections 2024-09-15T23:56:33.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.184+0000 7ff73ae27640 1 -- 172.21.15.121:0/280277139 wait complete. 2024-09-15T23:56:33.202 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:33.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.343+0000 7f0503077640 1 Processor -- start 2024-09-15T23:56:33.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.343+0000 7f0503077640 1 -- start start 2024-09-15T23:56:33.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f0503077640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04fc135f30 0x7f04fc13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f0503077640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc0a08c0 con 0x7f04fc135b50 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f0503077640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc09b310 con 0x7f04fc135f30 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04fc135f30 0x7f04fc13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04fc135f30 0x7f04fc13bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39142/0 (socket says 172.21.15.121:39142) 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f0500e13640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f04fc135b50 0x7f04fc09aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59360/0 (socket says 172.21.15.121:59360) 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fbfff640 1 -- 172.21.15.121:0/257685996 learned_addr learned my addr 172.21.15.121:0/257685996 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fbfff640 1 -- 172.21.15.121:0/257685996 >> v1:172.21.15.121:6789/0 conn(0x7f04fc135b50 legacy=0x7f04fc09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fbfff640 1 -- 172.21.15.121:0/257685996 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc0a2270 con 0x7f04fc135f30 2024-09-15T23:56:33.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.344+0000 7f04fb7fe640 1 -- 172.21.15.121:0/257685996 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559376187 0 0) 0x7f04fc0a08c0 con 0x7f04fc135b50 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.345+0000 7f04fbfff640 1 --2- 172.21.15.121:0/257685996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135f30 0x7f04fc13bb80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ba90 tx=0x7f04f002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f05cd856fefed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.345+0000 7f04fb7fe640 1 -- 172.21.15.121:0/257685996 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f0036020 con 0x7f04fc135f30 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.345+0000 7f04fb7fe640 1 -- 172.21.15.121:0/257685996 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0032770 con 0x7f04fc135f30 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.345+0000 7f04fb7fe640 1 -- 172.21.15.121:0/257685996 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f0032a70 con 0x7f04fc135f30 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 -- 172.21.15.121:0/257685996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135f30 msgr2=0x7f04fc13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 --2- 172.21.15.121:0/257685996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135f30 0x7f04fc13bb80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f04f000ba90 tx=0x7f04f002c940 comp rx=0 tx=0).stop 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 -- 172.21.15.121:0/257685996 shutdown_connections 2024-09-15T23:56:33.350 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 --2- 172.21.15.121:0/257685996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135f30 0x7f04fc13bb80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 -- 172.21.15.121:0/257685996 >> 172.21.15.121:0/257685996 conn(0x7f04fc0a85e0 msgr2=0x7f04fc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 -- 172.21.15.121:0/257685996 shutdown_connections 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.346+0000 7f0503077640 1 -- 172.21.15.121:0/257685996 wait complete. 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0503077640 1 Processor -- start 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0503077640 1 -- start start 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0503077640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0503077640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc136350 con 0x7f04fc135b50 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0500e13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0500e13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39150/0 (socket says 172.21.15.121:39150) 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.347+0000 7f0500e13640 1 -- 172.21.15.121:0/3122985691 learned_addr learned my addr 172.21.15.121:0/3122985691 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f0500e13640 1 -- 172.21.15.121:0/3122985691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1262d0 con 0x7f04fc135b50 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f0500e13640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c420 tx=0x7f04ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.351 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ec018070 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ec0074d0 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc125740 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ec004950 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.348+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc123900 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 45584+0+0 (secure 0 0 0) 0x7f04ec01b070 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f04f97fa640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 0x7f04e803a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4557+0+0 (secure 0 0 0) 0x7f04ec04a720 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc123be0 con 0x7f04fc135b50 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f04fbfff640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 0x7f04e803a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.349+0000 7f04fbfff640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 0x7f04e803a600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04f0037000 tx=0x7f04f0008040 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.354+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04ec0119b0 con 0x7f04fc135b50 2024-09-15T23:56:33.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.521+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04fc09aae0 con 0x7f04fc135b50 2024-09-15T23:56:33.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.523+0000 7f04f97fa640 1 -- 172.21.15.121:0/3122985691 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+14960 (secure 0 0 0) 0x7f04ec011c10 con 0x7f04fc135b50 2024-09-15T23:56:33.524 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:33.524 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":42,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:32.624936+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 msgr2=0x7f04e803a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 0x7f04e803a600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f04f0037000 tx=0x7f04f0008040 comp rx=0 tx=0).stop 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 msgr2=0x7f04fc121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00c420 tx=0x7f04ec00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 shutdown_connections 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04e8038140 0x7f04e803a600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 --2- 172.21.15.121:0/3122985691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04fc135b50 0x7f04fc121c60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 >> 172.21.15.121:0/3122985691 conn(0x7f04fc0a85e0 msgr2=0x7f04fc0a7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 shutdown_connections 2024-09-15T23:56:33.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.525+0000 7f0503077640 1 -- 172.21.15.121:0/3122985691 wait complete. 2024-09-15T23:56:33.536 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:33.633 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f93206ba640 1 Processor -- start 2024-09-15T23:56:33.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f93206ba640 1 -- start start 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f93206ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f93180a0790 0x7f931813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f93206ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93181375a0 con 0x7f9318136ab0 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f93206ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f93180a0bb0 con 0x7f93180a0790 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f931dc55640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f93180a0790 0x7f931813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f931e456640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9318136ab0 0x7f9318136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59372/0 (socket says 172.21.15.121:59372) 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.633+0000 7f931e456640 1 -- 172.21.15.121:0/2327615730 learned_addr learned my addr 172.21.15.121:0/2327615730 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931dc55640 1 -- 172.21.15.121:0/2327615730 >> v1:172.21.15.121:6789/0 conn(0x7f9318136ab0 legacy=0x7f9318136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931dc55640 1 -- 172.21.15.121:0/2327615730 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93180a0e40 con 0x7f93180a0790 2024-09-15T23:56:33.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931d454640 1 -- 172.21.15.121:0/2327615730 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121192658 0 0) 0x7f93181375a0 con 0x7f9318136ab0 2024-09-15T23:56:33.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931dc55640 1 --2- 172.21.15.121:0/2327615730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f931813ee50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f930c009720 tx=0x7f930c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b8343b41fca140 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931d454640 1 -- 172.21.15.121:0/2327615730 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f930c037070 con 0x7f93180a0790 2024-09-15T23:56:33.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.634+0000 7f931d454640 1 -- 172.21.15.121:0/2327615730 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c02ae20 con 0x7f93180a0790 2024-09-15T23:56:33.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f931d454640 1 -- 172.21.15.121:0/2327615730 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f930c032590 con 0x7f93180a0790 2024-09-15T23:56:33.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 -- 172.21.15.121:0/2327615730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 msgr2=0x7f931813ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 --2- 172.21.15.121:0/2327615730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f931813ee50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f930c009720 tx=0x7f930c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 -- 172.21.15.121:0/2327615730 shutdown_connections 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 --2- 172.21.15.121:0/2327615730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f931813ee50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 -- 172.21.15.121:0/2327615730 >> 172.21.15.121:0/2327615730 conn(0x7f93180a85e0 msgr2=0x7f93180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 -- 172.21.15.121:0/2327615730 shutdown_connections 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.635+0000 7f93206ba640 1 -- 172.21.15.121:0/2327615730 wait complete. 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f93206ba640 1 Processor -- start 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f93206ba640 1 -- start start 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f93206ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f93206ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f93180a5490 con 0x7f93180a0790 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f931e456640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f931e456640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39178/0 (socket says 172.21.15.121:39178) 2024-09-15T23:56:33.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.636+0000 7f931e456640 1 -- 172.21.15.121:0/743161424 learned_addr learned my addr 172.21.15.121:0/743161424 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:33.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f931e456640 1 -- 172.21.15.121:0/743161424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9318135640 con 0x7f93180a0790 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f931e456640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f931400c420 tx=0x7f931400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9314018070 con 0x7f93180a0790 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93140074d0 con 0x7f93180a0790 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9314004950 con 0x7f93180a0790 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931813a440 con 0x7f93180a0790 2024-09-15T23:56:33.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.637+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9318120da0 con 0x7f93180a0790 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.638+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 45584+0+0 (secure 0 0 0) 0x7f931401b070 con 0x7f93180a0790 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.638+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93181353e0 con 0x7f93180a0790 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.638+0000 7f930affd640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 0x7f92fc03a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.638+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4557+0+0 (secure 0 0 0) 0x7f931404a720 con 0x7f93180a0790 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.638+0000 7f931dc55640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 0x7f92fc03a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.639+0000 7f931dc55640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 0x7f92fc03a600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f930c034000 tx=0x7f930c02e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.643+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93140119b0 con 0x7f93180a0790 2024-09-15T23:56:33.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.813+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93181227d0 con 0x7f93180a0790 2024-09-15T23:56:33.815 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.814+0000 7f930affd640 1 -- 172.21.15.121:0/743161424 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+14947 (secure 0 0 0) 0x7f9314011c10 con 0x7f93180a0790 2024-09-15T23:56:33.815 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:33.815 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:33.704066+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 msgr2=0x7f92fc03a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 0x7f92fc03a600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f930c034000 tx=0x7f930c02e000 comp rx=0 tx=0).stop 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 msgr2=0x7f93181213b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f931400c420 tx=0x7f931400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 shutdown_connections 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f92fc038140 0x7f92fc03a600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 --2- 172.21.15.121:0/743161424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f93180a0790 0x7f93181213b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 >> 172.21.15.121:0/743161424 conn(0x7f93180a85e0 msgr2=0x7f93180a4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 shutdown_connections 2024-09-15T23:56:33.817 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.816+0000 7f93206ba640 1 -- 172.21.15.121:0/743161424 wait complete. 2024-09-15T23:56:33.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs_b standby_count_wanted 0 2024-09-15T23:56:33.928 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.927+0000 7f35efd03640 1 Processor -- start 2024-09-15T23:56:33.929 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35efd03640 1 -- start start 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35efd03640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35e8133020 0x7f35e80a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35efd03640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e809abc0 con 0x7f35e8133400 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35efd03640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80a2310 con 0x7f35e8133020 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35eda9f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35e8133020 0x7f35e80a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35ed29e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f35e8133400 0x7f35e8135fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59386/0 (socket says 172.21.15.121:59386) 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35ed29e640 1 -- 172.21.15.121:0/2911207335 learned_addr learned my addr 172.21.15.121:0/2911207335 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.928+0000 7f35eda9f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f35e8133020 0x7f35e80a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39182/0 (socket says 172.21.15.121:39182) 2024-09-15T23:56:33.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eda9f640 1 -- 172.21.15.121:0/2911207335 >> v1:172.21.15.121:6789/0 conn(0x7f35e8133400 legacy=0x7f35e8135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eda9f640 1 -- 172.21.15.121:0/2911207335 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8132bf0 con 0x7f35e8133020 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eda9f640 1 --2- 172.21.15.121:0/2911207335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e80a04b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009720 tx=0x7f35e402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0afea03d79d17b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eca9d640 1 -- 172.21.15.121:0/2911207335 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4037070 con 0x7f35e8133020 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eca9d640 1 -- 172.21.15.121:0/2911207335 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e402ad90 con 0x7f35e8133020 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.929+0000 7f35eca9d640 1 -- 172.21.15.121:0/2911207335 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4032590 con 0x7f35e8133020 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 -- 172.21.15.121:0/2911207335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 msgr2=0x7f35e80a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 --2- 172.21.15.121:0/2911207335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e80a04b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009720 tx=0x7f35e402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 -- 172.21.15.121:0/2911207335 shutdown_connections 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 --2- 172.21.15.121:0/2911207335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e80a04b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 -- 172.21.15.121:0/2911207335 >> 172.21.15.121:0/2911207335 conn(0x7f35e80a8430 msgr2=0x7f35e80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:33.932 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 -- 172.21.15.121:0/2911207335 shutdown_connections 2024-09-15T23:56:33.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.930+0000 7f35efd03640 1 -- 172.21.15.121:0/2911207335 wait complete. 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35efd03640 1 Processor -- start 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35efd03640 1 -- start start 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35efd03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35efd03640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80a19c0 con 0x7f35e8133020 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35eda9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35eda9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39196/0 (socket says 172.21.15.121:39196) 2024-09-15T23:56:33.935 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.931+0000 7f35eda9f640 1 -- 172.21.15.121:0/1633686429 learned_addr learned my addr 172.21.15.121:0/1633686429 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35eda9f640 1 -- 172.21.15.121:0/1633686429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8072130 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35eda9f640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009840 tx=0x7f35e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4041020 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e403d550 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e8071b70 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35e4037040 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.932+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e80702f0 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.933+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 45584+0+0 (secure 0 0 0) 0x7f35e4044020 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.933+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e8133830 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.933+0000 7f35de7fc640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 0x7f35cc03a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.933+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f35e406bb40 con 0x7f35e8133020 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.933+0000 7f35ed29e640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 0x7f35cc03a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:33.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.934+0000 7f35ed29e640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 0x7f35cc03a5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35d8007fd0 tx=0x7f35d8007ac0 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:33.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:33.938+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35e404b030 con 0x7f35e8133020 2024-09-15T23:56:34.137 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.136+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs_b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f35e8072460 con 0x7f35e8133020 2024-09-15T23:56:34.183 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.182+0000 7f35de7fc640 1 -- 172.21.15.121:0/1633686429 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs_b", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7f35e403b3f0 con 0x7f35e8133020 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 msgr2=0x7f35cc03a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 0x7f35cc03a5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35d8007fd0 tx=0x7f35d8007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 msgr2=0x7f35e812f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009840 tx=0x7f35e40046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 shutdown_connections 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f35cc0380f0 0x7f35cc03a5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 --2- 172.21.15.121:0/1633686429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35e8133020 0x7f35e812f850 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 >> 172.21.15.121:0/1633686429 conn(0x7f35e80a8430 msgr2=0x7f35e81361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:34.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 shutdown_connections 2024-09-15T23:56:34.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.185+0000 7f35efd03640 1 -- 172.21.15.121:0/1633686429 wait complete. 2024-09-15T23:56:34.197 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:56:34.198 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs_b allow_standby_replay false 2024-09-15T23:56:34.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.304+0000 7f2b975fd640 1 Processor -- start 2024-09-15T23:56:34.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.304+0000 7f2b975fd640 1 -- start start 2024-09-15T23:56:34.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b975fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b900a3b90 0x7f2b900a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:34.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b975fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b900a4560 con 0x7f2b900a37b0 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b975fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2b9009b4f0 con 0x7f2b900a3b90 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b94b98640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2b900a3b90 0x7f2b900a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b95399640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2b900a37b0 0x7f2b9009acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59396/0 (socket says 172.21.15.121:59396) 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b95399640 1 -- 172.21.15.121:0/2100521603 learned_addr learned my addr 172.21.15.121:0/2100521603 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b94b98640 1 -- 172.21.15.121:0/2100521603 >> v1:172.21.15.121:6789/0 conn(0x7f2b900a37b0 legacy=0x7f2b9009acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:34.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.305+0000 7f2b94b98640 1 -- 172.21.15.121:0/2100521603 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b900a1c90 con 0x7f2b900a3b90 2024-09-15T23:56:34.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.306+0000 7f2b94b98640 1 --2- 172.21.15.121:0/2100521603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a3b90 0x7f2b900a4020 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009720 tx=0x7f2b8002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5256670203b334e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:34.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.306+0000 7f2b87fff640 1 -- 172.21.15.121:0/2100521603 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80037070 con 0x7f2b900a3b90 2024-09-15T23:56:34.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.306+0000 7f2b87fff640 1 -- 172.21.15.121:0/2100521603 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8002ad90 con 0x7f2b900a3b90 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.306+0000 7f2b87fff640 1 -- 172.21.15.121:0/2100521603 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b80032590 con 0x7f2b900a3b90 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 -- 172.21.15.121:0/2100521603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a3b90 msgr2=0x7f2b900a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 --2- 172.21.15.121:0/2100521603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a3b90 0x7f2b900a4020 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009720 tx=0x7f2b8002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 -- 172.21.15.121:0/2100521603 shutdown_connections 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 --2- 172.21.15.121:0/2100521603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a3b90 0x7f2b900a4020 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 -- 172.21.15.121:0/2100521603 >> 172.21.15.121:0/2100521603 conn(0x7f2b900a8430 msgr2=0x7f2b900a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 -- 172.21.15.121:0/2100521603 shutdown_connections 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.307+0000 7f2b975fd640 1 -- 172.21.15.121:0/2100521603 wait complete. 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b975fd640 1 Processor -- start 2024-09-15T23:56:34.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b975fd640 1 -- start start 2024-09-15T23:56:34.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b975fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:34.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b975fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2b900a5220 con 0x7f2b900a37b0 2024-09-15T23:56:34.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b95399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:34.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b95399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39246/0 (socket says 172.21.15.121:39246) 2024-09-15T23:56:34.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b95399640 1 -- 172.21.15.121:0/597779660 learned_addr learned my addr 172.21.15.121:0/597779660 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.308+0000 7f2b95399640 1 -- 172.21.15.121:0/597779660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b90124f70 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b95399640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c4a0 tx=0x7f2b8c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c017070 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c005c10 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b8c007070 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b90124530 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.309+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b90123f60 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 45584+0+0 (secure 0 0 0) 0x7f2b8c01a070 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b85ffb640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 0x7f2b7403a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f2b8c04a670 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b94b98640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 0x7f2b7403a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b901229d0 con 0x7f2b900a37b0 2024-09-15T23:56:34.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.310+0000 7f2b94b98640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 0x7f2b7403a600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009720 tx=0x7f2b8002e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:34.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.315+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b8c01b400 con 0x7f2b900a37b0 2024-09-15T23:56:34.516 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.515+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs_b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2b900a4020 con 0x7f2b900a37b0 2024-09-15T23:56:34.644 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:56:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:34.713+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7f2b8c010c00 con 0x7f2b900a37b0 2024-09-15T23:56:35.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.185+0000 7f2b85ffb640 1 -- 172.21.15.121:0/597779660 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs_b", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 124+0+0 (secure 0 0 0) 0x7f2b8c01c440 con 0x7f2b900a37b0 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 msgr2=0x7f2b7403a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 0x7f2b7403a600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009720 tx=0x7f2b8002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 msgr2=0x7f2b90120a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c4a0 tx=0x7f2b8c00c960 comp rx=0 tx=0).stop 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 shutdown_connections 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f2b74038140 0x7f2b7403a600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 --2- 172.21.15.121:0/597779660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2b900a37b0 0x7f2b90120a90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.187+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 >> 172.21.15.121:0/597779660 conn(0x7f2b900a8430 msgr2=0x7f2b90134a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.188+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 shutdown_connections 2024-09-15T23:56:35.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.188+0000 7f2b975fd640 1 -- 172.21.15.121:0/597779660 wait complete. 2024-09-15T23:56:35.199 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs_b' 2024-09-15T23:56:35.200 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.337+0000 7f984491a640 1 Processor -- start 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.337+0000 7f984491a640 1 -- start start 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f984491a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f984006ccc0 0x7f984009d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f984491a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984006eac0 con 0x7f984006d0a0 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f984491a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f984009ced0 con 0x7f984006ccc0 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f983e59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f984006ccc0 0x7f984009d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f9835d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f984006d0a0 0x7f984006d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59398/0 (socket says 172.21.15.121:59398) 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f983e59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f984006ccc0 0x7f984009d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39256/0 (socket says 172.21.15.121:39256) 2024-09-15T23:56:35.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f9835d9b640 1 -- 172.21.15.121:0/120224504 learned_addr learned my addr 172.21.15.121:0/120224504 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f983e59c640 1 -- 172.21.15.121:0/120224504 >> v1:172.21.15.121:6789/0 conn(0x7f984006d0a0 legacy=0x7f984006d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f983dd9b640 1 -- 172.21.15.121:0/120224504 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317671484 0 0) 0x7f984006eac0 con 0x7f984006d0a0 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.338+0000 7f983e59c640 1 -- 172.21.15.121:0/120224504 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984006e270 con 0x7f984006ccc0 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f983e59c640 1 --2- 172.21.15.121:0/120224504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f984009d6c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9830009720 tx=0x7f983002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387ead00272600e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f983dd9b640 1 -- 172.21.15.121:0/120224504 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830037070 con 0x7f984006ccc0 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f983dd9b640 1 -- 172.21.15.121:0/120224504 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983002ad90 con 0x7f984006ccc0 2024-09-15T23:56:35.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f983dd9b640 1 -- 172.21.15.121:0/120224504 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830032590 con 0x7f984006ccc0 2024-09-15T23:56:35.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f984491a640 1 -- 172.21.15.121:0/120224504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 msgr2=0x7f984009d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f984491a640 1 --2- 172.21.15.121:0/120224504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f984009d6c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9830009720 tx=0x7f983002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:35.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f984491a640 1 -- 172.21.15.121:0/120224504 shutdown_connections 2024-09-15T23:56:35.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f984491a640 1 --2- 172.21.15.121:0/120224504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f984009d6c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.345 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.339+0000 7f984491a640 1 -- 172.21.15.121:0/120224504 >> 172.21.15.121:0/120224504 conn(0x7f9840071aa0 msgr2=0x7f984009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.340+0000 7f984491a640 1 -- 172.21.15.121:0/120224504 shutdown_connections 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.340+0000 7f984491a640 1 -- 172.21.15.121:0/120224504 wait complete. 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f984491a640 1 Processor -- start 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f984491a640 1 -- start start 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f984491a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f984491a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f984009cc10 con 0x7f984006ccc0 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f983e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f983e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39260/0 (socket says 172.21.15.121:39260) 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f983e59c640 1 -- 172.21.15.121:0/3274063975 learned_addr learned my addr 172.21.15.121:0/3274063975 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:35.346 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.341+0000 7f983e59c640 1 -- 172.21.15.121:0/3274063975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98400a9fd0 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f983e59c640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9830009720 tx=0x7f98300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830041070 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983003c460 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9830037040 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98400a9160 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.342+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f984009fab0 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7f9830044070 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f98377fe640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 0x7f982003a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98400a9e00 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f983006c400 con 0x7f984006ccc0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f9835d9b640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 0x7f982003a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.343+0000 7f9835d9b640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 0x7f982003a840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9828000c00 tx=0x7f9828007910 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.348+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f983003ce70 con 0x7f984006ccc0 2024-09-15T23:56:35.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.548+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98400a7600 con 0x7f984006ccc0 2024-09-15T23:56:35.550 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.549+0000 7f98377fe640 1 -- 172.21.15.121:0/3274063975 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+4890 (secure 0 0 0) 0x7f9830034030 con 0x7f984006ccc0 2024-09-15T23:56:35.550 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:35.550 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-09-15T23:56:35:184080+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:35.550 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-09-15T23:56:35.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 msgr2=0x7f982003a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 0x7f982003a840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9828000c00 tx=0x7f9828007910 comp rx=0 tx=0).stop 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 msgr2=0x7f98401ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9830009720 tx=0x7f98300046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 shutdown_connections 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9820038380 0x7f982003a840 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 --2- 172.21.15.121:0/3274063975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f984006ccc0 0x7f98401ce630 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 >> 172.21.15.121:0/3274063975 conn(0x7f9840071aa0 msgr2=0x7f984013a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 shutdown_connections 2024-09-15T23:56:35.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.551+0000 7f984491a640 1 -- 172.21.15.121:0/3274063975 wait complete. 2024-09-15T23:56:35.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:35.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.659+0000 7fc78ecd0640 1 Processor -- start 2024-09-15T23:56:35.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.659+0000 7fc78ecd0640 1 -- start start 2024-09-15T23:56:35.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ecd0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc78813a220 0x7fc78813a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ecd0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc78809f2f0 con 0x7fc7880a1c80 2024-09-15T23:56:35.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ecd0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc7880a07d0 con 0x7fc78813a220 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ca6c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc78813a220 0x7fc78813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ca6c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc78813a220 0x7fc78813a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39266/0 (socket says 172.21.15.121:39266) 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ca6c640 1 -- 172.21.15.121:0/2153159455 learned_addr learned my addr 172.21.15.121:0/2153159455 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc787fff640 1 --1- 172.21.15.121:0/2153159455 >> v1:172.21.15.121:6789/0 conn(0x7fc7880a1c80 0x7fc788136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59402/0 (socket says 172.21.15.121:59402) 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ca6c640 1 -- 172.21.15.121:0/2153159455 >> v1:172.21.15.121:6789/0 conn(0x7fc7880a1c80 legacy=0x7fc788136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.660+0000 7fc78ca6c640 1 -- 172.21.15.121:0/2153159455 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc788139dd0 con 0x7fc78813a220 2024-09-15T23:56:35.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.661+0000 7fc78ca6c640 1 --2- 172.21.15.121:0/2153159455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc78813a220 0x7fc78813a600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0097f0 tx=0x7fc77c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077a0b2f9d165e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.661+0000 7fc7877fe640 1 -- 172.21.15.121:0/2153159455 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77c037070 con 0x7fc78813a220 2024-09-15T23:56:35.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.661+0000 7fc7877fe640 1 -- 172.21.15.121:0/2153159455 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c032440 con 0x7fc78813a220 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.661+0000 7fc7877fe640 1 -- 172.21.15.121:0/2153159455 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77c02ae60 con 0x7fc78813a220 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2153159455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc78813a220 msgr2=0x7fc78813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2153159455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc78813a220 0x7fc78813a600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0097f0 tx=0x7fc77c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2153159455 shutdown_connections 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2153159455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc78813a220 0x7fc78813a600 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2153159455 >> 172.21.15.121:0/2153159455 conn(0x7fc78806d820 msgr2=0x7fc78806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2153159455 shutdown_connections 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.662+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2153159455 wait complete. 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ecd0640 1 Processor -- start 2024-09-15T23:56:35.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ecd0640 1 -- start start 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ecd0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ecd0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc788139a20 con 0x7fc7880a1c80 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ca6c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ca6c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39280/0 (socket says 172.21.15.121:39280) 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.663+0000 7fc78ca6c640 1 -- 172.21.15.121:0/2526522955 learned_addr learned my addr 172.21.15.121:0/2526522955 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc78ca6c640 1 -- 172.21.15.121:0/2526522955 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7880aa0a0 con 0x7fc7880a1c80 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc78ca6c640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0090b0 tx=0x7fc77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77c041070 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77c03c7a0 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7880a96b0 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77c037040 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.664+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7880a9950 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.665+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7fc77c044070 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.665+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7880a7d80 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.665+0000 7fc7857fa640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 0x7fc76c03a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.665+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fc77c06c240 con 0x7fc7880a1c80 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.665+0000 7fc787fff640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 0x7fc76c03a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.666+0000 7fc787fff640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 0x7fc76c03a840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc78813ab40 tx=0x7fc774007a40 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.670+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7880aa0a0 con 0x7fc7880a1c80 2024-09-15T23:56:35.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.838+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7880a0100 con 0x7fc7880a1c80 2024-09-15T23:56:35.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.839+0000 7fc7857fa640 1 -- 172.21.15.121:0/2526522955 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+14947 (secure 0 0 0) 0x7fc77c03d3f0 con 0x7fc7880a1c80 2024-09-15T23:56:35.841 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:35.841 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:33.704066+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:35.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 msgr2=0x7fc76c03a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 0x7fc76c03a840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc78813ab40 tx=0x7fc774007a40 comp rx=0 tx=0).stop 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 msgr2=0x7fc7880a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0090b0 tx=0x7fc77c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 shutdown_connections 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fc76c038380 0x7fc76c03a840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 --2- 172.21.15.121:0/2526522955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc7880a1c80 0x7fc7880a6000 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 >> 172.21.15.121:0/2526522955 conn(0x7fc78806d820 msgr2=0x7fc7881346d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.841+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 shutdown_connections 2024-09-15T23:56:35.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.842+0000 7fc78ecd0640 1 -- 172.21.15.121:0/2526522955 wait complete. 2024-09-15T23:56:35.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:56:35.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.951+0000 7f706d5d6640 1 Processor -- start 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.951+0000 7f706d5d6640 1 -- start start 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.951+0000 7f706d5d6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70680a3080 0x7f706813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.951+0000 7f706d5d6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706813ab10 con 0x7f706813a020 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.951+0000 7f706d5d6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f70680a3de0 con 0x7f70680a3080 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f705e7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70680a3080 0x7f706813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f705e7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f70680a3080 0x7f706813ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39284/0 (socket says 172.21.15.121:39284) 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f705e7fc640 1 -- 172.21.15.121:0/660344876 learned_addr learned my addr 172.21.15.121:0/660344876 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f7066ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f706813a020 0x7f706813a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59404/0 (socket says 172.21.15.121:59404) 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f705e7fc640 1 -- 172.21.15.121:0/660344876 >> v1:172.21.15.121:6789/0 conn(0x7f706813a020 legacy=0x7f706813a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.952+0000 7f705e7fc640 1 -- 172.21.15.121:0/660344876 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706806c390 con 0x7f70680a3080 2024-09-15T23:56:35.954 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f705e7fc640 1 --2- 172.21.15.121:0/660344876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f706813ef80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f70500097f0 tx=0x7f705002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b94f377d1e17a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f70667fc640 1 -- 172.21.15.121:0/660344876 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7050037070 con 0x7f70680a3080 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f70667fc640 1 -- 172.21.15.121:0/660344876 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050032440 con 0x7f70680a3080 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f70667fc640 1 -- 172.21.15.121:0/660344876 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f705002ae60 con 0x7f70680a3080 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 -- 172.21.15.121:0/660344876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 msgr2=0x7f706813ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 --2- 172.21.15.121:0/660344876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f706813ef80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f70500097f0 tx=0x7f705002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 -- 172.21.15.121:0/660344876 shutdown_connections 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 --2- 172.21.15.121:0/660344876 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f706813ef80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 -- 172.21.15.121:0/660344876 >> 172.21.15.121:0/660344876 conn(0x7f70680a90f0 msgr2=0x7f70680a9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 -- 172.21.15.121:0/660344876 shutdown_connections 2024-09-15T23:56:35.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.953+0000 7f706d5d6640 1 -- 172.21.15.121:0/660344876 wait complete. 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.954+0000 7f706d5d6640 1 Processor -- start 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.954+0000 7f706d5d6640 1 -- start start 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f706d5d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f706d5d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70680a4c10 con 0x7f70680a3080 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f7066ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f7066ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39298/0 (socket says 172.21.15.121:39298) 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f7066ffd640 1 -- 172.21.15.121:0/2649492407 learned_addr learned my addr 172.21.15.121:0/2649492407 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f7066ffd640 1 -- 172.21.15.121:0/2649492407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7068124e20 con 0x7f70680a3080 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f7066ffd640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f705800c450 tx=0x7f705800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7058007410 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70580075b0 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7068122a40 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.955+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7058004910 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.956+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7068122760 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.956+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7f705801a020 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.956+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70680a5850 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.956+0000 7f705ffff640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 0x7f704803a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.957+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f705804af80 con 0x7f70680a3080 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.957+0000 7f705e7fc640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 0x7f704803a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.957+0000 7f705e7fc640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 0x7f704803a840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7050034000 tx=0x7f705002e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:35.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:35.961+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f705801bc00 con 0x7f70680a3080 2024-09-15T23:56:36.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.122+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 --> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7068138d30 con 0x7f7048038380 2024-09-15T23:56:36.134 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.133+0000 7f705ffff640 1 -- 172.21.15.121:0/2649492407 <== mgr.4609 v2:172.21.15.121:6827/3398364693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+482101 (secure 0 0 0) 0x7f7050032710 con 0x7f7048038380 2024-09-15T23:56:36.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:36.142 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:56:36.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 msgr2=0x7f704803a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 0x7f704803a840 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7050034000 tx=0x7f705002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:36.144 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 msgr2=0x7f7068120ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f705800c450 tx=0x7f705800c910 comp rx=0 tx=0).stop 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 shutdown_connections 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f7048038380 0x7f704803a840 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 --2- 172.21.15.121:0/2649492407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70680a3080 0x7f7068120ac0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 >> 172.21.15.121:0/2649492407 conn(0x7f70680a90f0 msgr2=0x7f70680a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 shutdown_connections 2024-09-15T23:56:36.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.137+0000 7f706d5d6640 1 -- 172.21.15.121:0/2649492407 wait complete. 2024-09-15T23:56:36.148 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-15T23:56:34.193681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595414,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":228,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87580,"kb_used_data":2316,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283027940,"statfs":{"total":289910292480,"available":289820610560,"internally_reserved":0,"allocated":2371584,"data_stored":1614592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.010772"},"pg_stats":[{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736527+0000","last_change":"2024-09-15T23:56:32.728725+0000","last_active":"2024-09-15T23:56:32.736527+0000","last_peered":"2024-09-15T23:56:32.736527+0000","last_clean":"2024-09-15T23:56:32.736527+0000","last_became_active":"2024-09-15T23:56:32.728470+0000","last_became_peered":"2024-09-15T23:56:32.728470+0000","last_unstale":"2024-09-15T23:56:32.736527+0000","last_undegraded":"2024-09-15T23:56:32.736527+0000","last_fullsized":"2024-09-15T23:56:32.736527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:31.911049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716762+0000","last_change":"2024-09-15T23:56:19.699159+0000","last_active":"2024-09-15T23:56:32.716762+0000","last_peered":"2024-09-15T23:56:32.716762+0000","last_clean":"2024-09-15T23:56:32.716762+0000","last_became_active":"2024-09-15T23:56:19.698923+0000","last_became_peered":"2024-09-15T23:56:19.698923+0000","last_unstale":"2024-09-15T23:56:32.716762+0000","last_undegraded":"2024-09-15T23:56:32.716762+0000","last_fullsized":"2024-09-15T23:56:32.716762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:27.036988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719073+0000","last_change":"2024-09-15T23:56:20.697033+0000","last_active":"2024-09-15T23:56:32.719073+0000","last_peered":"2024-09-15T23:56:32.719073+0000","last_clean":"2024-09-15T23:56:32.719073+0000","last_became_active":"2024-09-15T23:56:20.696772+0000","last_became_peered":"2024-09-15T23:56:20.696772+0000","last_unstale":"2024-09-15T23:56:32.719073+0000","last_undegraded":"2024-09-15T23:56:32.719073+0000","last_fullsized":"2024-09-15T23:56:32.719073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:43.492783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715403+0000","last_change":"2024-09-15T23:56:32.203024+0000","last_active":"2024-09-15T23:56:32.715403+0000","last_peered":"2024-09-15T23:56:32.715403+0000","last_clean":"2024-09-15T23:56:32.715403+0000","last_became_active":"2024-09-15T23:56:32.202771+0000","last_became_peered":"2024-09-15T23:56:32.202771+0000","last_unstale":"2024-09-15T23:56:32.715403+0000","last_undegraded":"2024-09-15T23:56:32.715403+0000","last_fullsized":"2024-09-15T23:56:32.715403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:03.305324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737080+0000","last_change":"2024-09-15T23:56:32.734530+0000","last_active":"2024-09-15T23:56:32.737080+0000","last_peered":"2024-09-15T23:56:32.737080+0000","last_clean":"2024-09-15T23:56:32.737080+0000","last_became_active":"2024-09-15T23:56:32.734284+0000","last_became_peered":"2024-09-15T23:56:32.734284+0000","last_unstale":"2024-09-15T23:56:32.737080+0000","last_undegraded":"2024-09-15T23:56:32.737080+0000","last_fullsized":"2024-09-15T23:56:32.737080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:47.970301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718695+0000","last_change":"2024-09-15T23:56:19.686214+0000","last_active":"2024-09-15T23:56:32.718695+0000","last_peered":"2024-09-15T23:56:32.718695+0000","last_clean":"2024-09-15T23:56:32.718695+0000","last_became_active":"2024-09-15T23:56:19.685934+0000","last_became_peered":"2024-09-15T23:56:19.685934+0000","last_unstale":"2024-09-15T23:56:32.718695+0000","last_undegraded":"2024-09-15T23:56:32.718695+0000","last_fullsized":"2024-09-15T23:56:32.718695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:23.562336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709600+0000","last_change":"2024-09-15T23:56:20.691620+0000","last_active":"2024-09-15T23:56:32.709600+0000","last_peered":"2024-09-15T23:56:32.709600+0000","last_clean":"2024-09-15T23:56:32.709600+0000","last_became_active":"2024-09-15T23:56:20.690902+0000","last_became_peered":"2024-09-15T23:56:20.690902+0000","last_unstale":"2024-09-15T23:56:32.709600+0000","last_undegraded":"2024-09-15T23:56:32.709600+0000","last_fullsized":"2024-09-15T23:56:32.709600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:12.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710643+0000","last_change":"2024-09-15T23:56:32.200029+0000","last_active":"2024-09-15T23:56:32.710643+0000","last_peered":"2024-09-15T23:56:32.710643+0000","last_clean":"2024-09-15T23:56:32.710643+0000","last_became_active":"2024-09-15T23:56:32.199351+0000","last_became_peered":"2024-09-15T23:56:32.199351+0000","last_unstale":"2024-09-15T23:56:32.710643+0000","last_undegraded":"2024-09-15T23:56:32.710643+0000","last_fullsized":"2024-09-15T23:56:32.710643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:26.904716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736595+0000","last_change":"2024-09-15T23:56:32.729005+0000","last_active":"2024-09-15T23:56:32.736595+0000","last_peered":"2024-09-15T23:56:32.736595+0000","last_clean":"2024-09-15T23:56:32.736595+0000","last_became_active":"2024-09-15T23:56:32.728218+0000","last_became_peered":"2024-09-15T23:56:32.728218+0000","last_unstale":"2024-09-15T23:56:32.736595+0000","last_undegraded":"2024-09-15T23:56:32.736595+0000","last_fullsized":"2024-09-15T23:56:32.736595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:40.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721554+0000","last_change":"2024-09-15T23:56:19.694386+0000","last_active":"2024-09-15T23:56:32.721554+0000","last_peered":"2024-09-15T23:56:32.721554+0000","last_clean":"2024-09-15T23:56:32.721554+0000","last_became_active":"2024-09-15T23:56:19.693850+0000","last_became_peered":"2024-09-15T23:56:19.693850+0000","last_unstale":"2024-09-15T23:56:32.721554+0000","last_undegraded":"2024-09-15T23:56:32.721554+0000","last_fullsized":"2024-09-15T23:56:32.721554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:10.056160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716694+0000","last_change":"2024-09-15T23:56:20.710664+0000","last_active":"2024-09-15T23:56:32.716694+0000","last_peered":"2024-09-15T23:56:32.716694+0000","last_clean":"2024-09-15T23:56:32.716694+0000","last_became_active":"2024-09-15T23:56:20.710260+0000","last_became_peered":"2024-09-15T23:56:20.710260+0000","last_unstale":"2024-09-15T23:56:32.716694+0000","last_undegraded":"2024-09-15T23:56:32.716694+0000","last_fullsized":"2024-09-15T23:56:32.716694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:39.006258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715469+0000","last_change":"2024-09-15T23:56:32.199818+0000","last_active":"2024-09-15T23:56:32.715469+0000","last_peered":"2024-09-15T23:56:32.715469+0000","last_clean":"2024-09-15T23:56:32.715469+0000","last_became_active":"2024-09-15T23:56:32.199557+0000","last_became_peered":"2024-09-15T23:56:32.199557+0000","last_unstale":"2024-09-15T23:56:32.715469+0000","last_undegraded":"2024-09-15T23:56:32.715469+0000","last_fullsized":"2024-09-15T23:56:32.715469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:25.939740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737768+0000","last_change":"2024-09-15T23:56:32.734290+0000","last_active":"2024-09-15T23:56:32.737768+0000","last_peered":"2024-09-15T23:56:32.737768+0000","last_clean":"2024-09-15T23:56:32.737768+0000","last_became_active":"2024-09-15T23:56:32.733217+0000","last_became_peered":"2024-09-15T23:56:32.733217+0000","last_unstale":"2024-09-15T23:56:32.737768+0000","last_undegraded":"2024-09-15T23:56:32.737768+0000","last_fullsized":"2024-09-15T23:56:32.737768+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:22.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718203+0000","last_change":"2024-09-15T23:56:19.689323+0000","last_active":"2024-09-15T23:56:32.718203+0000","last_peered":"2024-09-15T23:56:32.718203+0000","last_clean":"2024-09-15T23:56:32.718203+0000","last_became_active":"2024-09-15T23:56:19.688934+0000","last_became_peered":"2024-09-15T23:56:19.688934+0000","last_unstale":"2024-09-15T23:56:32.718203+0000","last_undegraded":"2024-09-15T23:56:32.718203+0000","last_fullsized":"2024-09-15T23:56:32.718203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:23.699701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721136+0000","last_change":"2024-09-15T23:56:20.712331+0000","last_active":"2024-09-15T23:56:32.721136+0000","last_peered":"2024-09-15T23:56:32.721136+0000","last_clean":"2024-09-15T23:56:32.721136+0000","last_became_active":"2024-09-15T23:56:20.711680+0000","last_became_peered":"2024-09-15T23:56:20.711680+0000","last_unstale":"2024-09-15T23:56:32.721136+0000","last_undegraded":"2024-09-15T23:56:32.721136+0000","last_fullsized":"2024-09-15T23:56:32.721136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:30.490761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718594+0000","last_change":"2024-09-15T23:56:32.209526+0000","last_active":"2024-09-15T23:56:32.718594+0000","last_peered":"2024-09-15T23:56:32.718594+0000","last_clean":"2024-09-15T23:56:32.718594+0000","last_became_active":"2024-09-15T23:56:32.209269+0000","last_became_peered":"2024-09-15T23:56:32.209269+0000","last_unstale":"2024-09-15T23:56:32.718594+0000","last_undegraded":"2024-09-15T23:56:32.718594+0000","last_fullsized":"2024-09-15T23:56:32.718594+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:23.539178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737324+0000","last_change":"2024-09-15T23:56:32.734482+0000","last_active":"2024-09-15T23:56:32.737324+0000","last_peered":"2024-09-15T23:56:32.737324+0000","last_clean":"2024-09-15T23:56:32.737324+0000","last_became_active":"2024-09-15T23:56:32.734234+0000","last_became_peered":"2024-09-15T23:56:32.734234+0000","last_unstale":"2024-09-15T23:56:32.737324+0000","last_undegraded":"2024-09-15T23:56:32.737324+0000","last_fullsized":"2024-09-15T23:56:32.737324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:54.112503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715798+0000","last_change":"2024-09-15T23:56:20.699756+0000","last_active":"2024-09-15T23:56:32.715798+0000","last_peered":"2024-09-15T23:56:32.715798+0000","last_clean":"2024-09-15T23:56:32.715798+0000","last_became_active":"2024-09-15T23:56:20.699505+0000","last_became_peered":"2024-09-15T23:56:20.699505+0000","last_unstale":"2024-09-15T23:56:32.715798+0000","last_undegraded":"2024-09-15T23:56:32.715798+0000","last_fullsized":"2024-09-15T23:56:32.715798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:38.597293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708639+0000","last_change":"2024-09-15T23:56:19.684144+0000","last_active":"2024-09-15T23:56:32.708639+0000","last_peered":"2024-09-15T23:56:32.708639+0000","last_clean":"2024-09-15T23:56:32.708639+0000","last_became_active":"2024-09-15T23:56:19.683740+0000","last_became_peered":"2024-09-15T23:56:19.683740+0000","last_unstale":"2024-09-15T23:56:32.708639+0000","last_undegraded":"2024-09-15T23:56:32.708639+0000","last_fullsized":"2024-09-15T23:56:32.708639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:11.966919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.724750+0000","last_change":"2024-09-15T23:56:32.207428+0000","last_active":"2024-09-15T23:56:32.724750+0000","last_peered":"2024-09-15T23:56:32.724750+0000","last_clean":"2024-09-15T23:56:32.724750+0000","last_became_active":"2024-09-15T23:56:32.206952+0000","last_became_peered":"2024-09-15T23:56:32.206952+0000","last_unstale":"2024-09-15T23:56:32.724750+0000","last_undegraded":"2024-09-15T23:56:32.724750+0000","last_fullsized":"2024-09-15T23:56:32.724750+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.283204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735733+0000","last_change":"2024-09-15T23:56:32.727520+0000","last_active":"2024-09-15T23:56:32.735733+0000","last_peered":"2024-09-15T23:56:32.735733+0000","last_clean":"2024-09-15T23:56:32.735733+0000","last_became_active":"2024-09-15T23:56:32.727210+0000","last_became_peered":"2024-09-15T23:56:32.727210+0000","last_unstale":"2024-09-15T23:56:32.735733+0000","last_undegraded":"2024-09-15T23:56:32.735733+0000","last_fullsized":"2024-09-15T23:56:32.735733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:09.081051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718414+0000","last_change":"2024-09-15T23:56:20.718694+0000","last_active":"2024-09-15T23:56:32.718414+0000","last_peered":"2024-09-15T23:56:32.718414+0000","last_clean":"2024-09-15T23:56:32.718414+0000","last_became_active":"2024-09-15T23:56:20.718450+0000","last_became_peered":"2024-09-15T23:56:20.718450+0000","last_unstale":"2024-09-15T23:56:32.718414+0000","last_undegraded":"2024-09-15T23:56:32.718414+0000","last_fullsized":"2024-09-15T23:56:32.718414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:05.347620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715910+0000","last_change":"2024-09-15T23:56:19.693752+0000","last_active":"2024-09-15T23:56:32.715910+0000","last_peered":"2024-09-15T23:56:32.715910+0000","last_clean":"2024-09-15T23:56:32.715910+0000","last_became_active":"2024-09-15T23:56:19.693438+0000","last_became_peered":"2024-09-15T23:56:19.693438+0000","last_unstale":"2024-09-15T23:56:32.715910+0000","last_undegraded":"2024-09-15T23:56:32.715910+0000","last_fullsized":"2024-09-15T23:56:32.715910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:53.993520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719626+0000","last_change":"2024-09-15T23:56:32.199822+0000","last_active":"2024-09-15T23:56:32.719626+0000","last_peered":"2024-09-15T23:56:32.719626+0000","last_clean":"2024-09-15T23:56:32.719626+0000","last_became_active":"2024-09-15T23:56:32.199445+0000","last_became_peered":"2024-09-15T23:56:32.199445+0000","last_unstale":"2024-09-15T23:56:32.719626+0000","last_undegraded":"2024-09-15T23:56:32.719626+0000","last_fullsized":"2024-09-15T23:56:32.719626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:14.395987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727683+0000","last_change":"2024-09-15T23:56:32.721846+0000","last_active":"2024-09-15T23:56:32.727683+0000","last_peered":"2024-09-15T23:56:32.727683+0000","last_clean":"2024-09-15T23:56:32.727683+0000","last_became_active":"2024-09-15T23:56:32.720379+0000","last_became_peered":"2024-09-15T23:56:32.720379+0000","last_unstale":"2024-09-15T23:56:32.727683+0000","last_undegraded":"2024-09-15T23:56:32.727683+0000","last_fullsized":"2024-09-15T23:56:32.727683+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:58.842610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.722586+0000","last_change":"2024-09-15T23:56:20.711902+0000","last_active":"2024-09-15T23:56:32.722586+0000","last_peered":"2024-09-15T23:56:32.722586+0000","last_clean":"2024-09-15T23:56:32.722586+0000","last_became_active":"2024-09-15T23:56:20.711592+0000","last_became_peered":"2024-09-15T23:56:20.711592+0000","last_unstale":"2024-09-15T23:56:32.722586+0000","last_undegraded":"2024-09-15T23:56:32.722586+0000","last_fullsized":"2024-09-15T23:56:32.722586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:19.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718501+0000","last_change":"2024-09-15T23:56:19.690132+0000","last_active":"2024-09-15T23:56:32.718501+0000","last_peered":"2024-09-15T23:56:32.718501+0000","last_clean":"2024-09-15T23:56:32.718501+0000","last_became_active":"2024-09-15T23:56:19.689823+0000","last_became_peered":"2024-09-15T23:56:19.689823+0000","last_unstale":"2024-09-15T23:56:32.718501+0000","last_undegraded":"2024-09-15T23:56:32.718501+0000","last_fullsized":"2024-09-15T23:56:32.718501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:57.040079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.723766+0000","last_change":"2024-09-15T23:56:32.192808+0000","last_active":"2024-09-15T23:56:32.723766+0000","last_peered":"2024-09-15T23:56:32.723766+0000","last_clean":"2024-09-15T23:56:32.723766+0000","last_became_active":"2024-09-15T23:56:32.192414+0000","last_became_peered":"2024-09-15T23:56:32.192414+0000","last_unstale":"2024-09-15T23:56:32.723766+0000","last_undegraded":"2024-09-15T23:56:32.723766+0000","last_fullsized":"2024-09-15T23:56:32.723766+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:58.761114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736616+0000","last_change":"2024-09-15T23:56:32.731750+0000","last_active":"2024-09-15T23:56:32.736616+0000","last_peered":"2024-09-15T23:56:32.736616+0000","last_clean":"2024-09-15T23:56:32.736616+0000","last_became_active":"2024-09-15T23:56:32.731494+0000","last_became_peered":"2024-09-15T23:56:32.731494+0000","last_unstale":"2024-09-15T23:56:32.736616+0000","last_undegraded":"2024-09-15T23:56:32.736616+0000","last_fullsized":"2024-09-15T23:56:32.736616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:15.225628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.711885+0000","last_change":"2024-09-15T23:56:19.699217+0000","last_active":"2024-09-15T23:56:32.711885+0000","last_peered":"2024-09-15T23:56:32.711885+0000","last_clean":"2024-09-15T23:56:32.711885+0000","last_became_active":"2024-09-15T23:56:19.698869+0000","last_became_peered":"2024-09-15T23:56:19.698869+0000","last_unstale":"2024-09-15T23:56:32.711885+0000","last_undegraded":"2024-09-15T23:56:32.711885+0000","last_fullsized":"2024-09-15T23:56:32.711885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:42.489872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718643+0000","last_change":"2024-09-15T23:56:20.717899+0000","last_active":"2024-09-15T23:56:32.718643+0000","last_peered":"2024-09-15T23:56:32.718643+0000","last_clean":"2024-09-15T23:56:32.718643+0000","last_became_active":"2024-09-15T23:56:20.717637+0000","last_became_peered":"2024-09-15T23:56:20.717637+0000","last_unstale":"2024-09-15T23:56:32.718643+0000","last_undegraded":"2024-09-15T23:56:32.718643+0000","last_fullsized":"2024-09-15T23:56:32.718643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:35.866836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715991+0000","last_change":"2024-09-15T23:56:32.203656+0000","last_active":"2024-09-15T23:56:32.715991+0000","last_peered":"2024-09-15T23:56:32.715991+0000","last_clean":"2024-09-15T23:56:32.715991+0000","last_became_active":"2024-09-15T23:56:32.203418+0000","last_became_peered":"2024-09-15T23:56:32.203418+0000","last_unstale":"2024-09-15T23:56:32.715991+0000","last_undegraded":"2024-09-15T23:56:32.715991+0000","last_fullsized":"2024-09-15T23:56:32.715991+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:03.517172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736566+0000","last_change":"2024-09-15T23:56:32.728920+0000","last_active":"2024-09-15T23:56:32.736566+0000","last_peered":"2024-09-15T23:56:32.736566+0000","last_clean":"2024-09-15T23:56:32.736566+0000","last_became_active":"2024-09-15T23:56:32.727197+0000","last_became_peered":"2024-09-15T23:56:32.727197+0000","last_unstale":"2024-09-15T23:56:32.736566+0000","last_undegraded":"2024-09-15T23:56:32.736566+0000","last_fullsized":"2024-09-15T23:56:32.736566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:54.214534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710560+0000","last_change":"2024-09-15T23:56:20.690224+0000","last_active":"2024-09-15T23:56:32.710560+0000","last_peered":"2024-09-15T23:56:32.710560+0000","last_clean":"2024-09-15T23:56:32.710560+0000","last_became_active":"2024-09-15T23:56:20.689916+0000","last_became_peered":"2024-09-15T23:56:20.689916+0000","last_unstale":"2024-09-15T23:56:32.710560+0000","last_undegraded":"2024-09-15T23:56:32.710560+0000","last_fullsized":"2024-09-15T23:56:32.710560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:28.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710862+0000","last_change":"2024-09-15T23:56:19.684703+0000","last_active":"2024-09-15T23:56:32.710862+0000","last_peered":"2024-09-15T23:56:32.710862+0000","last_clean":"2024-09-15T23:56:32.710862+0000","last_became_active":"2024-09-15T23:56:19.684441+0000","last_became_peered":"2024-09-15T23:56:19.684441+0000","last_unstale":"2024-09-15T23:56:32.710862+0000","last_undegraded":"2024-09-15T23:56:32.710862+0000","last_fullsized":"2024-09-15T23:56:32.710862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:13.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712078+0000","last_change":"2024-09-15T23:56:32.201470+0000","last_active":"2024-09-15T23:56:32.712078+0000","last_peered":"2024-09-15T23:56:32.712078+0000","last_clean":"2024-09-15T23:56:32.712078+0000","last_became_active":"2024-09-15T23:56:32.201230+0000","last_became_peered":"2024-09-15T23:56:32.201230+0000","last_unstale":"2024-09-15T23:56:32.712078+0000","last_undegraded":"2024-09-15T23:56:32.712078+0000","last_fullsized":"2024-09-15T23:56:32.712078+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:19.539777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740280+0000","last_change":"2024-09-15T23:56:32.735510+0000","last_active":"2024-09-15T23:56:32.740280+0000","last_peered":"2024-09-15T23:56:32.740280+0000","last_clean":"2024-09-15T23:56:32.740280+0000","last_became_active":"2024-09-15T23:56:32.733533+0000","last_became_peered":"2024-09-15T23:56:32.733533+0000","last_unstale":"2024-09-15T23:56:32.740280+0000","last_undegraded":"2024-09-15T23:56:32.740280+0000","last_fullsized":"2024-09-15T23:56:32.740280+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:11.261525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716824+0000","last_change":"2024-09-15T23:56:20.710702+0000","last_active":"2024-09-15T23:56:32.716824+0000","last_peered":"2024-09-15T23:56:32.716824+0000","last_clean":"2024-09-15T23:56:32.716824+0000","last_became_active":"2024-09-15T23:56:20.710181+0000","last_became_peered":"2024-09-15T23:56:20.710181+0000","last_unstale":"2024-09-15T23:56:32.716824+0000","last_undegraded":"2024-09-15T23:56:32.716824+0000","last_fullsized":"2024-09-15T23:56:32.716824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:37.272992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708339+0000","last_change":"2024-09-15T23:56:19.694797+0000","last_active":"2024-09-15T23:56:32.708339+0000","last_peered":"2024-09-15T23:56:32.708339+0000","last_clean":"2024-09-15T23:56:32.708339+0000","last_became_active":"2024-09-15T23:56:19.694510+0000","last_became_peered":"2024-09-15T23:56:19.694510+0000","last_unstale":"2024-09-15T23:56:32.708339+0000","last_undegraded":"2024-09-15T23:56:32.708339+0000","last_fullsized":"2024-09-15T23:56:32.708339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:20.863085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720791+0000","last_change":"2024-09-15T23:56:32.200673+0000","last_active":"2024-09-15T23:56:32.720791+0000","last_peered":"2024-09-15T23:56:32.720791+0000","last_clean":"2024-09-15T23:56:32.720791+0000","last_became_active":"2024-09-15T23:56:32.199901+0000","last_became_peered":"2024-09-15T23:56:32.199901+0000","last_unstale":"2024-09-15T23:56:32.720791+0000","last_undegraded":"2024-09-15T23:56:32.720791+0000","last_fullsized":"2024-09-15T23:56:32.720791+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:56.564856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740356+0000","last_change":"2024-09-15T23:56:32.736263+0000","last_active":"2024-09-15T23:56:32.740356+0000","last_peered":"2024-09-15T23:56:32.740356+0000","last_clean":"2024-09-15T23:56:32.740356+0000","last_became_active":"2024-09-15T23:56:32.736003+0000","last_became_peered":"2024-09-15T23:56:32.736003+0000","last_unstale":"2024-09-15T23:56:32.740356+0000","last_undegraded":"2024-09-15T23:56:32.740356+0000","last_fullsized":"2024-09-15T23:56:32.740356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:07.390533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716420+0000","last_change":"2024-09-15T23:56:20.714759+0000","last_active":"2024-09-15T23:56:32.716420+0000","last_peered":"2024-09-15T23:56:32.716420+0000","last_clean":"2024-09-15T23:56:32.716420+0000","last_became_active":"2024-09-15T23:56:20.714471+0000","last_became_peered":"2024-09-15T23:56:20.714471+0000","last_unstale":"2024-09-15T23:56:32.716420+0000","last_undegraded":"2024-09-15T23:56:32.716420+0000","last_fullsized":"2024-09-15T23:56:32.716420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:41.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718304+0000","last_change":"2024-09-15T23:56:19.694373+0000","last_active":"2024-09-15T23:56:32.718304+0000","last_peered":"2024-09-15T23:56:32.718304+0000","last_clean":"2024-09-15T23:56:32.718304+0000","last_became_active":"2024-09-15T23:56:19.694083+0000","last_became_peered":"2024-09-15T23:56:19.694083+0000","last_unstale":"2024-09-15T23:56:32.718304+0000","last_undegraded":"2024-09-15T23:56:32.718304+0000","last_fullsized":"2024-09-15T23:56:32.718304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:26.777939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716456+0000","last_change":"2024-09-15T23:56:32.200998+0000","last_active":"2024-09-15T23:56:32.716456+0000","last_peered":"2024-09-15T23:56:32.716456+0000","last_clean":"2024-09-15T23:56:32.716456+0000","last_became_active":"2024-09-15T23:56:32.200749+0000","last_became_peered":"2024-09-15T23:56:32.200749+0000","last_unstale":"2024-09-15T23:56:32.716456+0000","last_undegraded":"2024-09-15T23:56:32.716456+0000","last_fullsized":"2024-09-15T23:56:32.716456+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:21.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725026+0000","last_change":"2024-09-15T23:56:32.719019+0000","last_active":"2024-09-15T23:56:32.725026+0000","last_peered":"2024-09-15T23:56:32.725026+0000","last_clean":"2024-09-15T23:56:32.725026+0000","last_became_active":"2024-09-15T23:56:32.718463+0000","last_became_peered":"2024-09-15T23:56:32.718463+0000","last_unstale":"2024-09-15T23:56:32.725026+0000","last_undegraded":"2024-09-15T23:56:32.725026+0000","last_fullsized":"2024-09-15T23:56:32.725026+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:12.850257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708971+0000","last_change":"2024-09-15T23:56:20.694489+0000","last_active":"2024-09-15T23:56:32.708971+0000","last_peered":"2024-09-15T23:56:32.708971+0000","last_clean":"2024-09-15T23:56:32.708971+0000","last_became_active":"2024-09-15T23:56:20.694192+0000","last_became_peered":"2024-09-15T23:56:20.694192+0000","last_unstale":"2024-09-15T23:56:32.708971+0000","last_undegraded":"2024-09-15T23:56:32.708971+0000","last_fullsized":"2024-09-15T23:56:32.708971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:21.358922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708460+0000","last_change":"2024-09-15T23:56:19.686245+0000","last_active":"2024-09-15T23:56:32.708460+0000","last_peered":"2024-09-15T23:56:32.708460+0000","last_clean":"2024-09-15T23:56:32.708460+0000","last_became_active":"2024-09-15T23:56:19.685062+0000","last_became_peered":"2024-09-15T23:56:19.685062+0000","last_unstale":"2024-09-15T23:56:32.708460+0000","last_undegraded":"2024-09-15T23:56:32.708460+0000","last_fullsized":"2024-09-15T23:56:32.708460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:20.077992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720922+0000","last_change":"2024-09-15T23:56:32.207745+0000","last_active":"2024-09-15T23:56:32.720922+0000","last_peered":"2024-09-15T23:56:32.720922+0000","last_clean":"2024-09-15T23:56:32.720922+0000","last_became_active":"2024-09-15T23:56:32.207486+0000","last_became_peered":"2024-09-15T23:56:32.207486+0000","last_unstale":"2024-09-15T23:56:32.720922+0000","last_undegraded":"2024-09-15T23:56:32.720922+0000","last_fullsized":"2024-09-15T23:56:32.720922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:47.637850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740292+0000","last_change":"2024-09-15T23:56:32.736351+0000","last_active":"2024-09-15T23:56:32.740292+0000","last_peered":"2024-09-15T23:56:32.740292+0000","last_clean":"2024-09-15T23:56:32.740292+0000","last_became_active":"2024-09-15T23:56:32.732018+0000","last_became_peered":"2024-09-15T23:56:32.732018+0000","last_unstale":"2024-09-15T23:56:32.740292+0000","last_undegraded":"2024-09-15T23:56:32.740292+0000","last_fullsized":"2024-09-15T23:56:32.740292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:09.852421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.722450+0000","last_change":"2024-09-15T23:56:20.709982+0000","last_active":"2024-09-15T23:56:32.722450+0000","last_peered":"2024-09-15T23:56:32.722450+0000","last_clean":"2024-09-15T23:56:32.722450+0000","last_became_active":"2024-09-15T23:56:20.709656+0000","last_became_peered":"2024-09-15T23:56:20.709656+0000","last_unstale":"2024-09-15T23:56:32.722450+0000","last_undegraded":"2024-09-15T23:56:32.722450+0000","last_fullsized":"2024-09-15T23:56:32.722450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:36.642813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710682+0000","last_change":"2024-09-15T23:56:19.699142+0000","last_active":"2024-09-15T23:56:32.710682+0000","last_peered":"2024-09-15T23:56:32.710682+0000","last_clean":"2024-09-15T23:56:32.710682+0000","last_became_active":"2024-09-15T23:56:19.698665+0000","last_became_peered":"2024-09-15T23:56:19.698665+0000","last_unstale":"2024-09-15T23:56:32.710682+0000","last_undegraded":"2024-09-15T23:56:32.710682+0000","last_fullsized":"2024-09-15T23:56:32.710682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.527319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716287+0000","last_change":"2024-09-15T23:56:32.204570+0000","last_active":"2024-09-15T23:56:32.716287+0000","last_peered":"2024-09-15T23:56:32.716287+0000","last_clean":"2024-09-15T23:56:32.716287+0000","last_became_active":"2024-09-15T23:56:32.204356+0000","last_became_peered":"2024-09-15T23:56:32.204356+0000","last_unstale":"2024-09-15T23:56:32.716287+0000","last_undegraded":"2024-09-15T23:56:32.716287+0000","last_fullsized":"2024-09-15T23:56:32.716287+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:49.754469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.734628+0000","last_change":"2024-09-15T23:56:32.729564+0000","last_active":"2024-09-15T23:56:32.734628+0000","last_peered":"2024-09-15T23:56:32.734628+0000","last_clean":"2024-09-15T23:56:32.734628+0000","last_became_active":"2024-09-15T23:56:32.729328+0000","last_became_peered":"2024-09-15T23:56:32.729328+0000","last_unstale":"2024-09-15T23:56:32.734628+0000","last_undegraded":"2024-09-15T23:56:32.734628+0000","last_fullsized":"2024-09-15T23:56:32.734628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.610955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712189+0000","last_change":"2024-09-15T23:56:20.708841+0000","last_active":"2024-09-15T23:56:32.712189+0000","last_peered":"2024-09-15T23:56:32.712189+0000","last_clean":"2024-09-15T23:56:32.712189+0000","last_became_active":"2024-09-15T23:56:20.708403+0000","last_became_peered":"2024-09-15T23:56:20.708403+0000","last_unstale":"2024-09-15T23:56:32.712189+0000","last_undegraded":"2024-09-15T23:56:32.712189+0000","last_fullsized":"2024-09-15T23:56:32.712189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:41.947981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716164+0000","last_change":"2024-09-15T23:56:19.684807+0000","last_active":"2024-09-15T23:56:32.716164+0000","last_peered":"2024-09-15T23:56:32.716164+0000","last_clean":"2024-09-15T23:56:32.716164+0000","last_became_active":"2024-09-15T23:56:19.684546+0000","last_became_peered":"2024-09-15T23:56:19.684546+0000","last_unstale":"2024-09-15T23:56:32.716164+0000","last_undegraded":"2024-09-15T23:56:32.716164+0000","last_fullsized":"2024-09-15T23:56:32.716164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709550+0000","last_change":"2024-09-15T23:56:32.202007+0000","last_active":"2024-09-15T23:56:32.709550+0000","last_peered":"2024-09-15T23:56:32.709550+0000","last_clean":"2024-09-15T23:56:32.709550+0000","last_became_active":"2024-09-15T23:56:32.201674+0000","last_became_peered":"2024-09-15T23:56:32.201674+0000","last_unstale":"2024-09-15T23:56:32.709550+0000","last_undegraded":"2024-09-15T23:56:32.709550+0000","last_fullsized":"2024-09-15T23:56:32.709550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:15.406693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737720+0000","last_change":"2024-09-15T23:56:32.733754+0000","last_active":"2024-09-15T23:56:32.737720+0000","last_peered":"2024-09-15T23:56:32.737720+0000","last_clean":"2024-09-15T23:56:32.737720+0000","last_became_active":"2024-09-15T23:56:32.732892+0000","last_became_peered":"2024-09-15T23:56:32.732892+0000","last_unstale":"2024-09-15T23:56:32.737720+0000","last_undegraded":"2024-09-15T23:56:32.737720+0000","last_fullsized":"2024-09-15T23:56:32.737720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:29.719862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719301+0000","last_change":"2024-09-15T23:56:20.712020+0000","last_active":"2024-09-15T23:56:32.719301+0000","last_peered":"2024-09-15T23:56:32.719301+0000","last_clean":"2024-09-15T23:56:32.719301+0000","last_became_active":"2024-09-15T23:56:20.709304+0000","last_became_peered":"2024-09-15T23:56:20.709304+0000","last_unstale":"2024-09-15T23:56:32.719301+0000","last_undegraded":"2024-09-15T23:56:32.719301+0000","last_fullsized":"2024-09-15T23:56:32.719301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:31.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715415+0000","last_change":"2024-09-15T23:56:19.682125+0000","last_active":"2024-09-15T23:56:32.715415+0000","last_peered":"2024-09-15T23:56:32.715415+0000","last_clean":"2024-09-15T23:56:32.715415+0000","last_became_active":"2024-09-15T23:56:19.681850+0000","last_became_peered":"2024-09-15T23:56:19.681850+0000","last_unstale":"2024-09-15T23:56:32.715415+0000","last_undegraded":"2024-09-15T23:56:32.715415+0000","last_fullsized":"2024-09-15T23:56:32.715415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:32.863735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712004+0000","last_change":"2024-09-15T23:56:32.198777+0000","last_active":"2024-09-15T23:56:32.712004+0000","last_peered":"2024-09-15T23:56:32.712004+0000","last_clean":"2024-09-15T23:56:32.712004+0000","last_became_active":"2024-09-15T23:56:32.198526+0000","last_became_peered":"2024-09-15T23:56:32.198526+0000","last_unstale":"2024-09-15T23:56:32.712004+0000","last_undegraded":"2024-09-15T23:56:32.712004+0000","last_fullsized":"2024-09-15T23:56:32.712004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:21.203587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737930+0000","last_change":"2024-09-15T23:56:32.734522+0000","last_active":"2024-09-15T23:56:32.737930+0000","last_peered":"2024-09-15T23:56:32.737930+0000","last_clean":"2024-09-15T23:56:32.737930+0000","last_became_active":"2024-09-15T23:56:32.733483+0000","last_became_peered":"2024-09-15T23:56:32.733483+0000","last_unstale":"2024-09-15T23:56:32.737930+0000","last_undegraded":"2024-09-15T23:56:32.737930+0000","last_fullsized":"2024-09-15T23:56:32.737930+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:58.909489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715200+0000","last_change":"2024-09-15T23:56:20.708412+0000","last_active":"2024-09-15T23:56:32.715200+0000","last_peered":"2024-09-15T23:56:32.715200+0000","last_clean":"2024-09-15T23:56:32.715200+0000","last_became_active":"2024-09-15T23:56:20.708170+0000","last_became_peered":"2024-09-15T23:56:20.708170+0000","last_unstale":"2024-09-15T23:56:32.715200+0000","last_undegraded":"2024-09-15T23:56:32.715200+0000","last_fullsized":"2024-09-15T23:56:32.715200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:53.313517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708339+0000","last_change":"2024-09-15T23:56:19.697356+0000","last_active":"2024-09-15T23:56:32.708339+0000","last_peered":"2024-09-15T23:56:32.708339+0000","last_clean":"2024-09-15T23:56:32.708339+0000","last_became_active":"2024-09-15T23:56:19.697077+0000","last_became_peered":"2024-09-15T23:56:19.697077+0000","last_unstale":"2024-09-15T23:56:32.708339+0000","last_undegraded":"2024-09-15T23:56:32.708339+0000","last_fullsized":"2024-09-15T23:56:32.708339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:11.467305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710622+0000","last_change":"2024-09-15T23:56:32.200392+0000","last_active":"2024-09-15T23:56:32.710622+0000","last_peered":"2024-09-15T23:56:32.710622+0000","last_clean":"2024-09-15T23:56:32.710622+0000","last_became_active":"2024-09-15T23:56:32.200036+0000","last_became_peered":"2024-09-15T23:56:32.200036+0000","last_unstale":"2024-09-15T23:56:32.710622+0000","last_undegraded":"2024-09-15T23:56:32.710622+0000","last_fullsized":"2024-09-15T23:56:32.710622+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:09.399425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737913+0000","last_change":"2024-09-15T23:56:32.735104+0000","last_active":"2024-09-15T23:56:32.737913+0000","last_peered":"2024-09-15T23:56:32.737913+0000","last_clean":"2024-09-15T23:56:32.737913+0000","last_became_active":"2024-09-15T23:56:32.733798+0000","last_became_peered":"2024-09-15T23:56:32.733798+0000","last_unstale":"2024-09-15T23:56:32.737913+0000","last_undegraded":"2024-09-15T23:56:32.737913+0000","last_fullsized":"2024-09-15T23:56:32.737913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:13.087452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708559+0000","last_change":"2024-09-15T23:56:20.690625+0000","last_active":"2024-09-15T23:56:32.708559+0000","last_peered":"2024-09-15T23:56:32.708559+0000","last_clean":"2024-09-15T23:56:32.708559+0000","last_became_active":"2024-09-15T23:56:20.690008+0000","last_became_peered":"2024-09-15T23:56:20.690008+0000","last_unstale":"2024-09-15T23:56:32.708559+0000","last_undegraded":"2024-09-15T23:56:32.708559+0000","last_fullsized":"2024-09-15T23:56:32.708559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:13.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716411+0000","last_change":"2024-09-15T23:56:19.699847+0000","last_active":"2024-09-15T23:56:32.716411+0000","last_peered":"2024-09-15T23:56:32.716411+0000","last_clean":"2024-09-15T23:56:32.716411+0000","last_became_active":"2024-09-15T23:56:19.698457+0000","last_became_peered":"2024-09-15T23:56:19.698457+0000","last_unstale":"2024-09-15T23:56:32.716411+0000","last_undegraded":"2024-09-15T23:56:32.716411+0000","last_fullsized":"2024-09-15T23:56:32.716411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:46.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709289+0000","last_change":"2024-09-15T23:56:32.200431+0000","last_active":"2024-09-15T23:56:32.709289+0000","last_peered":"2024-09-15T23:56:32.709289+0000","last_clean":"2024-09-15T23:56:32.709289+0000","last_became_active":"2024-09-15T23:56:32.200136+0000","last_became_peered":"2024-09-15T23:56:32.200136+0000","last_unstale":"2024-09-15T23:56:32.709289+0000","last_undegraded":"2024-09-15T23:56:32.709289+0000","last_fullsized":"2024-09-15T23:56:32.709289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:48.655628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736200+0000","last_change":"2024-09-15T23:56:32.732910+0000","last_active":"2024-09-15T23:56:32.736200+0000","last_peered":"2024-09-15T23:56:32.736200+0000","last_clean":"2024-09-15T23:56:32.736200+0000","last_became_active":"2024-09-15T23:56:32.732472+0000","last_became_peered":"2024-09-15T23:56:32.732472+0000","last_unstale":"2024-09-15T23:56:32.736200+0000","last_undegraded":"2024-09-15T23:56:32.736200+0000","last_fullsized":"2024-09-15T23:56:32.736200+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:13.171460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709096+0000","last_change":"2024-09-15T23:56:20.710375+0000","last_active":"2024-09-15T23:56:32.709096+0000","last_peered":"2024-09-15T23:56:32.709096+0000","last_clean":"2024-09-15T23:56:32.709096+0000","last_became_active":"2024-09-15T23:56:20.707708+0000","last_became_peered":"2024-09-15T23:56:20.707708+0000","last_unstale":"2024-09-15T23:56:32.709096+0000","last_undegraded":"2024-09-15T23:56:32.709096+0000","last_fullsized":"2024-09-15T23:56:32.709096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:46.173174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709373+0000","last_change":"2024-09-15T23:56:19.699207+0000","last_active":"2024-09-15T23:56:32.709373+0000","last_peered":"2024-09-15T23:56:32.709373+0000","last_clean":"2024-09-15T23:56:32.709373+0000","last_became_active":"2024-09-15T23:56:19.698960+0000","last_became_peered":"2024-09-15T23:56:19.698960+0000","last_unstale":"2024-09-15T23:56:32.709373+0000","last_undegraded":"2024-09-15T23:56:32.709373+0000","last_fullsized":"2024-09-15T23:56:32.709373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:18.018681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":272,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719144+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:56:32.719144+0000","last_peered":"2024-09-15T23:56:32.719144+0000","last_clean":"2024-09-15T23:56:32.719144+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:56:32.719144+0000","last_undegraded":"2024-09-15T23:56:32.719144+0000","last_fullsized":"2024-09-15T23:56:32.719144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708809+0000","last_change":"2024-09-15T23:56:32.198830+0000","last_active":"2024-09-15T23:56:32.708809+0000","last_peered":"2024-09-15T23:56:32.708809+0000","last_clean":"2024-09-15T23:56:32.708809+0000","last_became_active":"2024-09-15T23:56:32.198582+0000","last_became_peered":"2024-09-15T23:56:32.198582+0000","last_unstale":"2024-09-15T23:56:32.708809+0000","last_undegraded":"2024-09-15T23:56:32.708809+0000","last_fullsized":"2024-09-15T23:56:32.708809+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.152210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737895+0000","last_change":"2024-09-15T23:56:32.734347+0000","last_active":"2024-09-15T23:56:32.737895+0000","last_peered":"2024-09-15T23:56:32.737895+0000","last_clean":"2024-09-15T23:56:32.737895+0000","last_became_active":"2024-09-15T23:56:32.733146+0000","last_became_peered":"2024-09-15T23:56:32.733146+0000","last_unstale":"2024-09-15T23:56:32.737895+0000","last_undegraded":"2024-09-15T23:56:32.737895+0000","last_fullsized":"2024-09-15T23:56:32.737895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:01.465532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715704+0000","last_change":"2024-09-15T23:56:20.708879+0000","last_active":"2024-09-15T23:56:32.715704+0000","last_peered":"2024-09-15T23:56:32.715704+0000","last_clean":"2024-09-15T23:56:32.715704+0000","last_became_active":"2024-09-15T23:56:20.707893+0000","last_became_peered":"2024-09-15T23:56:20.707893+0000","last_unstale":"2024-09-15T23:56:32.715704+0000","last_undegraded":"2024-09-15T23:56:32.715704+0000","last_fullsized":"2024-09-15T23:56:32.715704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:03.270640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708472+0000","last_change":"2024-09-15T23:56:19.696843+0000","last_active":"2024-09-15T23:56:32.708472+0000","last_peered":"2024-09-15T23:56:32.708472+0000","last_clean":"2024-09-15T23:56:32.708472+0000","last_became_active":"2024-09-15T23:56:19.695192+0000","last_became_peered":"2024-09-15T23:56:19.695192+0000","last_unstale":"2024-09-15T23:56:32.708472+0000","last_undegraded":"2024-09-15T23:56:32.708472+0000","last_fullsized":"2024-09-15T23:56:32.708472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:07.169275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719026+0000","last_change":"2024-09-15T23:56:32.199555+0000","last_active":"2024-09-15T23:56:32.719026+0000","last_peered":"2024-09-15T23:56:32.719026+0000","last_clean":"2024-09-15T23:56:32.719026+0000","last_became_active":"2024-09-15T23:56:32.199290+0000","last_became_peered":"2024-09-15T23:56:32.199290+0000","last_unstale":"2024-09-15T23:56:32.719026+0000","last_undegraded":"2024-09-15T23:56:32.719026+0000","last_fullsized":"2024-09-15T23:56:32.719026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:32.741851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740376+0000","last_change":"2024-09-15T23:56:32.736298+0000","last_active":"2024-09-15T23:56:32.740376+0000","last_peered":"2024-09-15T23:56:32.740376+0000","last_clean":"2024-09-15T23:56:32.740376+0000","last_became_active":"2024-09-15T23:56:32.735749+0000","last_became_peered":"2024-09-15T23:56:32.735749+0000","last_unstale":"2024-09-15T23:56:32.740376+0000","last_undegraded":"2024-09-15T23:56:32.740376+0000","last_fullsized":"2024-09-15T23:56:32.740376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:12.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721056+0000","last_change":"2024-09-15T23:56:20.712560+0000","last_active":"2024-09-15T23:56:32.721056+0000","last_peered":"2024-09-15T23:56:32.721056+0000","last_clean":"2024-09-15T23:56:32.721056+0000","last_became_active":"2024-09-15T23:56:20.712104+0000","last_became_peered":"2024-09-15T23:56:20.712104+0000","last_unstale":"2024-09-15T23:56:32.721056+0000","last_undegraded":"2024-09-15T23:56:32.721056+0000","last_fullsized":"2024-09-15T23:56:32.721056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:08.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718271+0000","last_change":"2024-09-15T23:56:19.689550+0000","last_active":"2024-09-15T23:56:32.718271+0000","last_peered":"2024-09-15T23:56:32.718271+0000","last_clean":"2024-09-15T23:56:32.718271+0000","last_became_active":"2024-09-15T23:56:19.689285+0000","last_became_peered":"2024-09-15T23:56:19.689285+0000","last_unstale":"2024-09-15T23:56:32.718271+0000","last_undegraded":"2024-09-15T23:56:32.718271+0000","last_fullsized":"2024-09-15T23:56:32.718271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:16.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.723854+0000","last_change":"2024-09-15T23:56:32.209239+0000","last_active":"2024-09-15T23:56:32.723854+0000","last_peered":"2024-09-15T23:56:32.723854+0000","last_clean":"2024-09-15T23:56:32.723854+0000","last_became_active":"2024-09-15T23:56:32.208942+0000","last_became_peered":"2024-09-15T23:56:32.208942+0000","last_unstale":"2024-09-15T23:56:32.723854+0000","last_undegraded":"2024-09-15T23:56:32.723854+0000","last_fullsized":"2024-09-15T23:56:32.723854+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:53.544616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736649+0000","last_change":"2024-09-15T23:56:32.733399+0000","last_active":"2024-09-15T23:56:32.736649+0000","last_peered":"2024-09-15T23:56:32.736649+0000","last_clean":"2024-09-15T23:56:32.736649+0000","last_became_active":"2024-09-15T23:56:32.731898+0000","last_became_peered":"2024-09-15T23:56:32.731898+0000","last_unstale":"2024-09-15T23:56:32.736649+0000","last_undegraded":"2024-09-15T23:56:32.736649+0000","last_fullsized":"2024-09-15T23:56:32.736649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:58.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716482+0000","last_change":"2024-09-15T23:56:20.710525+0000","last_active":"2024-09-15T23:56:32.716482+0000","last_peered":"2024-09-15T23:56:32.716482+0000","last_clean":"2024-09-15T23:56:32.716482+0000","last_became_active":"2024-09-15T23:56:20.709915+0000","last_became_peered":"2024-09-15T23:56:20.709915+0000","last_unstale":"2024-09-15T23:56:32.716482+0000","last_undegraded":"2024-09-15T23:56:32.716482+0000","last_fullsized":"2024-09-15T23:56:32.716482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:13.590246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716495+0000","last_change":"2024-09-15T23:56:19.691077+0000","last_active":"2024-09-15T23:56:32.716495+0000","last_peered":"2024-09-15T23:56:32.716495+0000","last_clean":"2024-09-15T23:56:32.716495+0000","last_became_active":"2024-09-15T23:56:19.687845+0000","last_became_peered":"2024-09-15T23:56:19.687845+0000","last_unstale":"2024-09-15T23:56:32.716495+0000","last_undegraded":"2024-09-15T23:56:32.716495+0000","last_fullsized":"2024-09-15T23:56:32.716495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:04.973037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715604+0000","last_change":"2024-09-15T23:56:32.207971+0000","last_active":"2024-09-15T23:56:32.715604+0000","last_peered":"2024-09-15T23:56:32.715604+0000","last_clean":"2024-09-15T23:56:32.715604+0000","last_became_active":"2024-09-15T23:56:32.207686+0000","last_became_peered":"2024-09-15T23:56:32.207686+0000","last_unstale":"2024-09-15T23:56:32.715604+0000","last_undegraded":"2024-09-15T23:56:32.715604+0000","last_fullsized":"2024-09-15T23:56:32.715604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:13.814315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727660+0000","last_change":"2024-09-15T23:56:32.719964+0000","last_active":"2024-09-15T23:56:32.727660+0000","last_peered":"2024-09-15T23:56:32.727660+0000","last_clean":"2024-09-15T23:56:32.727660+0000","last_became_active":"2024-09-15T23:56:32.719699+0000","last_became_peered":"2024-09-15T23:56:32.719699+0000","last_unstale":"2024-09-15T23:56:32.727660+0000","last_undegraded":"2024-09-15T23:56:32.727660+0000","last_fullsized":"2024-09-15T23:56:32.727660+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:22.475445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709520+0000","last_change":"2024-09-15T23:56:20.694615+0000","last_active":"2024-09-15T23:56:32.709520+0000","last_peered":"2024-09-15T23:56:32.709520+0000","last_clean":"2024-09-15T23:56:32.709520+0000","last_became_active":"2024-09-15T23:56:20.692669+0000","last_became_peered":"2024-09-15T23:56:20.692669+0000","last_unstale":"2024-09-15T23:56:32.709520+0000","last_undegraded":"2024-09-15T23:56:32.709520+0000","last_fullsized":"2024-09-15T23:56:32.709520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.075768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718600+0000","last_change":"2024-09-15T23:56:19.692305+0000","last_active":"2024-09-15T23:56:32.718600+0000","last_peered":"2024-09-15T23:56:32.718600+0000","last_clean":"2024-09-15T23:56:32.718600+0000","last_became_active":"2024-09-15T23:56:19.692025+0000","last_became_peered":"2024-09-15T23:56:19.692025+0000","last_unstale":"2024-09-15T23:56:32.718600+0000","last_undegraded":"2024-09-15T23:56:32.718600+0000","last_fullsized":"2024-09-15T23:56:32.718600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:32.822239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721936+0000","last_change":"2024-09-15T23:56:32.206741+0000","last_active":"2024-09-15T23:56:32.721936+0000","last_peered":"2024-09-15T23:56:32.721936+0000","last_clean":"2024-09-15T23:56:32.721936+0000","last_became_active":"2024-09-15T23:56:32.206500+0000","last_became_peered":"2024-09-15T23:56:32.206500+0000","last_unstale":"2024-09-15T23:56:32.721936+0000","last_undegraded":"2024-09-15T23:56:32.721936+0000","last_fullsized":"2024-09-15T23:56:32.721936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:15.807132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730784+0000","last_change":"2024-09-15T23:56:32.725774+0000","last_active":"2024-09-15T23:56:32.730784+0000","last_peered":"2024-09-15T23:56:32.730784+0000","last_clean":"2024-09-15T23:56:32.730784+0000","last_became_active":"2024-09-15T23:56:32.725514+0000","last_became_peered":"2024-09-15T23:56:32.725514+0000","last_unstale":"2024-09-15T23:56:32.730784+0000","last_undegraded":"2024-09-15T23:56:32.730784+0000","last_fullsized":"2024-09-15T23:56:32.730784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:58.932334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718912+0000","last_change":"2024-09-15T23:56:20.710955+0000","last_active":"2024-09-15T23:56:32.718912+0000","last_peered":"2024-09-15T23:56:32.718912+0000","last_clean":"2024-09-15T23:56:32.718912+0000","last_became_active":"2024-09-15T23:56:20.710010+0000","last_became_peered":"2024-09-15T23:56:20.710010+0000","last_unstale":"2024-09-15T23:56:32.718912+0000","last_undegraded":"2024-09-15T23:56:32.718912+0000","last_fullsized":"2024-09-15T23:56:32.718912+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:24.036402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716651+0000","last_change":"2024-09-15T23:56:19.698114+0000","last_active":"2024-09-15T23:56:32.716651+0000","last_peered":"2024-09-15T23:56:32.716651+0000","last_clean":"2024-09-15T23:56:32.716651+0000","last_became_active":"2024-09-15T23:56:19.697798+0000","last_became_peered":"2024-09-15T23:56:19.697798+0000","last_unstale":"2024-09-15T23:56:32.716651+0000","last_undegraded":"2024-09-15T23:56:32.716651+0000","last_fullsized":"2024-09-15T23:56:32.716651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:08.484696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716091+0000","last_change":"2024-09-15T23:56:32.206648+0000","last_active":"2024-09-15T23:56:32.716091+0000","last_peered":"2024-09-15T23:56:32.716091+0000","last_clean":"2024-09-15T23:56:32.716091+0000","last_became_active":"2024-09-15T23:56:32.206312+0000","last_became_peered":"2024-09-15T23:56:32.206312+0000","last_unstale":"2024-09-15T23:56:32.716091+0000","last_undegraded":"2024-09-15T23:56:32.716091+0000","last_fullsized":"2024-09-15T23:56:32.716091+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:10.072338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736499+0000","last_change":"2024-09-15T23:56:32.732333+0000","last_active":"2024-09-15T23:56:32.736499+0000","last_peered":"2024-09-15T23:56:32.736499+0000","last_clean":"2024-09-15T23:56:32.736499+0000","last_became_active":"2024-09-15T23:56:32.731986+0000","last_became_peered":"2024-09-15T23:56:32.731986+0000","last_unstale":"2024-09-15T23:56:32.736499+0000","last_undegraded":"2024-09-15T23:56:32.736499+0000","last_fullsized":"2024-09-15T23:56:32.736499+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:17.543131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719251+0000","last_change":"2024-09-15T23:56:32.204658+0000","last_active":"2024-09-15T23:56:32.719251+0000","last_peered":"2024-09-15T23:56:32.719251+0000","last_clean":"2024-09-15T23:56:32.719251+0000","last_became_active":"2024-09-15T23:56:32.204403+0000","last_became_peered":"2024-09-15T23:56:32.204403+0000","last_unstale":"2024-09-15T23:56:32.719251+0000","last_undegraded":"2024-09-15T23:56:32.719251+0000","last_fullsized":"2024-09-15T23:56:32.719251+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:21.777398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715231+0000","last_change":"2024-09-15T23:56:20.716218+0000","last_active":"2024-09-15T23:56:32.715231+0000","last_peered":"2024-09-15T23:56:32.715231+0000","last_clean":"2024-09-15T23:56:32.715231+0000","last_became_active":"2024-09-15T23:56:20.715898+0000","last_became_peered":"2024-09-15T23:56:20.715898+0000","last_unstale":"2024-09-15T23:56:32.715231+0000","last_undegraded":"2024-09-15T23:56:32.715231+0000","last_fullsized":"2024-09-15T23:56:32.715231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:11.938755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708348+0000","last_change":"2024-09-15T23:56:19.700486+0000","last_active":"2024-09-15T23:56:32.708348+0000","last_peered":"2024-09-15T23:56:32.708348+0000","last_clean":"2024-09-15T23:56:32.708348+0000","last_became_active":"2024-09-15T23:56:19.697214+0000","last_became_peered":"2024-09-15T23:56:19.697214+0000","last_unstale":"2024-09-15T23:56:32.708348+0000","last_undegraded":"2024-09-15T23:56:32.708348+0000","last_fullsized":"2024-09-15T23:56:32.708348+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:29.487850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727808+0000","last_change":"2024-09-15T23:56:32.720778+0000","last_active":"2024-09-15T23:56:32.727808+0000","last_peered":"2024-09-15T23:56:32.727808+0000","last_clean":"2024-09-15T23:56:32.727808+0000","last_became_active":"2024-09-15T23:56:32.720521+0000","last_became_peered":"2024-09-15T23:56:32.720521+0000","last_unstale":"2024-09-15T23:56:32.727808+0000","last_undegraded":"2024-09-15T23:56:32.727808+0000","last_fullsized":"2024-09-15T23:56:32.727808+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:03.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712163+0000","last_change":"2024-09-15T23:56:32.201583+0000","last_active":"2024-09-15T23:56:32.712163+0000","last_peered":"2024-09-15T23:56:32.712163+0000","last_clean":"2024-09-15T23:56:32.712163+0000","last_became_active":"2024-09-15T23:56:32.201370+0000","last_became_peered":"2024-09-15T23:56:32.201370+0000","last_unstale":"2024-09-15T23:56:32.712163+0000","last_undegraded":"2024-09-15T23:56:32.712163+0000","last_fullsized":"2024-09-15T23:56:32.712163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:39.445210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719420+0000","last_change":"2024-09-15T23:56:20.710055+0000","last_active":"2024-09-15T23:56:32.719420+0000","last_peered":"2024-09-15T23:56:32.719420+0000","last_clean":"2024-09-15T23:56:32.719420+0000","last_became_active":"2024-09-15T23:56:20.709780+0000","last_became_peered":"2024-09-15T23:56:20.709780+0000","last_unstale":"2024-09-15T23:56:32.719420+0000","last_undegraded":"2024-09-15T23:56:32.719420+0000","last_fullsized":"2024-09-15T23:56:32.719420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.341983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715081+0000","last_change":"2024-09-15T23:56:19.699359+0000","last_active":"2024-09-15T23:56:32.715081+0000","last_peered":"2024-09-15T23:56:32.715081+0000","last_clean":"2024-09-15T23:56:32.715081+0000","last_became_active":"2024-09-15T23:56:19.698476+0000","last_became_peered":"2024-09-15T23:56:19.698476+0000","last_unstale":"2024-09-15T23:56:32.715081+0000","last_undegraded":"2024-09-15T23:56:32.715081+0000","last_fullsized":"2024-09-15T23:56:32.715081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:05.758453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728136+0000","last_change":"2024-09-15T23:56:32.722140+0000","last_active":"2024-09-15T23:56:32.728136+0000","last_peered":"2024-09-15T23:56:32.728136+0000","last_clean":"2024-09-15T23:56:32.728136+0000","last_became_active":"2024-09-15T23:56:32.721224+0000","last_became_peered":"2024-09-15T23:56:32.721224+0000","last_unstale":"2024-09-15T23:56:32.728136+0000","last_undegraded":"2024-09-15T23:56:32.728136+0000","last_fullsized":"2024-09-15T23:56:32.728136+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:44:19.190101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712279+0000","last_change":"2024-09-15T23:56:20.708637+0000","last_active":"2024-09-15T23:56:32.712279+0000","last_peered":"2024-09-15T23:56:32.712279+0000","last_clean":"2024-09-15T23:56:32.712279+0000","last_became_active":"2024-09-15T23:56:20.708101+0000","last_became_peered":"2024-09-15T23:56:20.708101+0000","last_unstale":"2024-09-15T23:56:32.712279+0000","last_undegraded":"2024-09-15T23:56:32.712279+0000","last_fullsized":"2024-09-15T23:56:32.712279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:05.040048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708738+0000","last_change":"2024-09-15T23:56:19.700204+0000","last_active":"2024-09-15T23:56:32.708738+0000","last_peered":"2024-09-15T23:56:32.708738+0000","last_clean":"2024-09-15T23:56:32.708738+0000","last_became_active":"2024-09-15T23:56:19.699920+0000","last_became_peered":"2024-09-15T23:56:19.699920+0000","last_unstale":"2024-09-15T23:56:32.708738+0000","last_undegraded":"2024-09-15T23:56:32.708738+0000","last_fullsized":"2024-09-15T23:56:32.708738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:30.371927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725007+0000","last_change":"2024-09-15T23:56:32.207347+0000","last_active":"2024-09-15T23:56:32.725007+0000","last_peered":"2024-09-15T23:56:32.725007+0000","last_clean":"2024-09-15T23:56:32.725007+0000","last_became_active":"2024-09-15T23:56:32.207105+0000","last_became_peered":"2024-09-15T23:56:32.207105+0000","last_unstale":"2024-09-15T23:56:32.725007+0000","last_undegraded":"2024-09-15T23:56:32.725007+0000","last_fullsized":"2024-09-15T23:56:32.725007+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:41.837755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725134+0000","last_change":"2024-09-15T23:56:32.719233+0000","last_active":"2024-09-15T23:56:32.725134+0000","last_peered":"2024-09-15T23:56:32.725134+0000","last_clean":"2024-09-15T23:56:32.725134+0000","last_became_active":"2024-09-15T23:56:32.718198+0000","last_became_peered":"2024-09-15T23:56:32.718198+0000","last_unstale":"2024-09-15T23:56:32.725134+0000","last_undegraded":"2024-09-15T23:56:32.725134+0000","last_fullsized":"2024-09-15T23:56:32.725134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:17.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716503+0000","last_change":"2024-09-15T23:56:20.696227+0000","last_active":"2024-09-15T23:56:32.716503+0000","last_peered":"2024-09-15T23:56:32.716503+0000","last_clean":"2024-09-15T23:56:32.716503+0000","last_became_active":"2024-09-15T23:56:20.695959+0000","last_became_peered":"2024-09-15T23:56:20.695959+0000","last_unstale":"2024-09-15T23:56:32.716503+0000","last_undegraded":"2024-09-15T23:56:32.716503+0000","last_fullsized":"2024-09-15T23:56:32.716503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:14.825952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716878+0000","last_change":"2024-09-15T23:56:19.696212+0000","last_active":"2024-09-15T23:56:32.716878+0000","last_peered":"2024-09-15T23:56:32.716878+0000","last_clean":"2024-09-15T23:56:32.716878+0000","last_became_active":"2024-09-15T23:56:19.695986+0000","last_became_peered":"2024-09-15T23:56:19.695986+0000","last_unstale":"2024-09-15T23:56:32.716878+0000","last_undegraded":"2024-09-15T23:56:32.716878+0000","last_fullsized":"2024-09-15T23:56:32.716878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.146610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712920+0000","last_change":"2024-09-15T23:56:32.203254+0000","last_active":"2024-09-15T23:56:32.712920+0000","last_peered":"2024-09-15T23:56:32.712920+0000","last_clean":"2024-09-15T23:56:32.712920+0000","last_became_active":"2024-09-15T23:56:32.203003+0000","last_became_peered":"2024-09-15T23:56:32.203003+0000","last_unstale":"2024-09-15T23:56:32.712920+0000","last_undegraded":"2024-09-15T23:56:32.712920+0000","last_fullsized":"2024-09-15T23:56:32.712920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:43.633540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737225+0000","last_change":"2024-09-15T23:56:32.735249+0000","last_active":"2024-09-15T23:56:32.737225+0000","last_peered":"2024-09-15T23:56:32.737225+0000","last_clean":"2024-09-15T23:56:32.737225+0000","last_became_active":"2024-09-15T23:56:32.735014+0000","last_became_peered":"2024-09-15T23:56:32.735014+0000","last_unstale":"2024-09-15T23:56:32.737225+0000","last_undegraded":"2024-09-15T23:56:32.737225+0000","last_fullsized":"2024-09-15T23:56:32.737225+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:48.865433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716338+0000","last_change":"2024-09-15T23:56:20.709094+0000","last_active":"2024-09-15T23:56:32.716338+0000","last_peered":"2024-09-15T23:56:32.716338+0000","last_clean":"2024-09-15T23:56:32.716338+0000","last_became_active":"2024-09-15T23:56:20.708654+0000","last_became_peered":"2024-09-15T23:56:20.708654+0000","last_unstale":"2024-09-15T23:56:32.716338+0000","last_undegraded":"2024-09-15T23:56:32.716338+0000","last_fullsized":"2024-09-15T23:56:32.716338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:39.903610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"41'12","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716277+0000","last_change":"2024-09-15T23:56:19.703061+0000","last_active":"2024-09-15T23:56:32.716277+0000","last_peered":"2024-09-15T23:56:32.716277+0000","last_clean":"2024-09-15T23:56:32.716277+0000","last_became_active":"2024-09-15T23:56:19.702750+0000","last_became_peered":"2024-09-15T23:56:19.702750+0000","last_unstale":"2024-09-15T23:56:32.716277+0000","last_undegraded":"2024-09-15T23:56:32.716277+0000","last_fullsized":"2024-09-15T23:56:32.716277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:23.575094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710511+0000","last_change":"2024-09-15T23:56:32.203939+0000","last_active":"2024-09-15T23:56:32.710511+0000","last_peered":"2024-09-15T23:56:32.710511+0000","last_clean":"2024-09-15T23:56:32.710511+0000","last_became_active":"2024-09-15T23:56:32.203686+0000","last_became_peered":"2024-09-15T23:56:32.203686+0000","last_unstale":"2024-09-15T23:56:32.710511+0000","last_undegraded":"2024-09-15T23:56:32.710511+0000","last_fullsized":"2024-09-15T23:56:32.710511+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:48.851672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736631+0000","last_change":"2024-09-15T23:56:32.733279+0000","last_active":"2024-09-15T23:56:32.736631+0000","last_peered":"2024-09-15T23:56:32.736631+0000","last_clean":"2024-09-15T23:56:32.736631+0000","last_became_active":"2024-09-15T23:56:32.733035+0000","last_became_peered":"2024-09-15T23:56:32.733035+0000","last_unstale":"2024-09-15T23:56:32.736631+0000","last_undegraded":"2024-09-15T23:56:32.736631+0000","last_fullsized":"2024-09-15T23:56:32.736631+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:54.451064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718096+0000","last_change":"2024-09-15T23:56:20.708385+0000","last_active":"2024-09-15T23:56:32.718096+0000","last_peered":"2024-09-15T23:56:32.718096+0000","last_clean":"2024-09-15T23:56:32.718096+0000","last_became_active":"2024-09-15T23:56:20.708115+0000","last_became_peered":"2024-09-15T23:56:20.708115+0000","last_unstale":"2024-09-15T23:56:32.718096+0000","last_undegraded":"2024-09-15T23:56:32.718096+0000","last_fullsized":"2024-09-15T23:56:32.718096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:21.865995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716588+0000","last_change":"2024-09-15T23:56:19.701230+0000","last_active":"2024-09-15T23:56:32.716588+0000","last_peered":"2024-09-15T23:56:32.716588+0000","last_clean":"2024-09-15T23:56:32.716588+0000","last_became_active":"2024-09-15T23:56:19.700977+0000","last_became_peered":"2024-09-15T23:56:19.700977+0000","last_unstale":"2024-09-15T23:56:32.716588+0000","last_undegraded":"2024-09-15T23:56:32.716588+0000","last_fullsized":"2024-09-15T23:56:32.716588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:25.148499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721793+0000","last_change":"2024-09-15T23:56:32.206496+0000","last_active":"2024-09-15T23:56:32.721793+0000","last_peered":"2024-09-15T23:56:32.721793+0000","last_clean":"2024-09-15T23:56:32.721793+0000","last_became_active":"2024-09-15T23:56:32.206291+0000","last_became_peered":"2024-09-15T23:56:32.206291+0000","last_unstale":"2024-09-15T23:56:32.721793+0000","last_undegraded":"2024-09-15T23:56:32.721793+0000","last_fullsized":"2024-09-15T23:56:32.721793+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:25.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735050+0000","last_change":"2024-09-15T23:56:32.731170+0000","last_active":"2024-09-15T23:56:32.735050+0000","last_peered":"2024-09-15T23:56:32.735050+0000","last_clean":"2024-09-15T23:56:32.735050+0000","last_became_active":"2024-09-15T23:56:32.730891+0000","last_became_peered":"2024-09-15T23:56:32.730891+0000","last_unstale":"2024-09-15T23:56:32.735050+0000","last_undegraded":"2024-09-15T23:56:32.735050+0000","last_fullsized":"2024-09-15T23:56:32.735050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:51.982360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720385+0000","last_change":"2024-09-15T23:56:20.705825+0000","last_active":"2024-09-15T23:56:32.720385+0000","last_peered":"2024-09-15T23:56:32.720385+0000","last_clean":"2024-09-15T23:56:32.720385+0000","last_became_active":"2024-09-15T23:56:20.705487+0000","last_became_peered":"2024-09-15T23:56:20.705487+0000","last_unstale":"2024-09-15T23:56:32.720385+0000","last_undegraded":"2024-09-15T23:56:32.720385+0000","last_fullsized":"2024-09-15T23:56:32.720385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:12.470216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708947+0000","last_change":"2024-09-15T23:56:19.684971+0000","last_active":"2024-09-15T23:56:32.708947+0000","last_peered":"2024-09-15T23:56:32.708947+0000","last_clean":"2024-09-15T23:56:32.708947+0000","last_became_active":"2024-09-15T23:56:19.684181+0000","last_became_peered":"2024-09-15T23:56:19.684181+0000","last_unstale":"2024-09-15T23:56:32.708947+0000","last_undegraded":"2024-09-15T23:56:32.708947+0000","last_fullsized":"2024-09-15T23:56:32.708947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:43.447800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709222+0000","last_change":"2024-09-15T23:56:32.200239+0000","last_active":"2024-09-15T23:56:32.709222+0000","last_peered":"2024-09-15T23:56:32.709222+0000","last_clean":"2024-09-15T23:56:32.709222+0000","last_became_active":"2024-09-15T23:56:32.199789+0000","last_became_peered":"2024-09-15T23:56:32.199789+0000","last_unstale":"2024-09-15T23:56:32.709222+0000","last_undegraded":"2024-09-15T23:56:32.709222+0000","last_fullsized":"2024-09-15T23:56:32.709222+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.872715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736239+0000","last_change":"2024-09-15T23:56:32.733176+0000","last_active":"2024-09-15T23:56:32.736239+0000","last_peered":"2024-09-15T23:56:32.736239+0000","last_clean":"2024-09-15T23:56:32.736239+0000","last_became_active":"2024-09-15T23:56:32.732585+0000","last_became_peered":"2024-09-15T23:56:32.732585+0000","last_unstale":"2024-09-15T23:56:32.736239+0000","last_undegraded":"2024-09-15T23:56:32.736239+0000","last_fullsized":"2024-09-15T23:56:32.736239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:49.177636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718851+0000","last_change":"2024-09-15T23:56:20.701720+0000","last_active":"2024-09-15T23:56:32.718851+0000","last_peered":"2024-09-15T23:56:32.718851+0000","last_clean":"2024-09-15T23:56:32.718851+0000","last_became_active":"2024-09-15T23:56:20.701136+0000","last_became_peered":"2024-09-15T23:56:20.701136+0000","last_unstale":"2024-09-15T23:56:32.718851+0000","last_undegraded":"2024-09-15T23:56:32.718851+0000","last_fullsized":"2024-09-15T23:56:32.718851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:45.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719623+0000","last_change":"2024-09-15T23:56:19.690833+0000","last_active":"2024-09-15T23:56:32.719623+0000","last_peered":"2024-09-15T23:56:32.719623+0000","last_clean":"2024-09-15T23:56:32.719623+0000","last_became_active":"2024-09-15T23:56:19.690087+0000","last_became_peered":"2024-09-15T23:56:19.690087+0000","last_unstale":"2024-09-15T23:56:32.719623+0000","last_undegraded":"2024-09-15T23:56:32.719623+0000","last_fullsized":"2024-09-15T23:56:32.719623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:03.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715367+0000","last_change":"2024-09-15T23:56:32.206644+0000","last_active":"2024-09-15T23:56:32.715367+0000","last_peered":"2024-09-15T23:56:32.715367+0000","last_clean":"2024-09-15T23:56:32.715367+0000","last_became_active":"2024-09-15T23:56:32.206355+0000","last_became_peered":"2024-09-15T23:56:32.206355+0000","last_unstale":"2024-09-15T23:56:32.715367+0000","last_undegraded":"2024-09-15T23:56:32.715367+0000","last_fullsized":"2024-09-15T23:56:32.715367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.400112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736764+0000","last_change":"2024-09-15T23:56:32.728163+0000","last_active":"2024-09-15T23:56:32.736764+0000","last_peered":"2024-09-15T23:56:32.736764+0000","last_clean":"2024-09-15T23:56:32.736764+0000","last_became_active":"2024-09-15T23:56:32.727916+0000","last_became_peered":"2024-09-15T23:56:32.727916+0000","last_unstale":"2024-09-15T23:56:32.736764+0000","last_undegraded":"2024-09-15T23:56:32.736764+0000","last_fullsized":"2024-09-15T23:56:32.736764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:33.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709033+0000","last_change":"2024-09-15T23:56:19.694496+0000","last_active":"2024-09-15T23:56:32.709033+0000","last_peered":"2024-09-15T23:56:32.709033+0000","last_clean":"2024-09-15T23:56:32.709033+0000","last_became_active":"2024-09-15T23:56:19.694220+0000","last_became_peered":"2024-09-15T23:56:19.694220+0000","last_unstale":"2024-09-15T23:56:32.709033+0000","last_undegraded":"2024-09-15T23:56:32.709033+0000","last_fullsized":"2024-09-15T23:56:32.709033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:37.594382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712363+0000","last_change":"2024-09-15T23:56:20.714864+0000","last_active":"2024-09-15T23:56:32.712363+0000","last_peered":"2024-09-15T23:56:32.712363+0000","last_clean":"2024-09-15T23:56:32.712363+0000","last_became_active":"2024-09-15T23:56:20.713754+0000","last_became_peered":"2024-09-15T23:56:20.713754+0000","last_unstale":"2024-09-15T23:56:32.712363+0000","last_undegraded":"2024-09-15T23:56:32.712363+0000","last_fullsized":"2024-09-15T23:56:32.712363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709168+0000","last_change":"2024-09-15T23:56:32.202917+0000","last_active":"2024-09-15T23:56:32.709168+0000","last_peered":"2024-09-15T23:56:32.709168+0000","last_clean":"2024-09-15T23:56:32.709168+0000","last_became_active":"2024-09-15T23:56:32.201606+0000","last_became_peered":"2024-09-15T23:56:32.201606+0000","last_unstale":"2024-09-15T23:56:32.709168+0000","last_undegraded":"2024-09-15T23:56:32.709168+0000","last_fullsized":"2024-09-15T23:56:32.709168+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:46.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736826+0000","last_change":"2024-09-15T23:56:32.731736+0000","last_active":"2024-09-15T23:56:32.736826+0000","last_peered":"2024-09-15T23:56:32.736826+0000","last_clean":"2024-09-15T23:56:32.736826+0000","last_became_active":"2024-09-15T23:56:32.731506+0000","last_became_peered":"2024-09-15T23:56:32.731506+0000","last_unstale":"2024-09-15T23:56:32.736826+0000","last_undegraded":"2024-09-15T23:56:32.736826+0000","last_fullsized":"2024-09-15T23:56:32.736826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:19.250971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716919+0000","last_change":"2024-09-15T23:56:20.710057+0000","last_active":"2024-09-15T23:56:32.716919+0000","last_peered":"2024-09-15T23:56:32.716919+0000","last_clean":"2024-09-15T23:56:32.716919+0000","last_became_active":"2024-09-15T23:56:20.709097+0000","last_became_peered":"2024-09-15T23:56:20.709097+0000","last_unstale":"2024-09-15T23:56:32.716919+0000","last_undegraded":"2024-09-15T23:56:32.716919+0000","last_fullsized":"2024-09-15T23:56:32.716919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:25.639372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737875+0000","last_change":"2024-09-15T23:56:32.734053+0000","last_active":"2024-09-15T23:56:32.737875+0000","last_peered":"2024-09-15T23:56:32.737875+0000","last_clean":"2024-09-15T23:56:32.737875+0000","last_became_active":"2024-09-15T23:56:32.732568+0000","last_became_peered":"2024-09-15T23:56:32.732568+0000","last_unstale":"2024-09-15T23:56:32.737875+0000","last_undegraded":"2024-09-15T23:56:32.737875+0000","last_fullsized":"2024-09-15T23:56:32.737875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:58.655594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715911+0000","last_change":"2024-09-15T23:56:20.698982+0000","last_active":"2024-09-15T23:56:32.715911+0000","last_peered":"2024-09-15T23:56:32.715911+0000","last_clean":"2024-09-15T23:56:32.715911+0000","last_became_active":"2024-09-15T23:56:20.697467+0000","last_became_peered":"2024-09-15T23:56:20.697467+0000","last_unstale":"2024-09-15T23:56:32.715911+0000","last_undegraded":"2024-09-15T23:56:32.715911+0000","last_fullsized":"2024-09-15T23:56:32.715911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:32.776991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736580+0000","last_change":"2024-09-15T23:56:32.727764+0000","last_active":"2024-09-15T23:56:32.736580+0000","last_peered":"2024-09-15T23:56:32.736580+0000","last_clean":"2024-09-15T23:56:32.736580+0000","last_became_active":"2024-09-15T23:56:32.727523+0000","last_became_peered":"2024-09-15T23:56:32.727523+0000","last_unstale":"2024-09-15T23:56:32.736580+0000","last_undegraded":"2024-09-15T23:56:32.736580+0000","last_fullsized":"2024-09-15T23:56:32.736580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:58.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718734+0000","last_change":"2024-09-15T23:56:20.716888+0000","last_active":"2024-09-15T23:56:32.718734+0000","last_peered":"2024-09-15T23:56:32.718734+0000","last_clean":"2024-09-15T23:56:32.718734+0000","last_became_active":"2024-09-15T23:56:20.716614+0000","last_became_peered":"2024-09-15T23:56:20.716614+0000","last_unstale":"2024-09-15T23:56:32.718734+0000","last_undegraded":"2024-09-15T23:56:32.718734+0000","last_fullsized":"2024-09-15T23:56:32.718734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:18.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735067+0000","last_change":"2024-09-15T23:56:32.732574+0000","last_active":"2024-09-15T23:56:32.735067+0000","last_peered":"2024-09-15T23:56:32.735067+0000","last_clean":"2024-09-15T23:56:32.735067+0000","last_became_active":"2024-09-15T23:56:32.732327+0000","last_became_peered":"2024-09-15T23:56:32.732327+0000","last_unstale":"2024-09-15T23:56:32.735067+0000","last_undegraded":"2024-09-15T23:56:32.735067+0000","last_fullsized":"2024-09-15T23:56:32.735067+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:43.487198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712448+0000","last_change":"2024-09-15T23:56:20.693934+0000","last_active":"2024-09-15T23:56:32.712448+0000","last_peered":"2024-09-15T23:56:32.712448+0000","last_clean":"2024-09-15T23:56:32.712448+0000","last_became_active":"2024-09-15T23:56:20.692241+0000","last_became_peered":"2024-09-15T23:56:20.692241+0000","last_unstale":"2024-09-15T23:56:32.712448+0000","last_undegraded":"2024-09-15T23:56:32.712448+0000","last_fullsized":"2024-09-15T23:56:32.712448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:26.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737793+0000","last_change":"2024-09-15T23:56:32.734580+0000","last_active":"2024-09-15T23:56:32.737793+0000","last_peered":"2024-09-15T23:56:32.737793+0000","last_clean":"2024-09-15T23:56:32.737793+0000","last_became_active":"2024-09-15T23:56:32.734177+0000","last_became_peered":"2024-09-15T23:56:32.734177+0000","last_unstale":"2024-09-15T23:56:32.737793+0000","last_undegraded":"2024-09-15T23:56:32.737793+0000","last_fullsized":"2024-09-15T23:56:32.737793+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:08.171277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716729+0000","last_change":"2024-09-15T23:56:20.710738+0000","last_active":"2024-09-15T23:56:32.716729+0000","last_peered":"2024-09-15T23:56:32.716729+0000","last_clean":"2024-09-15T23:56:32.716729+0000","last_became_active":"2024-09-15T23:56:20.710350+0000","last_became_peered":"2024-09-15T23:56:20.710350+0000","last_unstale":"2024-09-15T23:56:32.716729+0000","last_undegraded":"2024-09-15T23:56:32.716729+0000","last_fullsized":"2024-09-15T23:56:32.716729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:33.024255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728222+0000","last_change":"2024-09-15T23:56:32.720379+0000","last_active":"2024-09-15T23:56:32.728222+0000","last_peered":"2024-09-15T23:56:32.728222+0000","last_clean":"2024-09-15T23:56:32.728222+0000","last_became_active":"2024-09-15T23:56:32.720131+0000","last_became_peered":"2024-09-15T23:56:32.720131+0000","last_unstale":"2024-09-15T23:56:32.728222+0000","last_undegraded":"2024-09-15T23:56:32.728222+0000","last_fullsized":"2024-09-15T23:56:32.728222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:49.795009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712598+0000","last_change":"2024-09-15T23:56:20.698003+0000","last_active":"2024-09-15T23:56:32.712598+0000","last_peered":"2024-09-15T23:56:32.712598+0000","last_clean":"2024-09-15T23:56:32.712598+0000","last_became_active":"2024-09-15T23:56:20.697750+0000","last_became_peered":"2024-09-15T23:56:20.697750+0000","last_unstale":"2024-09-15T23:56:32.712598+0000","last_undegraded":"2024-09-15T23:56:32.712598+0000","last_fullsized":"2024-09-15T23:56:32.712598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:31.167780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736546+0000","last_change":"2024-09-15T23:56:32.730186+0000","last_active":"2024-09-15T23:56:32.736546+0000","last_peered":"2024-09-15T23:56:32.736546+0000","last_clean":"2024-09-15T23:56:32.736546+0000","last_became_active":"2024-09-15T23:56:32.728714+0000","last_became_peered":"2024-09-15T23:56:32.728714+0000","last_unstale":"2024-09-15T23:56:32.736546+0000","last_undegraded":"2024-09-15T23:56:32.736546+0000","last_fullsized":"2024-09-15T23:56:32.736546+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:35.837243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718998+0000","last_change":"2024-09-15T23:56:20.708903+0000","last_active":"2024-09-15T23:56:32.718998+0000","last_peered":"2024-09-15T23:56:32.718998+0000","last_clean":"2024-09-15T23:56:32.718998+0000","last_became_active":"2024-09-15T23:56:20.708615+0000","last_became_peered":"2024-09-15T23:56:20.708615+0000","last_unstale":"2024-09-15T23:56:32.718998+0000","last_undegraded":"2024-09-15T23:56:32.718998+0000","last_fullsized":"2024-09-15T23:56:32.718998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:10.895459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736441+0000","last_change":"2024-09-15T23:56:32.728772+0000","last_active":"2024-09-15T23:56:32.736441+0000","last_peered":"2024-09-15T23:56:32.736441+0000","last_clean":"2024-09-15T23:56:32.736441+0000","last_became_active":"2024-09-15T23:56:32.728496+0000","last_became_peered":"2024-09-15T23:56:32.728496+0000","last_unstale":"2024-09-15T23:56:32.736441+0000","last_undegraded":"2024-09-15T23:56:32.736441+0000","last_fullsized":"2024-09-15T23:56:32.736441+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:27.568548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709688+0000","last_change":"2024-09-15T23:56:20.704206+0000","last_active":"2024-09-15T23:56:32.709688+0000","last_peered":"2024-09-15T23:56:32.709688+0000","last_clean":"2024-09-15T23:56:32.709688+0000","last_became_active":"2024-09-15T23:56:20.703587+0000","last_became_peered":"2024-09-15T23:56:20.703587+0000","last_unstale":"2024-09-15T23:56:32.709688+0000","last_undegraded":"2024-09-15T23:56:32.709688+0000","last_fullsized":"2024-09-15T23:56:32.709688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:42.099710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.729825+0000","last_change":"2024-09-15T23:56:32.725884+0000","last_active":"2024-09-15T23:56:32.729825+0000","last_peered":"2024-09-15T23:56:32.729825+0000","last_clean":"2024-09-15T23:56:32.729825+0000","last_became_active":"2024-09-15T23:56:32.725636+0000","last_became_peered":"2024-09-15T23:56:32.725636+0000","last_unstale":"2024-09-15T23:56:32.729825+0000","last_undegraded":"2024-09-15T23:56:32.729825+0000","last_fullsized":"2024-09-15T23:56:32.729825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:29.820066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717000+0000","last_change":"2024-09-15T23:56:20.709433+0000","last_active":"2024-09-15T23:56:32.717000+0000","last_peered":"2024-09-15T23:56:32.717000+0000","last_clean":"2024-09-15T23:56:32.717000+0000","last_became_active":"2024-09-15T23:56:20.708730+0000","last_became_peered":"2024-09-15T23:56:20.708730+0000","last_unstale":"2024-09-15T23:56:32.717000+0000","last_undegraded":"2024-09-15T23:56:32.717000+0000","last_fullsized":"2024-09-15T23:56:32.717000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:12.070024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737947+0000","last_change":"2024-09-15T23:56:32.735323+0000","last_active":"2024-09-15T23:56:32.737947+0000","last_peered":"2024-09-15T23:56:32.737947+0000","last_clean":"2024-09-15T23:56:32.737947+0000","last_became_active":"2024-09-15T23:56:32.732975+0000","last_became_peered":"2024-09-15T23:56:32.732975+0000","last_unstale":"2024-09-15T23:56:32.737947+0000","last_undegraded":"2024-09-15T23:56:32.737947+0000","last_fullsized":"2024-09-15T23:56:32.737947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.246476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708861+0000","last_change":"2024-09-15T23:56:20.696531+0000","last_active":"2024-09-15T23:56:32.708861+0000","last_peered":"2024-09-15T23:56:32.708861+0000","last_clean":"2024-09-15T23:56:32.708861+0000","last_became_active":"2024-09-15T23:56:20.694733+0000","last_became_peered":"2024-09-15T23:56:20.694733+0000","last_unstale":"2024-09-15T23:56:32.708861+0000","last_undegraded":"2024-09-15T23:56:32.708861+0000","last_fullsized":"2024-09-15T23:56:32.708861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736839+0000","last_change":"2024-09-15T23:56:32.730535+0000","last_active":"2024-09-15T23:56:32.736839+0000","last_peered":"2024-09-15T23:56:32.736839+0000","last_clean":"2024-09-15T23:56:32.736839+0000","last_became_active":"2024-09-15T23:56:32.730217+0000","last_became_peered":"2024-09-15T23:56:32.730217+0000","last_unstale":"2024-09-15T23:56:32.736839+0000","last_undegraded":"2024-09-15T23:56:32.736839+0000","last_fullsized":"2024-09-15T23:56:32.736839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:26.514162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709173+0000","last_change":"2024-09-15T23:56:20.693536+0000","last_active":"2024-09-15T23:56:32.709173+0000","last_peered":"2024-09-15T23:56:32.709173+0000","last_clean":"2024-09-15T23:56:32.709173+0000","last_became_active":"2024-09-15T23:56:20.691876+0000","last_became_peered":"2024-09-15T23:56:20.691876+0000","last_unstale":"2024-09-15T23:56:32.709173+0000","last_undegraded":"2024-09-15T23:56:32.709173+0000","last_fullsized":"2024-09-15T23:56:32.709173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:23.334160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728115+0000","last_change":"2024-09-15T23:56:32.721939+0000","last_active":"2024-09-15T23:56:32.728115+0000","last_peered":"2024-09-15T23:56:32.728115+0000","last_clean":"2024-09-15T23:56:32.728115+0000","last_became_active":"2024-09-15T23:56:32.720088+0000","last_became_peered":"2024-09-15T23:56:32.720088+0000","last_unstale":"2024-09-15T23:56:32.728115+0000","last_undegraded":"2024-09-15T23:56:32.728115+0000","last_fullsized":"2024-09-15T23:56:32.728115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716981+0000","last_change":"2024-09-15T23:56:20.719041+0000","last_active":"2024-09-15T23:56:32.716981+0000","last_peered":"2024-09-15T23:56:32.716981+0000","last_clean":"2024-09-15T23:56:32.716981+0000","last_became_active":"2024-09-15T23:56:20.718733+0000","last_became_peered":"2024-09-15T23:56:20.718733+0000","last_unstale":"2024-09-15T23:56:32.716981+0000","last_undegraded":"2024-09-15T23:56:32.716981+0000","last_fullsized":"2024-09-15T23:56:32.716981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:32.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736613+0000","last_change":"2024-09-15T23:56:32.729122+0000","last_active":"2024-09-15T23:56:32.736613+0000","last_peered":"2024-09-15T23:56:32.736613+0000","last_clean":"2024-09-15T23:56:32.736613+0000","last_became_active":"2024-09-15T23:56:32.728699+0000","last_became_peered":"2024-09-15T23:56:32.728699+0000","last_unstale":"2024-09-15T23:56:32.736613+0000","last_undegraded":"2024-09-15T23:56:32.736613+0000","last_fullsized":"2024-09-15T23:56:32.736613+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:39.077347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716821+0000","last_change":"2024-09-15T23:56:20.716052+0000","last_active":"2024-09-15T23:56:32.716821+0000","last_peered":"2024-09-15T23:56:32.716821+0000","last_clean":"2024-09-15T23:56:32.716821+0000","last_became_active":"2024-09-15T23:56:20.715747+0000","last_became_peered":"2024-09-15T23:56:20.715747+0000","last_unstale":"2024-09-15T23:56:32.716821+0000","last_undegraded":"2024-09-15T23:56:32.716821+0000","last_fullsized":"2024-09-15T23:56:32.716821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:38.811325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737786+0000","last_change":"2024-09-15T23:56:32.734495+0000","last_active":"2024-09-15T23:56:32.737786+0000","last_peered":"2024-09-15T23:56:32.737786+0000","last_clean":"2024-09-15T23:56:32.737786+0000","last_became_active":"2024-09-15T23:56:32.734047+0000","last_became_peered":"2024-09-15T23:56:32.734047+0000","last_unstale":"2024-09-15T23:56:32.737786+0000","last_undegraded":"2024-09-15T23:56:32.737786+0000","last_fullsized":"2024-09-15T23:56:32.737786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:41.398372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712381+0000","last_change":"2024-09-15T23:56:20.695194+0000","last_active":"2024-09-15T23:56:32.712381+0000","last_peered":"2024-09-15T23:56:32.712381+0000","last_clean":"2024-09-15T23:56:32.712381+0000","last_became_active":"2024-09-15T23:56:20.694922+0000","last_became_peered":"2024-09-15T23:56:20.694922+0000","last_unstale":"2024-09-15T23:56:32.712381+0000","last_undegraded":"2024-09-15T23:56:32.712381+0000","last_fullsized":"2024-09-15T23:56:32.712381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:52.021672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737242+0000","last_change":"2024-09-15T23:56:32.735047+0000","last_active":"2024-09-15T23:56:32.737242+0000","last_peered":"2024-09-15T23:56:32.737242+0000","last_clean":"2024-09-15T23:56:32.737242+0000","last_became_active":"2024-09-15T23:56:32.734797+0000","last_became_peered":"2024-09-15T23:56:32.734797+0000","last_unstale":"2024-09-15T23:56:32.737242+0000","last_undegraded":"2024-09-15T23:56:32.737242+0000","last_fullsized":"2024-09-15T23:56:32.737242+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:53.066266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719299+0000","last_change":"2024-09-15T23:56:20.698132+0000","last_active":"2024-09-15T23:56:32.719299+0000","last_peered":"2024-09-15T23:56:32.719299+0000","last_clean":"2024-09-15T23:56:32.719299+0000","last_became_active":"2024-09-15T23:56:20.697871+0000","last_became_peered":"2024-09-15T23:56:20.697871+0000","last_unstale":"2024-09-15T23:56:32.719299+0000","last_undegraded":"2024-09-15T23:56:32.719299+0000","last_fullsized":"2024-09-15T23:56:32.719299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:12.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.734944+0000","last_change":"2024-09-15T23:56:32.729743+0000","last_active":"2024-09-15T23:56:32.734944+0000","last_peered":"2024-09-15T23:56:32.734944+0000","last_clean":"2024-09-15T23:56:32.734944+0000","last_became_active":"2024-09-15T23:56:32.729475+0000","last_became_peered":"2024-09-15T23:56:32.729475+0000","last_unstale":"2024-09-15T23:56:32.734944+0000","last_undegraded":"2024-09-15T23:56:32.734944+0000","last_fullsized":"2024-09-15T23:56:32.734944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:07.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717086+0000","last_change":"2024-09-15T23:56:20.702847+0000","last_active":"2024-09-15T23:56:32.717086+0000","last_peered":"2024-09-15T23:56:32.717086+0000","last_clean":"2024-09-15T23:56:32.717086+0000","last_became_active":"2024-09-15T23:56:20.702549+0000","last_became_peered":"2024-09-15T23:56:20.702549+0000","last_unstale":"2024-09-15T23:56:32.717086+0000","last_undegraded":"2024-09-15T23:56:32.717086+0000","last_fullsized":"2024-09-15T23:56:32.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:17.413803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737741+0000","last_change":"2024-09-15T23:56:32.733950+0000","last_active":"2024-09-15T23:56:32.737741+0000","last_peered":"2024-09-15T23:56:32.737741+0000","last_clean":"2024-09-15T23:56:32.737741+0000","last_became_active":"2024-09-15T23:56:32.733228+0000","last_became_peered":"2024-09-15T23:56:32.733228+0000","last_unstale":"2024-09-15T23:56:32.737741+0000","last_undegraded":"2024-09-15T23:56:32.737741+0000","last_fullsized":"2024-09-15T23:56:32.737741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:00.202502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709054+0000","last_change":"2024-09-15T23:56:20.694911+0000","last_active":"2024-09-15T23:56:32.709054+0000","last_peered":"2024-09-15T23:56:32.709054+0000","last_clean":"2024-09-15T23:56:32.709054+0000","last_became_active":"2024-09-15T23:56:20.694301+0000","last_became_peered":"2024-09-15T23:56:20.694301+0000","last_unstale":"2024-09-15T23:56:32.709054+0000","last_undegraded":"2024-09-15T23:56:32.709054+0000","last_fullsized":"2024-09-15T23:56:32.709054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:35.233940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736129+0000","last_change":"2024-09-15T23:56:32.732846+0000","last_active":"2024-09-15T23:56:32.736129+0000","last_peered":"2024-09-15T23:56:32.736129+0000","last_clean":"2024-09-15T23:56:32.736129+0000","last_became_active":"2024-09-15T23:56:32.732219+0000","last_became_peered":"2024-09-15T23:56:32.732219+0000","last_unstale":"2024-09-15T23:56:32.736129+0000","last_undegraded":"2024-09-15T23:56:32.736129+0000","last_fullsized":"2024-09-15T23:56:32.736129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:57.951954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715279+0000","last_change":"2024-09-15T23:56:20.707737+0000","last_active":"2024-09-15T23:56:32.715279+0000","last_peered":"2024-09-15T23:56:32.715279+0000","last_clean":"2024-09-15T23:56:32.715279+0000","last_became_active":"2024-09-15T23:56:20.707475+0000","last_became_peered":"2024-09-15T23:56:20.707475+0000","last_unstale":"2024-09-15T23:56:32.715279+0000","last_undegraded":"2024-09-15T23:56:32.715279+0000","last_fullsized":"2024-09-15T23:56:32.715279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:06.221910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730838+0000","last_change":"2024-09-15T23:56:32.727925+0000","last_active":"2024-09-15T23:56:32.730838+0000","last_peered":"2024-09-15T23:56:32.730838+0000","last_clean":"2024-09-15T23:56:32.730838+0000","last_became_active":"2024-09-15T23:56:32.726974+0000","last_became_peered":"2024-09-15T23:56:32.726974+0000","last_unstale":"2024-09-15T23:56:32.730838+0000","last_undegraded":"2024-09-15T23:56:32.730838+0000","last_fullsized":"2024-09-15T23:56:32.730838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:49.029923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709321+0000","last_change":"2024-09-15T23:56:20.693453+0000","last_active":"2024-09-15T23:56:32.709321+0000","last_peered":"2024-09-15T23:56:32.709321+0000","last_clean":"2024-09-15T23:56:32.709321+0000","last_became_active":"2024-09-15T23:56:20.692979+0000","last_became_peered":"2024-09-15T23:56:20.692979+0000","last_unstale":"2024-09-15T23:56:32.709321+0000","last_undegraded":"2024-09-15T23:56:32.709321+0000","last_fullsized":"2024-09-15T23:56:32.709321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:19.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735047+0000","last_change":"2024-09-15T23:56:32.729707+0000","last_active":"2024-09-15T23:56:32.735047+0000","last_peered":"2024-09-15T23:56:32.735047+0000","last_clean":"2024-09-15T23:56:32.735047+0000","last_became_active":"2024-09-15T23:56:32.729445+0000","last_became_peered":"2024-09-15T23:56:32.729445+0000","last_unstale":"2024-09-15T23:56:32.735047+0000","last_undegraded":"2024-09-15T23:56:32.735047+0000","last_fullsized":"2024-09-15T23:56:32.735047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:13.159664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717067+0000","last_change":"2024-09-15T23:56:20.707715+0000","last_active":"2024-09-15T23:56:32.717067+0000","last_peered":"2024-09-15T23:56:32.717067+0000","last_clean":"2024-09-15T23:56:32.717067+0000","last_became_active":"2024-09-15T23:56:20.707482+0000","last_became_peered":"2024-09-15T23:56:20.707482+0000","last_unstale":"2024-09-15T23:56:32.717067+0000","last_undegraded":"2024-09-15T23:56:32.717067+0000","last_fullsized":"2024-09-15T23:56:32.717067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:04.217570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730932+0000","last_change":"2024-09-15T23:56:32.727665+0000","last_active":"2024-09-15T23:56:32.730932+0000","last_peered":"2024-09-15T23:56:32.730932+0000","last_clean":"2024-09-15T23:56:32.730932+0000","last_became_active":"2024-09-15T23:56:32.727396+0000","last_became_peered":"2024-09-15T23:56:32.727396+0000","last_unstale":"2024-09-15T23:56:32.730932+0000","last_undegraded":"2024-09-15T23:56:32.730932+0000","last_fullsized":"2024-09-15T23:56:32.730932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:30.127957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.724529+0000","last_change":"2024-09-15T23:56:20.715787+0000","last_active":"2024-09-15T23:56:32.724529+0000","last_peered":"2024-09-15T23:56:32.724529+0000","last_clean":"2024-09-15T23:56:32.724529+0000","last_became_active":"2024-09-15T23:56:20.715520+0000","last_became_peered":"2024-09-15T23:56:20.715520+0000","last_unstale":"2024-09-15T23:56:32.724529+0000","last_undegraded":"2024-09-15T23:56:32.724529+0000","last_fullsized":"2024-09-15T23:56:32.724529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:23.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735119+0000","last_change":"2024-09-15T23:56:32.730385+0000","last_active":"2024-09-15T23:56:32.735119+0000","last_peered":"2024-09-15T23:56:32.735119+0000","last_clean":"2024-09-15T23:56:32.735119+0000","last_became_active":"2024-09-15T23:56:32.729452+0000","last_became_peered":"2024-09-15T23:56:32.729452+0000","last_unstale":"2024-09-15T23:56:32.735119+0000","last_undegraded":"2024-09-15T23:56:32.735119+0000","last_fullsized":"2024-09-15T23:56:32.735119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:59.914470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712686+0000","last_change":"2024-09-15T23:56:20.697597+0000","last_active":"2024-09-15T23:56:32.712686+0000","last_peered":"2024-09-15T23:56:32.712686+0000","last_clean":"2024-09-15T23:56:32.712686+0000","last_became_active":"2024-09-15T23:56:20.697269+0000","last_became_peered":"2024-09-15T23:56:20.697269+0000","last_unstale":"2024-09-15T23:56:32.712686+0000","last_undegraded":"2024-09-15T23:56:32.712686+0000","last_fullsized":"2024-09-15T23:56:32.712686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:40.413575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736222+0000","last_change":"2024-09-15T23:56:32.733151+0000","last_active":"2024-09-15T23:56:32.736222+0000","last_peered":"2024-09-15T23:56:32.736222+0000","last_clean":"2024-09-15T23:56:32.736222+0000","last_became_active":"2024-09-15T23:56:32.732877+0000","last_became_peered":"2024-09-15T23:56:32.732877+0000","last_unstale":"2024-09-15T23:56:32.736222+0000","last_undegraded":"2024-09-15T23:56:32.736222+0000","last_fullsized":"2024-09-15T23:56:32.736222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:55.835877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709220+0000","last_change":"2024-09-15T23:56:20.710594+0000","last_active":"2024-09-15T23:56:32.709220+0000","last_peered":"2024-09-15T23:56:32.709220+0000","last_clean":"2024-09-15T23:56:32.709220+0000","last_became_active":"2024-09-15T23:56:20.709407+0000","last_became_peered":"2024-09-15T23:56:20.709407+0000","last_unstale":"2024-09-15T23:56:32.709220+0000","last_undegraded":"2024-09-15T23:56:32.709220+0000","last_fullsized":"2024-09-15T23:56:32.709220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.538712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727737+0000","last_change":"2024-09-15T23:56:32.722039+0000","last_active":"2024-09-15T23:56:32.727737+0000","last_peered":"2024-09-15T23:56:32.727737+0000","last_clean":"2024-09-15T23:56:32.727737+0000","last_became_active":"2024-09-15T23:56:32.721282+0000","last_became_peered":"2024-09-15T23:56:32.721282+0000","last_unstale":"2024-09-15T23:56:32.727737+0000","last_undegraded":"2024-09-15T23:56:32.727737+0000","last_fullsized":"2024-09-15T23:56:32.727737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:41.824395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710089+0000","last_change":"2024-09-15T23:56:20.692345+0000","last_active":"2024-09-15T23:56:32.710089+0000","last_peered":"2024-09-15T23:56:32.710089+0000","last_clean":"2024-09-15T23:56:32.710089+0000","last_became_active":"2024-09-15T23:56:20.691997+0000","last_became_peered":"2024-09-15T23:56:20.691997+0000","last_unstale":"2024-09-15T23:56:32.710089+0000","last_undegraded":"2024-09-15T23:56:32.710089+0000","last_fullsized":"2024-09-15T23:56:32.710089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:32.210271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736086+0000","last_change":"2024-09-15T23:56:32.727714+0000","last_active":"2024-09-15T23:56:32.736086+0000","last_peered":"2024-09-15T23:56:32.736086+0000","last_clean":"2024-09-15T23:56:32.736086+0000","last_became_active":"2024-09-15T23:56:32.727463+0000","last_became_peered":"2024-09-15T23:56:32.727463+0000","last_unstale":"2024-09-15T23:56:32.736086+0000","last_undegraded":"2024-09-15T23:56:32.736086+0000","last_fullsized":"2024-09-15T23:56:32.736086+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:47.737023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709279+0000","last_change":"2024-09-15T23:56:20.713004+0000","last_active":"2024-09-15T23:56:32.709279+0000","last_peered":"2024-09-15T23:56:32.709279+0000","last_clean":"2024-09-15T23:56:32.709279+0000","last_became_active":"2024-09-15T23:56:20.712725+0000","last_became_peered":"2024-09-15T23:56:20.712725+0000","last_unstale":"2024-09-15T23:56:32.709279+0000","last_undegraded":"2024-09-15T23:56:32.709279+0000","last_fullsized":"2024-09-15T23:56:32.709279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:45.781065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736478+0000","last_change":"2024-09-15T23:56:32.728278+0000","last_active":"2024-09-15T23:56:32.736478+0000","last_peered":"2024-09-15T23:56:32.736478+0000","last_clean":"2024-09-15T23:56:32.736478+0000","last_became_active":"2024-09-15T23:56:32.728013+0000","last_became_peered":"2024-09-15T23:56:32.728013+0000","last_unstale":"2024-09-15T23:56:32.736478+0000","last_undegraded":"2024-09-15T23:56:32.736478+0000","last_fullsized":"2024-09-15T23:56:32.736478+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:34.722829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708916+0000","last_change":"2024-09-15T23:56:20.690748+0000","last_active":"2024-09-15T23:56:32.708916+0000","last_peered":"2024-09-15T23:56:32.708916+0000","last_clean":"2024-09-15T23:56:32.708916+0000","last_became_active":"2024-09-15T23:56:20.690331+0000","last_became_peered":"2024-09-15T23:56:20.690331+0000","last_unstale":"2024-09-15T23:56:32.708916+0000","last_undegraded":"2024-09-15T23:56:32.708916+0000","last_fullsized":"2024-09-15T23:56:32.708916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:49.052824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736598+0000","last_change":"2024-09-15T23:56:32.729590+0000","last_active":"2024-09-15T23:56:32.736598+0000","last_peered":"2024-09-15T23:56:32.736598+0000","last_clean":"2024-09-15T23:56:32.736598+0000","last_became_active":"2024-09-15T23:56:32.728783+0000","last_became_peered":"2024-09-15T23:56:32.728783+0000","last_unstale":"2024-09-15T23:56:32.736598+0000","last_undegraded":"2024-09-15T23:56:32.736598+0000","last_fullsized":"2024-09-15T23:56:32.736598+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:52.631789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710093+0000","last_change":"2024-09-15T23:56:20.693245+0000","last_active":"2024-09-15T23:56:32.710093+0000","last_peered":"2024-09-15T23:56:32.710093+0000","last_clean":"2024-09-15T23:56:32.710093+0000","last_became_active":"2024-09-15T23:56:20.692604+0000","last_became_peered":"2024-09-15T23:56:20.692604+0000","last_unstale":"2024-09-15T23:56:32.710093+0000","last_undegraded":"2024-09-15T23:56:32.710093+0000","last_fullsized":"2024-09-15T23:56:32.710093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:15.065465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736782+0000","last_change":"2024-09-15T23:56:32.732604+0000","last_active":"2024-09-15T23:56:32.736782+0000","last_peered":"2024-09-15T23:56:32.736782+0000","last_clean":"2024-09-15T23:56:32.736782+0000","last_became_active":"2024-09-15T23:56:32.731603+0000","last_became_peered":"2024-09-15T23:56:32.731603+0000","last_unstale":"2024-09-15T23:56:32.736782+0000","last_undegraded":"2024-09-15T23:56:32.736782+0000","last_fullsized":"2024-09-15T23:56:32.736782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:03.041794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.713158+0000","last_change":"2024-09-15T23:56:20.694156+0000","last_active":"2024-09-15T23:56:32.713158+0000","last_peered":"2024-09-15T23:56:32.713158+0000","last_clean":"2024-09-15T23:56:32.713158+0000","last_became_active":"2024-09-15T23:56:20.693864+0000","last_became_peered":"2024-09-15T23:56:20.693864+0000","last_unstale":"2024-09-15T23:56:32.713158+0000","last_undegraded":"2024-09-15T23:56:32.713158+0000","last_fullsized":"2024-09-15T23:56:32.713158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:22.219746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.738011+0000","last_change":"2024-09-15T23:56:32.735699+0000","last_active":"2024-09-15T23:56:32.738011+0000","last_peered":"2024-09-15T23:56:32.738011+0000","last_clean":"2024-09-15T23:56:32.738011+0000","last_became_active":"2024-09-15T23:56:32.735449+0000","last_became_peered":"2024-09-15T23:56:32.735449+0000","last_unstale":"2024-09-15T23:56:32.738011+0000","last_undegraded":"2024-09-15T23:56:32.738011+0000","last_fullsized":"2024-09-15T23:56:32.738011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:27.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709215+0000","last_change":"2024-09-15T23:56:20.706407+0000","last_active":"2024-09-15T23:56:32.709215+0000","last_peered":"2024-09-15T23:56:32.709215+0000","last_clean":"2024-09-15T23:56:32.709215+0000","last_became_active":"2024-09-15T23:56:20.706098+0000","last_became_peered":"2024-09-15T23:56:20.706098+0000","last_unstale":"2024-09-15T23:56:32.709215+0000","last_undegraded":"2024-09-15T23:56:32.709215+0000","last_fullsized":"2024-09-15T23:56:32.709215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:41.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737528+0000","last_change":"2024-09-15T23:56:32.735999+0000","last_active":"2024-09-15T23:56:32.737528+0000","last_peered":"2024-09-15T23:56:32.737528+0000","last_clean":"2024-09-15T23:56:32.737528+0000","last_became_active":"2024-09-15T23:56:32.735642+0000","last_became_peered":"2024-09-15T23:56:32.735642+0000","last_unstale":"2024-09-15T23:56:32.737528+0000","last_undegraded":"2024-09-15T23:56:32.737528+0000","last_fullsized":"2024-09-15T23:56:32.737528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:44.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721273+0000","last_change":"2024-09-15T23:56:20.712420+0000","last_active":"2024-09-15T23:56:32.721273+0000","last_peered":"2024-09-15T23:56:32.721273+0000","last_clean":"2024-09-15T23:56:32.721273+0000","last_became_active":"2024-09-15T23:56:20.711746+0000","last_became_peered":"2024-09-15T23:56:20.711746+0000","last_unstale":"2024-09-15T23:56:32.721273+0000","last_undegraded":"2024-09-15T23:56:32.721273+0000","last_fullsized":"2024-09-15T23:56:32.721273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:21.080902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727887+0000","last_change":"2024-09-15T23:56:32.720667+0000","last_active":"2024-09-15T23:56:32.727887+0000","last_peered":"2024-09-15T23:56:32.727887+0000","last_clean":"2024-09-15T23:56:32.727887+0000","last_became_active":"2024-09-15T23:56:32.720185+0000","last_became_peered":"2024-09-15T23:56:32.720185+0000","last_unstale":"2024-09-15T23:56:32.727887+0000","last_undegraded":"2024-09-15T23:56:32.727887+0000","last_fullsized":"2024-09-15T23:56:32.727887+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:27.603363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720467+0000","last_change":"2024-09-15T23:56:20.715838+0000","last_active":"2024-09-15T23:56:32.720467+0000","last_peered":"2024-09-15T23:56:32.720467+0000","last_clean":"2024-09-15T23:56:32.720467+0000","last_became_active":"2024-09-15T23:56:20.715553+0000","last_became_peered":"2024-09-15T23:56:20.715553+0000","last_unstale":"2024-09-15T23:56:32.720467+0000","last_undegraded":"2024-09-15T23:56:32.720467+0000","last_fullsized":"2024-09-15T23:56:32.720467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:36.218180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727705+0000","last_change":"2024-09-15T23:56:32.722294+0000","last_active":"2024-09-15T23:56:32.727705+0000","last_peered":"2024-09-15T23:56:32.727705+0000","last_clean":"2024-09-15T23:56:32.727705+0000","last_became_active":"2024-09-15T23:56:32.721596+0000","last_became_peered":"2024-09-15T23:56:32.721596+0000","last_unstale":"2024-09-15T23:56:32.727705+0000","last_undegraded":"2024-09-15T23:56:32.727705+0000","last_fullsized":"2024-09-15T23:56:32.727705+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:04.406292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710147+0000","last_change":"2024-09-15T23:56:20.704497+0000","last_active":"2024-09-15T23:56:32.710147+0000","last_peered":"2024-09-15T23:56:32.710147+0000","last_clean":"2024-09-15T23:56:32.710147+0000","last_became_active":"2024-09-15T23:56:20.703942+0000","last_became_peered":"2024-09-15T23:56:20.703942+0000","last_unstale":"2024-09-15T23:56:32.710147+0000","last_undegraded":"2024-09-15T23:56:32.710147+0000","last_fullsized":"2024-09-15T23:56:32.710147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:29.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":5046,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705684,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":393216,"data_stored":142506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":733611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":995328,"data_stored":738475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:36.156 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:56:36.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.286+0000 7f8eaf674640 1 Processor -- start 2024-09-15T23:56:36.287 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.286+0000 7f8eaf674640 1 -- start start 2024-09-15T23:56:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eaf674640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ea8135f30 0x7f8ea813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eaf674640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea80a08c0 con 0x7f8ea8135b50 2024-09-15T23:56:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eaf674640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea809b310 con 0x7f8ea8135f30 2024-09-15T23:56:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eacc0f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ea8135f30 0x7f8ea813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8ead410640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8ea8135b50 0x7f8ea809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:59406/0 (socket says 172.21.15.121:59406) 2024-09-15T23:56:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eacc0f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ea8135f30 0x7f8ea813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39304/0 (socket says 172.21.15.121:39304) 2024-09-15T23:56:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8ead410640 1 -- 172.21.15.121:0/1104563649 learned_addr learned my addr 172.21.15.121:0/1104563649 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eacc0f640 1 -- 172.21.15.121:0/1104563649 >> v1:172.21.15.121:6789/0 conn(0x7f8ea8135b50 legacy=0x7f8ea809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.287+0000 7f8eacc0f640 1 -- 172.21.15.121:0/1104563649 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea80a2270 con 0x7f8ea8135f30 2024-09-15T23:56:36.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.288+0000 7f8eacc0f640 1 --2- 172.21.15.121:0/1104563649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135f30 0x7f8ea813bb80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009720 tx=0x7f8e9802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1f7c9e89e073f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.288+0000 7f8e9ffff640 1 -- 172.21.15.121:0/1104563649 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98037070 con 0x7f8ea8135f30 2024-09-15T23:56:36.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.288+0000 7f8e9ffff640 1 -- 172.21.15.121:0/1104563649 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9802ae20 con 0x7f8ea8135f30 2024-09-15T23:56:36.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.288+0000 7f8e9ffff640 1 -- 172.21.15.121:0/1104563649 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e98032590 con 0x7f8ea8135f30 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 -- 172.21.15.121:0/1104563649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135f30 msgr2=0x7f8ea813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 --2- 172.21.15.121:0/1104563649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135f30 0x7f8ea813bb80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009720 tx=0x7f8e9802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 -- 172.21.15.121:0/1104563649 shutdown_connections 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 --2- 172.21.15.121:0/1104563649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135f30 0x7f8ea813bb80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 -- 172.21.15.121:0/1104563649 >> 172.21.15.121:0/1104563649 conn(0x7f8ea80a85e0 msgr2=0x7f8ea80a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 -- 172.21.15.121:0/1104563649 shutdown_connections 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.289+0000 7f8eaf674640 1 -- 172.21.15.121:0/1104563649 wait complete. 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8eaf674640 1 Processor -- start 2024-09-15T23:56:36.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8eaf674640 1 -- start start 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8eaf674640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8eaf674640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8136350 con 0x7f8ea8135b50 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8ead410640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8ead410640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39310/0 (socket says 172.21.15.121:39310) 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8ead410640 1 -- 172.21.15.121:0/2631383095 learned_addr learned my addr 172.21.15.121:0/2631383095 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8ead410640 1 -- 172.21.15.121:0/2631383095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea811fe50 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.290+0000 7f8ead410640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c380 tx=0x7f8ea400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4005c10 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4005db0 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4004930 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea80a0270 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea8135580 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.291+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7f8ea401a020 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.292+0000 7f8e9dffb640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 0x7f8e8c03a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.292+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f8ea404aef0 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.292+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea809aae0 con 0x7f8ea8135b50 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.292+0000 7f8eacc0f640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 0x7f8e8c03a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.292+0000 7f8eacc0f640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 0x7f8e8c03a840 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e98034000 tx=0x7f8e9802e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.297+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ea40075f0 con 0x7f8ea8135b50 2024-09-15T23:56:36.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.458+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 --> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ea80a1f10 con 0x7f8e8c038380 2024-09-15T23:56:36.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.469+0000 7f8e9dffb640 1 -- 172.21.15.121:0/2631383095 <== mgr.4609 v2:172.21.15.121:6827/3398364693 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+482101 (secure 0 0 0) 0x7f8ea80a1f10 con 0x7f8e8c038380 2024-09-15T23:56:36.475 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:36.478 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 msgr2=0x7f8e8c03a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 0x7f8e8c03a840 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e98034000 tx=0x7f8e9802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 msgr2=0x7f8ea811ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c380 tx=0x7f8ea400c840 comp rx=0 tx=0).stop 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 shutdown_connections 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8e8c038380 0x7f8e8c03a840 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 --2- 172.21.15.121:0/2631383095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ea8135b50 0x7f8ea811ebc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 >> 172.21.15.121:0/2631383095 conn(0x7f8ea80a85e0 msgr2=0x7f8ea809d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 shutdown_connections 2024-09-15T23:56:36.481 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.473+0000 7f8eaf674640 1 -- 172.21.15.121:0/2631383095 wait complete. 2024-09-15T23:56:36.485 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-09-15T23:56:36.193963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595414,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":228,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":87580,"kb_used_data":2316,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283027940,"statfs":{"total":289910292480,"available":289820610560,"internally_reserved":0,"allocated":2371584,"data_stored":1614592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":87223631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.011054"},"pg_stats":[{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736527+0000","last_change":"2024-09-15T23:56:32.728725+0000","last_active":"2024-09-15T23:56:32.736527+0000","last_peered":"2024-09-15T23:56:32.736527+0000","last_clean":"2024-09-15T23:56:32.736527+0000","last_became_active":"2024-09-15T23:56:32.728470+0000","last_became_peered":"2024-09-15T23:56:32.728470+0000","last_unstale":"2024-09-15T23:56:32.736527+0000","last_undegraded":"2024-09-15T23:56:32.736527+0000","last_fullsized":"2024-09-15T23:56:32.736527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:31.911049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":24,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716762+0000","last_change":"2024-09-15T23:56:19.699159+0000","last_active":"2024-09-15T23:56:32.716762+0000","last_peered":"2024-09-15T23:56:32.716762+0000","last_clean":"2024-09-15T23:56:32.716762+0000","last_became_active":"2024-09-15T23:56:19.698923+0000","last_became_peered":"2024-09-15T23:56:19.698923+0000","last_unstale":"2024-09-15T23:56:32.716762+0000","last_undegraded":"2024-09-15T23:56:32.716762+0000","last_fullsized":"2024-09-15T23:56:32.716762+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:27.036988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719073+0000","last_change":"2024-09-15T23:56:20.697033+0000","last_active":"2024-09-15T23:56:32.719073+0000","last_peered":"2024-09-15T23:56:32.719073+0000","last_clean":"2024-09-15T23:56:32.719073+0000","last_became_active":"2024-09-15T23:56:20.696772+0000","last_became_peered":"2024-09-15T23:56:20.696772+0000","last_unstale":"2024-09-15T23:56:32.719073+0000","last_undegraded":"2024-09-15T23:56:32.719073+0000","last_fullsized":"2024-09-15T23:56:32.719073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:43.492783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715403+0000","last_change":"2024-09-15T23:56:32.203024+0000","last_active":"2024-09-15T23:56:32.715403+0000","last_peered":"2024-09-15T23:56:32.715403+0000","last_clean":"2024-09-15T23:56:32.715403+0000","last_became_active":"2024-09-15T23:56:32.202771+0000","last_became_peered":"2024-09-15T23:56:32.202771+0000","last_unstale":"2024-09-15T23:56:32.715403+0000","last_undegraded":"2024-09-15T23:56:32.715403+0000","last_fullsized":"2024-09-15T23:56:32.715403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:03.305324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737080+0000","last_change":"2024-09-15T23:56:32.734530+0000","last_active":"2024-09-15T23:56:32.737080+0000","last_peered":"2024-09-15T23:56:32.737080+0000","last_clean":"2024-09-15T23:56:32.737080+0000","last_became_active":"2024-09-15T23:56:32.734284+0000","last_became_peered":"2024-09-15T23:56:32.734284+0000","last_unstale":"2024-09-15T23:56:32.737080+0000","last_undegraded":"2024-09-15T23:56:32.737080+0000","last_fullsized":"2024-09-15T23:56:32.737080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:47.970301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718695+0000","last_change":"2024-09-15T23:56:19.686214+0000","last_active":"2024-09-15T23:56:32.718695+0000","last_peered":"2024-09-15T23:56:32.718695+0000","last_clean":"2024-09-15T23:56:32.718695+0000","last_became_active":"2024-09-15T23:56:19.685934+0000","last_became_peered":"2024-09-15T23:56:19.685934+0000","last_unstale":"2024-09-15T23:56:32.718695+0000","last_undegraded":"2024-09-15T23:56:32.718695+0000","last_fullsized":"2024-09-15T23:56:32.718695+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:23.562336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709600+0000","last_change":"2024-09-15T23:56:20.691620+0000","last_active":"2024-09-15T23:56:32.709600+0000","last_peered":"2024-09-15T23:56:32.709600+0000","last_clean":"2024-09-15T23:56:32.709600+0000","last_became_active":"2024-09-15T23:56:20.690902+0000","last_became_peered":"2024-09-15T23:56:20.690902+0000","last_unstale":"2024-09-15T23:56:32.709600+0000","last_undegraded":"2024-09-15T23:56:32.709600+0000","last_fullsized":"2024-09-15T23:56:32.709600+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:12.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710643+0000","last_change":"2024-09-15T23:56:32.200029+0000","last_active":"2024-09-15T23:56:32.710643+0000","last_peered":"2024-09-15T23:56:32.710643+0000","last_clean":"2024-09-15T23:56:32.710643+0000","last_became_active":"2024-09-15T23:56:32.199351+0000","last_became_peered":"2024-09-15T23:56:32.199351+0000","last_unstale":"2024-09-15T23:56:32.710643+0000","last_undegraded":"2024-09-15T23:56:32.710643+0000","last_fullsized":"2024-09-15T23:56:32.710643+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:26.904716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736595+0000","last_change":"2024-09-15T23:56:32.729005+0000","last_active":"2024-09-15T23:56:32.736595+0000","last_peered":"2024-09-15T23:56:32.736595+0000","last_clean":"2024-09-15T23:56:32.736595+0000","last_became_active":"2024-09-15T23:56:32.728218+0000","last_became_peered":"2024-09-15T23:56:32.728218+0000","last_unstale":"2024-09-15T23:56:32.736595+0000","last_undegraded":"2024-09-15T23:56:32.736595+0000","last_fullsized":"2024-09-15T23:56:32.736595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:40.986313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721554+0000","last_change":"2024-09-15T23:56:19.694386+0000","last_active":"2024-09-15T23:56:32.721554+0000","last_peered":"2024-09-15T23:56:32.721554+0000","last_clean":"2024-09-15T23:56:32.721554+0000","last_became_active":"2024-09-15T23:56:19.693850+0000","last_became_peered":"2024-09-15T23:56:19.693850+0000","last_unstale":"2024-09-15T23:56:32.721554+0000","last_undegraded":"2024-09-15T23:56:32.721554+0000","last_fullsized":"2024-09-15T23:56:32.721554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:10.056160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716694+0000","last_change":"2024-09-15T23:56:20.710664+0000","last_active":"2024-09-15T23:56:32.716694+0000","last_peered":"2024-09-15T23:56:32.716694+0000","last_clean":"2024-09-15T23:56:32.716694+0000","last_became_active":"2024-09-15T23:56:20.710260+0000","last_became_peered":"2024-09-15T23:56:20.710260+0000","last_unstale":"2024-09-15T23:56:32.716694+0000","last_undegraded":"2024-09-15T23:56:32.716694+0000","last_fullsized":"2024-09-15T23:56:32.716694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:39.006258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715469+0000","last_change":"2024-09-15T23:56:32.199818+0000","last_active":"2024-09-15T23:56:32.715469+0000","last_peered":"2024-09-15T23:56:32.715469+0000","last_clean":"2024-09-15T23:56:32.715469+0000","last_became_active":"2024-09-15T23:56:32.199557+0000","last_became_peered":"2024-09-15T23:56:32.199557+0000","last_unstale":"2024-09-15T23:56:32.715469+0000","last_undegraded":"2024-09-15T23:56:32.715469+0000","last_fullsized":"2024-09-15T23:56:32.715469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:25.939740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737768+0000","last_change":"2024-09-15T23:56:32.734290+0000","last_active":"2024-09-15T23:56:32.737768+0000","last_peered":"2024-09-15T23:56:32.737768+0000","last_clean":"2024-09-15T23:56:32.737768+0000","last_became_active":"2024-09-15T23:56:32.733217+0000","last_became_peered":"2024-09-15T23:56:32.733217+0000","last_unstale":"2024-09-15T23:56:32.737768+0000","last_undegraded":"2024-09-15T23:56:32.737768+0000","last_fullsized":"2024-09-15T23:56:32.737768+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:22.023650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718203+0000","last_change":"2024-09-15T23:56:19.689323+0000","last_active":"2024-09-15T23:56:32.718203+0000","last_peered":"2024-09-15T23:56:32.718203+0000","last_clean":"2024-09-15T23:56:32.718203+0000","last_became_active":"2024-09-15T23:56:19.688934+0000","last_became_peered":"2024-09-15T23:56:19.688934+0000","last_unstale":"2024-09-15T23:56:32.718203+0000","last_undegraded":"2024-09-15T23:56:32.718203+0000","last_fullsized":"2024-09-15T23:56:32.718203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:23.699701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721136+0000","last_change":"2024-09-15T23:56:20.712331+0000","last_active":"2024-09-15T23:56:32.721136+0000","last_peered":"2024-09-15T23:56:32.721136+0000","last_clean":"2024-09-15T23:56:32.721136+0000","last_became_active":"2024-09-15T23:56:20.711680+0000","last_became_peered":"2024-09-15T23:56:20.711680+0000","last_unstale":"2024-09-15T23:56:32.721136+0000","last_undegraded":"2024-09-15T23:56:32.721136+0000","last_fullsized":"2024-09-15T23:56:32.721136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:30.490761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718594+0000","last_change":"2024-09-15T23:56:32.209526+0000","last_active":"2024-09-15T23:56:32.718594+0000","last_peered":"2024-09-15T23:56:32.718594+0000","last_clean":"2024-09-15T23:56:32.718594+0000","last_became_active":"2024-09-15T23:56:32.209269+0000","last_became_peered":"2024-09-15T23:56:32.209269+0000","last_unstale":"2024-09-15T23:56:32.718594+0000","last_undegraded":"2024-09-15T23:56:32.718594+0000","last_fullsized":"2024-09-15T23:56:32.718594+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:23.539178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737324+0000","last_change":"2024-09-15T23:56:32.734482+0000","last_active":"2024-09-15T23:56:32.737324+0000","last_peered":"2024-09-15T23:56:32.737324+0000","last_clean":"2024-09-15T23:56:32.737324+0000","last_became_active":"2024-09-15T23:56:32.734234+0000","last_became_peered":"2024-09-15T23:56:32.734234+0000","last_unstale":"2024-09-15T23:56:32.737324+0000","last_undegraded":"2024-09-15T23:56:32.737324+0000","last_fullsized":"2024-09-15T23:56:32.737324+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:54.112503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715798+0000","last_change":"2024-09-15T23:56:20.699756+0000","last_active":"2024-09-15T23:56:32.715798+0000","last_peered":"2024-09-15T23:56:32.715798+0000","last_clean":"2024-09-15T23:56:32.715798+0000","last_became_active":"2024-09-15T23:56:20.699505+0000","last_became_peered":"2024-09-15T23:56:20.699505+0000","last_unstale":"2024-09-15T23:56:32.715798+0000","last_undegraded":"2024-09-15T23:56:32.715798+0000","last_fullsized":"2024-09-15T23:56:32.715798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:38.597293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708639+0000","last_change":"2024-09-15T23:56:19.684144+0000","last_active":"2024-09-15T23:56:32.708639+0000","last_peered":"2024-09-15T23:56:32.708639+0000","last_clean":"2024-09-15T23:56:32.708639+0000","last_became_active":"2024-09-15T23:56:19.683740+0000","last_became_peered":"2024-09-15T23:56:19.683740+0000","last_unstale":"2024-09-15T23:56:32.708639+0000","last_undegraded":"2024-09-15T23:56:32.708639+0000","last_fullsized":"2024-09-15T23:56:32.708639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:11.966919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.724750+0000","last_change":"2024-09-15T23:56:32.207428+0000","last_active":"2024-09-15T23:56:32.724750+0000","last_peered":"2024-09-15T23:56:32.724750+0000","last_clean":"2024-09-15T23:56:32.724750+0000","last_became_active":"2024-09-15T23:56:32.206952+0000","last_became_peered":"2024-09-15T23:56:32.206952+0000","last_unstale":"2024-09-15T23:56:32.724750+0000","last_undegraded":"2024-09-15T23:56:32.724750+0000","last_fullsized":"2024-09-15T23:56:32.724750+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:21.283204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735733+0000","last_change":"2024-09-15T23:56:32.727520+0000","last_active":"2024-09-15T23:56:32.735733+0000","last_peered":"2024-09-15T23:56:32.735733+0000","last_clean":"2024-09-15T23:56:32.735733+0000","last_became_active":"2024-09-15T23:56:32.727210+0000","last_became_peered":"2024-09-15T23:56:32.727210+0000","last_unstale":"2024-09-15T23:56:32.735733+0000","last_undegraded":"2024-09-15T23:56:32.735733+0000","last_fullsized":"2024-09-15T23:56:32.735733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:09.081051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718414+0000","last_change":"2024-09-15T23:56:20.718694+0000","last_active":"2024-09-15T23:56:32.718414+0000","last_peered":"2024-09-15T23:56:32.718414+0000","last_clean":"2024-09-15T23:56:32.718414+0000","last_became_active":"2024-09-15T23:56:20.718450+0000","last_became_peered":"2024-09-15T23:56:20.718450+0000","last_unstale":"2024-09-15T23:56:32.718414+0000","last_undegraded":"2024-09-15T23:56:32.718414+0000","last_fullsized":"2024-09-15T23:56:32.718414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:05.347620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715910+0000","last_change":"2024-09-15T23:56:19.693752+0000","last_active":"2024-09-15T23:56:32.715910+0000","last_peered":"2024-09-15T23:56:32.715910+0000","last_clean":"2024-09-15T23:56:32.715910+0000","last_became_active":"2024-09-15T23:56:19.693438+0000","last_became_peered":"2024-09-15T23:56:19.693438+0000","last_unstale":"2024-09-15T23:56:32.715910+0000","last_undegraded":"2024-09-15T23:56:32.715910+0000","last_fullsized":"2024-09-15T23:56:32.715910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:53.993520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719626+0000","last_change":"2024-09-15T23:56:32.199822+0000","last_active":"2024-09-15T23:56:32.719626+0000","last_peered":"2024-09-15T23:56:32.719626+0000","last_clean":"2024-09-15T23:56:32.719626+0000","last_became_active":"2024-09-15T23:56:32.199445+0000","last_became_peered":"2024-09-15T23:56:32.199445+0000","last_unstale":"2024-09-15T23:56:32.719626+0000","last_undegraded":"2024-09-15T23:56:32.719626+0000","last_fullsized":"2024-09-15T23:56:32.719626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:14.395987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727683+0000","last_change":"2024-09-15T23:56:32.721846+0000","last_active":"2024-09-15T23:56:32.727683+0000","last_peered":"2024-09-15T23:56:32.727683+0000","last_clean":"2024-09-15T23:56:32.727683+0000","last_became_active":"2024-09-15T23:56:32.720379+0000","last_became_peered":"2024-09-15T23:56:32.720379+0000","last_unstale":"2024-09-15T23:56:32.727683+0000","last_undegraded":"2024-09-15T23:56:32.727683+0000","last_fullsized":"2024-09-15T23:56:32.727683+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:58.842610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.722586+0000","last_change":"2024-09-15T23:56:20.711902+0000","last_active":"2024-09-15T23:56:32.722586+0000","last_peered":"2024-09-15T23:56:32.722586+0000","last_clean":"2024-09-15T23:56:32.722586+0000","last_became_active":"2024-09-15T23:56:20.711592+0000","last_became_peered":"2024-09-15T23:56:20.711592+0000","last_unstale":"2024-09-15T23:56:32.722586+0000","last_undegraded":"2024-09-15T23:56:32.722586+0000","last_fullsized":"2024-09-15T23:56:32.722586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:19.021591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718501+0000","last_change":"2024-09-15T23:56:19.690132+0000","last_active":"2024-09-15T23:56:32.718501+0000","last_peered":"2024-09-15T23:56:32.718501+0000","last_clean":"2024-09-15T23:56:32.718501+0000","last_became_active":"2024-09-15T23:56:19.689823+0000","last_became_peered":"2024-09-15T23:56:19.689823+0000","last_unstale":"2024-09-15T23:56:32.718501+0000","last_undegraded":"2024-09-15T23:56:32.718501+0000","last_fullsized":"2024-09-15T23:56:32.718501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:57.040079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.723766+0000","last_change":"2024-09-15T23:56:32.192808+0000","last_active":"2024-09-15T23:56:32.723766+0000","last_peered":"2024-09-15T23:56:32.723766+0000","last_clean":"2024-09-15T23:56:32.723766+0000","last_became_active":"2024-09-15T23:56:32.192414+0000","last_became_peered":"2024-09-15T23:56:32.192414+0000","last_unstale":"2024-09-15T23:56:32.723766+0000","last_undegraded":"2024-09-15T23:56:32.723766+0000","last_fullsized":"2024-09-15T23:56:32.723766+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:58.761114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736616+0000","last_change":"2024-09-15T23:56:32.731750+0000","last_active":"2024-09-15T23:56:32.736616+0000","last_peered":"2024-09-15T23:56:32.736616+0000","last_clean":"2024-09-15T23:56:32.736616+0000","last_became_active":"2024-09-15T23:56:32.731494+0000","last_became_peered":"2024-09-15T23:56:32.731494+0000","last_unstale":"2024-09-15T23:56:32.736616+0000","last_undegraded":"2024-09-15T23:56:32.736616+0000","last_fullsized":"2024-09-15T23:56:32.736616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:15.225628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.711885+0000","last_change":"2024-09-15T23:56:19.699217+0000","last_active":"2024-09-15T23:56:32.711885+0000","last_peered":"2024-09-15T23:56:32.711885+0000","last_clean":"2024-09-15T23:56:32.711885+0000","last_became_active":"2024-09-15T23:56:19.698869+0000","last_became_peered":"2024-09-15T23:56:19.698869+0000","last_unstale":"2024-09-15T23:56:32.711885+0000","last_undegraded":"2024-09-15T23:56:32.711885+0000","last_fullsized":"2024-09-15T23:56:32.711885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:42.489872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718643+0000","last_change":"2024-09-15T23:56:20.717899+0000","last_active":"2024-09-15T23:56:32.718643+0000","last_peered":"2024-09-15T23:56:32.718643+0000","last_clean":"2024-09-15T23:56:32.718643+0000","last_became_active":"2024-09-15T23:56:20.717637+0000","last_became_peered":"2024-09-15T23:56:20.717637+0000","last_unstale":"2024-09-15T23:56:32.718643+0000","last_undegraded":"2024-09-15T23:56:32.718643+0000","last_fullsized":"2024-09-15T23:56:32.718643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:35.866836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715991+0000","last_change":"2024-09-15T23:56:32.203656+0000","last_active":"2024-09-15T23:56:32.715991+0000","last_peered":"2024-09-15T23:56:32.715991+0000","last_clean":"2024-09-15T23:56:32.715991+0000","last_became_active":"2024-09-15T23:56:32.203418+0000","last_became_peered":"2024-09-15T23:56:32.203418+0000","last_unstale":"2024-09-15T23:56:32.715991+0000","last_undegraded":"2024-09-15T23:56:32.715991+0000","last_fullsized":"2024-09-15T23:56:32.715991+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:03.517172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736566+0000","last_change":"2024-09-15T23:56:32.728920+0000","last_active":"2024-09-15T23:56:32.736566+0000","last_peered":"2024-09-15T23:56:32.736566+0000","last_clean":"2024-09-15T23:56:32.736566+0000","last_became_active":"2024-09-15T23:56:32.727197+0000","last_became_peered":"2024-09-15T23:56:32.727197+0000","last_unstale":"2024-09-15T23:56:32.736566+0000","last_undegraded":"2024-09-15T23:56:32.736566+0000","last_fullsized":"2024-09-15T23:56:32.736566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:54.214534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710560+0000","last_change":"2024-09-15T23:56:20.690224+0000","last_active":"2024-09-15T23:56:32.710560+0000","last_peered":"2024-09-15T23:56:32.710560+0000","last_clean":"2024-09-15T23:56:32.710560+0000","last_became_active":"2024-09-15T23:56:20.689916+0000","last_became_peered":"2024-09-15T23:56:20.689916+0000","last_unstale":"2024-09-15T23:56:32.710560+0000","last_undegraded":"2024-09-15T23:56:32.710560+0000","last_fullsized":"2024-09-15T23:56:32.710560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:02:28.483230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710862+0000","last_change":"2024-09-15T23:56:19.684703+0000","last_active":"2024-09-15T23:56:32.710862+0000","last_peered":"2024-09-15T23:56:32.710862+0000","last_clean":"2024-09-15T23:56:32.710862+0000","last_became_active":"2024-09-15T23:56:19.684441+0000","last_became_peered":"2024-09-15T23:56:19.684441+0000","last_unstale":"2024-09-15T23:56:32.710862+0000","last_undegraded":"2024-09-15T23:56:32.710862+0000","last_fullsized":"2024-09-15T23:56:32.710862+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:13.823041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712078+0000","last_change":"2024-09-15T23:56:32.201470+0000","last_active":"2024-09-15T23:56:32.712078+0000","last_peered":"2024-09-15T23:56:32.712078+0000","last_clean":"2024-09-15T23:56:32.712078+0000","last_became_active":"2024-09-15T23:56:32.201230+0000","last_became_peered":"2024-09-15T23:56:32.201230+0000","last_unstale":"2024-09-15T23:56:32.712078+0000","last_undegraded":"2024-09-15T23:56:32.712078+0000","last_fullsized":"2024-09-15T23:56:32.712078+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:19.539777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740280+0000","last_change":"2024-09-15T23:56:32.735510+0000","last_active":"2024-09-15T23:56:32.740280+0000","last_peered":"2024-09-15T23:56:32.740280+0000","last_clean":"2024-09-15T23:56:32.740280+0000","last_became_active":"2024-09-15T23:56:32.733533+0000","last_became_peered":"2024-09-15T23:56:32.733533+0000","last_unstale":"2024-09-15T23:56:32.740280+0000","last_undegraded":"2024-09-15T23:56:32.740280+0000","last_fullsized":"2024-09-15T23:56:32.740280+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:11.261525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716824+0000","last_change":"2024-09-15T23:56:20.710702+0000","last_active":"2024-09-15T23:56:32.716824+0000","last_peered":"2024-09-15T23:56:32.716824+0000","last_clean":"2024-09-15T23:56:32.716824+0000","last_became_active":"2024-09-15T23:56:20.710181+0000","last_became_peered":"2024-09-15T23:56:20.710181+0000","last_unstale":"2024-09-15T23:56:32.716824+0000","last_undegraded":"2024-09-15T23:56:32.716824+0000","last_fullsized":"2024-09-15T23:56:32.716824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:37.272992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708339+0000","last_change":"2024-09-15T23:56:19.694797+0000","last_active":"2024-09-15T23:56:32.708339+0000","last_peered":"2024-09-15T23:56:32.708339+0000","last_clean":"2024-09-15T23:56:32.708339+0000","last_became_active":"2024-09-15T23:56:19.694510+0000","last_became_peered":"2024-09-15T23:56:19.694510+0000","last_unstale":"2024-09-15T23:56:32.708339+0000","last_undegraded":"2024-09-15T23:56:32.708339+0000","last_fullsized":"2024-09-15T23:56:32.708339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:20.863085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720791+0000","last_change":"2024-09-15T23:56:32.200673+0000","last_active":"2024-09-15T23:56:32.720791+0000","last_peered":"2024-09-15T23:56:32.720791+0000","last_clean":"2024-09-15T23:56:32.720791+0000","last_became_active":"2024-09-15T23:56:32.199901+0000","last_became_peered":"2024-09-15T23:56:32.199901+0000","last_unstale":"2024-09-15T23:56:32.720791+0000","last_undegraded":"2024-09-15T23:56:32.720791+0000","last_fullsized":"2024-09-15T23:56:32.720791+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:56.564856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740356+0000","last_change":"2024-09-15T23:56:32.736263+0000","last_active":"2024-09-15T23:56:32.740356+0000","last_peered":"2024-09-15T23:56:32.740356+0000","last_clean":"2024-09-15T23:56:32.740356+0000","last_became_active":"2024-09-15T23:56:32.736003+0000","last_became_peered":"2024-09-15T23:56:32.736003+0000","last_unstale":"2024-09-15T23:56:32.740356+0000","last_undegraded":"2024-09-15T23:56:32.740356+0000","last_fullsized":"2024-09-15T23:56:32.740356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:07.390533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716420+0000","last_change":"2024-09-15T23:56:20.714759+0000","last_active":"2024-09-15T23:56:32.716420+0000","last_peered":"2024-09-15T23:56:32.716420+0000","last_clean":"2024-09-15T23:56:32.716420+0000","last_became_active":"2024-09-15T23:56:20.714471+0000","last_became_peered":"2024-09-15T23:56:20.714471+0000","last_unstale":"2024-09-15T23:56:32.716420+0000","last_undegraded":"2024-09-15T23:56:32.716420+0000","last_fullsized":"2024-09-15T23:56:32.716420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:41.793281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718304+0000","last_change":"2024-09-15T23:56:19.694373+0000","last_active":"2024-09-15T23:56:32.718304+0000","last_peered":"2024-09-15T23:56:32.718304+0000","last_clean":"2024-09-15T23:56:32.718304+0000","last_became_active":"2024-09-15T23:56:19.694083+0000","last_became_peered":"2024-09-15T23:56:19.694083+0000","last_unstale":"2024-09-15T23:56:32.718304+0000","last_undegraded":"2024-09-15T23:56:32.718304+0000","last_fullsized":"2024-09-15T23:56:32.718304+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:26.777939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716456+0000","last_change":"2024-09-15T23:56:32.200998+0000","last_active":"2024-09-15T23:56:32.716456+0000","last_peered":"2024-09-15T23:56:32.716456+0000","last_clean":"2024-09-15T23:56:32.716456+0000","last_became_active":"2024-09-15T23:56:32.200749+0000","last_became_peered":"2024-09-15T23:56:32.200749+0000","last_unstale":"2024-09-15T23:56:32.716456+0000","last_undegraded":"2024-09-15T23:56:32.716456+0000","last_fullsized":"2024-09-15T23:56:32.716456+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:21.095934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725026+0000","last_change":"2024-09-15T23:56:32.719019+0000","last_active":"2024-09-15T23:56:32.725026+0000","last_peered":"2024-09-15T23:56:32.725026+0000","last_clean":"2024-09-15T23:56:32.725026+0000","last_became_active":"2024-09-15T23:56:32.718463+0000","last_became_peered":"2024-09-15T23:56:32.718463+0000","last_unstale":"2024-09-15T23:56:32.725026+0000","last_undegraded":"2024-09-15T23:56:32.725026+0000","last_fullsized":"2024-09-15T23:56:32.725026+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:12.850257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708971+0000","last_change":"2024-09-15T23:56:20.694489+0000","last_active":"2024-09-15T23:56:32.708971+0000","last_peered":"2024-09-15T23:56:32.708971+0000","last_clean":"2024-09-15T23:56:32.708971+0000","last_became_active":"2024-09-15T23:56:20.694192+0000","last_became_peered":"2024-09-15T23:56:20.694192+0000","last_unstale":"2024-09-15T23:56:32.708971+0000","last_undegraded":"2024-09-15T23:56:32.708971+0000","last_fullsized":"2024-09-15T23:56:32.708971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:21.358922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708460+0000","last_change":"2024-09-15T23:56:19.686245+0000","last_active":"2024-09-15T23:56:32.708460+0000","last_peered":"2024-09-15T23:56:32.708460+0000","last_clean":"2024-09-15T23:56:32.708460+0000","last_became_active":"2024-09-15T23:56:19.685062+0000","last_became_peered":"2024-09-15T23:56:19.685062+0000","last_unstale":"2024-09-15T23:56:32.708460+0000","last_undegraded":"2024-09-15T23:56:32.708460+0000","last_fullsized":"2024-09-15T23:56:32.708460+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:20.077992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720922+0000","last_change":"2024-09-15T23:56:32.207745+0000","last_active":"2024-09-15T23:56:32.720922+0000","last_peered":"2024-09-15T23:56:32.720922+0000","last_clean":"2024-09-15T23:56:32.720922+0000","last_became_active":"2024-09-15T23:56:32.207486+0000","last_became_peered":"2024-09-15T23:56:32.207486+0000","last_unstale":"2024-09-15T23:56:32.720922+0000","last_undegraded":"2024-09-15T23:56:32.720922+0000","last_fullsized":"2024-09-15T23:56:32.720922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:47.637850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740292+0000","last_change":"2024-09-15T23:56:32.736351+0000","last_active":"2024-09-15T23:56:32.740292+0000","last_peered":"2024-09-15T23:56:32.740292+0000","last_clean":"2024-09-15T23:56:32.740292+0000","last_became_active":"2024-09-15T23:56:32.732018+0000","last_became_peered":"2024-09-15T23:56:32.732018+0000","last_unstale":"2024-09-15T23:56:32.740292+0000","last_undegraded":"2024-09-15T23:56:32.740292+0000","last_fullsized":"2024-09-15T23:56:32.740292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:09.852421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.722450+0000","last_change":"2024-09-15T23:56:20.709982+0000","last_active":"2024-09-15T23:56:32.722450+0000","last_peered":"2024-09-15T23:56:32.722450+0000","last_clean":"2024-09-15T23:56:32.722450+0000","last_became_active":"2024-09-15T23:56:20.709656+0000","last_became_peered":"2024-09-15T23:56:20.709656+0000","last_unstale":"2024-09-15T23:56:32.722450+0000","last_undegraded":"2024-09-15T23:56:32.722450+0000","last_fullsized":"2024-09-15T23:56:32.722450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:36.642813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710682+0000","last_change":"2024-09-15T23:56:19.699142+0000","last_active":"2024-09-15T23:56:32.710682+0000","last_peered":"2024-09-15T23:56:32.710682+0000","last_clean":"2024-09-15T23:56:32.710682+0000","last_became_active":"2024-09-15T23:56:19.698665+0000","last_became_peered":"2024-09-15T23:56:19.698665+0000","last_unstale":"2024-09-15T23:56:32.710682+0000","last_undegraded":"2024-09-15T23:56:32.710682+0000","last_fullsized":"2024-09-15T23:56:32.710682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.527319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716287+0000","last_change":"2024-09-15T23:56:32.204570+0000","last_active":"2024-09-15T23:56:32.716287+0000","last_peered":"2024-09-15T23:56:32.716287+0000","last_clean":"2024-09-15T23:56:32.716287+0000","last_became_active":"2024-09-15T23:56:32.204356+0000","last_became_peered":"2024-09-15T23:56:32.204356+0000","last_unstale":"2024-09-15T23:56:32.716287+0000","last_undegraded":"2024-09-15T23:56:32.716287+0000","last_fullsized":"2024-09-15T23:56:32.716287+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:49.754469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.734628+0000","last_change":"2024-09-15T23:56:32.729564+0000","last_active":"2024-09-15T23:56:32.734628+0000","last_peered":"2024-09-15T23:56:32.734628+0000","last_clean":"2024-09-15T23:56:32.734628+0000","last_became_active":"2024-09-15T23:56:32.729328+0000","last_became_peered":"2024-09-15T23:56:32.729328+0000","last_unstale":"2024-09-15T23:56:32.734628+0000","last_undegraded":"2024-09-15T23:56:32.734628+0000","last_fullsized":"2024-09-15T23:56:32.734628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.610955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712189+0000","last_change":"2024-09-15T23:56:20.708841+0000","last_active":"2024-09-15T23:56:32.712189+0000","last_peered":"2024-09-15T23:56:32.712189+0000","last_clean":"2024-09-15T23:56:32.712189+0000","last_became_active":"2024-09-15T23:56:20.708403+0000","last_became_peered":"2024-09-15T23:56:20.708403+0000","last_unstale":"2024-09-15T23:56:32.712189+0000","last_undegraded":"2024-09-15T23:56:32.712189+0000","last_fullsized":"2024-09-15T23:56:32.712189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:41.947981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716164+0000","last_change":"2024-09-15T23:56:19.684807+0000","last_active":"2024-09-15T23:56:32.716164+0000","last_peered":"2024-09-15T23:56:32.716164+0000","last_clean":"2024-09-15T23:56:32.716164+0000","last_became_active":"2024-09-15T23:56:19.684546+0000","last_became_peered":"2024-09-15T23:56:19.684546+0000","last_unstale":"2024-09-15T23:56:32.716164+0000","last_undegraded":"2024-09-15T23:56:32.716164+0000","last_fullsized":"2024-09-15T23:56:32.716164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:00.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709550+0000","last_change":"2024-09-15T23:56:32.202007+0000","last_active":"2024-09-15T23:56:32.709550+0000","last_peered":"2024-09-15T23:56:32.709550+0000","last_clean":"2024-09-15T23:56:32.709550+0000","last_became_active":"2024-09-15T23:56:32.201674+0000","last_became_peered":"2024-09-15T23:56:32.201674+0000","last_unstale":"2024-09-15T23:56:32.709550+0000","last_undegraded":"2024-09-15T23:56:32.709550+0000","last_fullsized":"2024-09-15T23:56:32.709550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:21:15.406693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737720+0000","last_change":"2024-09-15T23:56:32.733754+0000","last_active":"2024-09-15T23:56:32.737720+0000","last_peered":"2024-09-15T23:56:32.737720+0000","last_clean":"2024-09-15T23:56:32.737720+0000","last_became_active":"2024-09-15T23:56:32.732892+0000","last_became_peered":"2024-09-15T23:56:32.732892+0000","last_unstale":"2024-09-15T23:56:32.737720+0000","last_undegraded":"2024-09-15T23:56:32.737720+0000","last_fullsized":"2024-09-15T23:56:32.737720+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:29.719862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719301+0000","last_change":"2024-09-15T23:56:20.712020+0000","last_active":"2024-09-15T23:56:32.719301+0000","last_peered":"2024-09-15T23:56:32.719301+0000","last_clean":"2024-09-15T23:56:32.719301+0000","last_became_active":"2024-09-15T23:56:20.709304+0000","last_became_peered":"2024-09-15T23:56:20.709304+0000","last_unstale":"2024-09-15T23:56:32.719301+0000","last_undegraded":"2024-09-15T23:56:32.719301+0000","last_fullsized":"2024-09-15T23:56:32.719301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:31.374837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715415+0000","last_change":"2024-09-15T23:56:19.682125+0000","last_active":"2024-09-15T23:56:32.715415+0000","last_peered":"2024-09-15T23:56:32.715415+0000","last_clean":"2024-09-15T23:56:32.715415+0000","last_became_active":"2024-09-15T23:56:19.681850+0000","last_became_peered":"2024-09-15T23:56:19.681850+0000","last_unstale":"2024-09-15T23:56:32.715415+0000","last_undegraded":"2024-09-15T23:56:32.715415+0000","last_fullsized":"2024-09-15T23:56:32.715415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:32.863735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712004+0000","last_change":"2024-09-15T23:56:32.198777+0000","last_active":"2024-09-15T23:56:32.712004+0000","last_peered":"2024-09-15T23:56:32.712004+0000","last_clean":"2024-09-15T23:56:32.712004+0000","last_became_active":"2024-09-15T23:56:32.198526+0000","last_became_peered":"2024-09-15T23:56:32.198526+0000","last_unstale":"2024-09-15T23:56:32.712004+0000","last_undegraded":"2024-09-15T23:56:32.712004+0000","last_fullsized":"2024-09-15T23:56:32.712004+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:21.203587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737930+0000","last_change":"2024-09-15T23:56:32.734522+0000","last_active":"2024-09-15T23:56:32.737930+0000","last_peered":"2024-09-15T23:56:32.737930+0000","last_clean":"2024-09-15T23:56:32.737930+0000","last_became_active":"2024-09-15T23:56:32.733483+0000","last_became_peered":"2024-09-15T23:56:32.733483+0000","last_unstale":"2024-09-15T23:56:32.737930+0000","last_undegraded":"2024-09-15T23:56:32.737930+0000","last_fullsized":"2024-09-15T23:56:32.737930+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:58.909489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715200+0000","last_change":"2024-09-15T23:56:20.708412+0000","last_active":"2024-09-15T23:56:32.715200+0000","last_peered":"2024-09-15T23:56:32.715200+0000","last_clean":"2024-09-15T23:56:32.715200+0000","last_became_active":"2024-09-15T23:56:20.708170+0000","last_became_peered":"2024-09-15T23:56:20.708170+0000","last_unstale":"2024-09-15T23:56:32.715200+0000","last_undegraded":"2024-09-15T23:56:32.715200+0000","last_fullsized":"2024-09-15T23:56:32.715200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:53.313517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708339+0000","last_change":"2024-09-15T23:56:19.697356+0000","last_active":"2024-09-15T23:56:32.708339+0000","last_peered":"2024-09-15T23:56:32.708339+0000","last_clean":"2024-09-15T23:56:32.708339+0000","last_became_active":"2024-09-15T23:56:19.697077+0000","last_became_peered":"2024-09-15T23:56:19.697077+0000","last_unstale":"2024-09-15T23:56:32.708339+0000","last_undegraded":"2024-09-15T23:56:32.708339+0000","last_fullsized":"2024-09-15T23:56:32.708339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:11.467305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710622+0000","last_change":"2024-09-15T23:56:32.200392+0000","last_active":"2024-09-15T23:56:32.710622+0000","last_peered":"2024-09-15T23:56:32.710622+0000","last_clean":"2024-09-15T23:56:32.710622+0000","last_became_active":"2024-09-15T23:56:32.200036+0000","last_became_peered":"2024-09-15T23:56:32.200036+0000","last_unstale":"2024-09-15T23:56:32.710622+0000","last_undegraded":"2024-09-15T23:56:32.710622+0000","last_fullsized":"2024-09-15T23:56:32.710622+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:56:09.399425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737913+0000","last_change":"2024-09-15T23:56:32.735104+0000","last_active":"2024-09-15T23:56:32.737913+0000","last_peered":"2024-09-15T23:56:32.737913+0000","last_clean":"2024-09-15T23:56:32.737913+0000","last_became_active":"2024-09-15T23:56:32.733798+0000","last_became_peered":"2024-09-15T23:56:32.733798+0000","last_unstale":"2024-09-15T23:56:32.737913+0000","last_undegraded":"2024-09-15T23:56:32.737913+0000","last_fullsized":"2024-09-15T23:56:32.737913+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:13.087452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708559+0000","last_change":"2024-09-15T23:56:20.690625+0000","last_active":"2024-09-15T23:56:32.708559+0000","last_peered":"2024-09-15T23:56:32.708559+0000","last_clean":"2024-09-15T23:56:32.708559+0000","last_became_active":"2024-09-15T23:56:20.690008+0000","last_became_peered":"2024-09-15T23:56:20.690008+0000","last_unstale":"2024-09-15T23:56:32.708559+0000","last_undegraded":"2024-09-15T23:56:32.708559+0000","last_fullsized":"2024-09-15T23:56:32.708559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:13.648713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716411+0000","last_change":"2024-09-15T23:56:19.699847+0000","last_active":"2024-09-15T23:56:32.716411+0000","last_peered":"2024-09-15T23:56:32.716411+0000","last_clean":"2024-09-15T23:56:32.716411+0000","last_became_active":"2024-09-15T23:56:19.698457+0000","last_became_peered":"2024-09-15T23:56:19.698457+0000","last_unstale":"2024-09-15T23:56:32.716411+0000","last_undegraded":"2024-09-15T23:56:32.716411+0000","last_fullsized":"2024-09-15T23:56:32.716411+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:46.631722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709289+0000","last_change":"2024-09-15T23:56:32.200431+0000","last_active":"2024-09-15T23:56:32.709289+0000","last_peered":"2024-09-15T23:56:32.709289+0000","last_clean":"2024-09-15T23:56:32.709289+0000","last_became_active":"2024-09-15T23:56:32.200136+0000","last_became_peered":"2024-09-15T23:56:32.200136+0000","last_unstale":"2024-09-15T23:56:32.709289+0000","last_undegraded":"2024-09-15T23:56:32.709289+0000","last_fullsized":"2024-09-15T23:56:32.709289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:48.655628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736200+0000","last_change":"2024-09-15T23:56:32.732910+0000","last_active":"2024-09-15T23:56:32.736200+0000","last_peered":"2024-09-15T23:56:32.736200+0000","last_clean":"2024-09-15T23:56:32.736200+0000","last_became_active":"2024-09-15T23:56:32.732472+0000","last_became_peered":"2024-09-15T23:56:32.732472+0000","last_unstale":"2024-09-15T23:56:32.736200+0000","last_undegraded":"2024-09-15T23:56:32.736200+0000","last_fullsized":"2024-09-15T23:56:32.736200+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:13.171460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709096+0000","last_change":"2024-09-15T23:56:20.710375+0000","last_active":"2024-09-15T23:56:32.709096+0000","last_peered":"2024-09-15T23:56:32.709096+0000","last_clean":"2024-09-15T23:56:32.709096+0000","last_became_active":"2024-09-15T23:56:20.707708+0000","last_became_peered":"2024-09-15T23:56:20.707708+0000","last_unstale":"2024-09-15T23:56:32.709096+0000","last_undegraded":"2024-09-15T23:56:32.709096+0000","last_fullsized":"2024-09-15T23:56:32.709096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:46.173174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709373+0000","last_change":"2024-09-15T23:56:19.699207+0000","last_active":"2024-09-15T23:56:32.709373+0000","last_peered":"2024-09-15T23:56:32.709373+0000","last_clean":"2024-09-15T23:56:32.709373+0000","last_became_active":"2024-09-15T23:56:19.698960+0000","last_became_peered":"2024-09-15T23:56:19.698960+0000","last_unstale":"2024-09-15T23:56:32.709373+0000","last_undegraded":"2024-09-15T23:56:32.709373+0000","last_fullsized":"2024-09-15T23:56:32.709373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:18.018681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":272,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719144+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:56:32.719144+0000","last_peered":"2024-09-15T23:56:32.719144+0000","last_clean":"2024-09-15T23:56:32.719144+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:56:32.719144+0000","last_undegraded":"2024-09-15T23:56:32.719144+0000","last_fullsized":"2024-09-15T23:56:32.719144+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708809+0000","last_change":"2024-09-15T23:56:32.198830+0000","last_active":"2024-09-15T23:56:32.708809+0000","last_peered":"2024-09-15T23:56:32.708809+0000","last_clean":"2024-09-15T23:56:32.708809+0000","last_became_active":"2024-09-15T23:56:32.198582+0000","last_became_peered":"2024-09-15T23:56:32.198582+0000","last_unstale":"2024-09-15T23:56:32.708809+0000","last_undegraded":"2024-09-15T23:56:32.708809+0000","last_fullsized":"2024-09-15T23:56:32.708809+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:24:22.152210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737895+0000","last_change":"2024-09-15T23:56:32.734347+0000","last_active":"2024-09-15T23:56:32.737895+0000","last_peered":"2024-09-15T23:56:32.737895+0000","last_clean":"2024-09-15T23:56:32.737895+0000","last_became_active":"2024-09-15T23:56:32.733146+0000","last_became_peered":"2024-09-15T23:56:32.733146+0000","last_unstale":"2024-09-15T23:56:32.737895+0000","last_undegraded":"2024-09-15T23:56:32.737895+0000","last_fullsized":"2024-09-15T23:56:32.737895+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:16:01.465532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715704+0000","last_change":"2024-09-15T23:56:20.708879+0000","last_active":"2024-09-15T23:56:32.715704+0000","last_peered":"2024-09-15T23:56:32.715704+0000","last_clean":"2024-09-15T23:56:32.715704+0000","last_became_active":"2024-09-15T23:56:20.707893+0000","last_became_peered":"2024-09-15T23:56:20.707893+0000","last_unstale":"2024-09-15T23:56:32.715704+0000","last_undegraded":"2024-09-15T23:56:32.715704+0000","last_fullsized":"2024-09-15T23:56:32.715704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:03.270640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708472+0000","last_change":"2024-09-15T23:56:19.696843+0000","last_active":"2024-09-15T23:56:32.708472+0000","last_peered":"2024-09-15T23:56:32.708472+0000","last_clean":"2024-09-15T23:56:32.708472+0000","last_became_active":"2024-09-15T23:56:19.695192+0000","last_became_peered":"2024-09-15T23:56:19.695192+0000","last_unstale":"2024-09-15T23:56:32.708472+0000","last_undegraded":"2024-09-15T23:56:32.708472+0000","last_fullsized":"2024-09-15T23:56:32.708472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:07.169275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719026+0000","last_change":"2024-09-15T23:56:32.199555+0000","last_active":"2024-09-15T23:56:32.719026+0000","last_peered":"2024-09-15T23:56:32.719026+0000","last_clean":"2024-09-15T23:56:32.719026+0000","last_became_active":"2024-09-15T23:56:32.199290+0000","last_became_peered":"2024-09-15T23:56:32.199290+0000","last_unstale":"2024-09-15T23:56:32.719026+0000","last_undegraded":"2024-09-15T23:56:32.719026+0000","last_fullsized":"2024-09-15T23:56:32.719026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:32.741851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.740376+0000","last_change":"2024-09-15T23:56:32.736298+0000","last_active":"2024-09-15T23:56:32.740376+0000","last_peered":"2024-09-15T23:56:32.740376+0000","last_clean":"2024-09-15T23:56:32.740376+0000","last_became_active":"2024-09-15T23:56:32.735749+0000","last_became_peered":"2024-09-15T23:56:32.735749+0000","last_unstale":"2024-09-15T23:56:32.740376+0000","last_undegraded":"2024-09-15T23:56:32.740376+0000","last_fullsized":"2024-09-15T23:56:32.740376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:12.038789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721056+0000","last_change":"2024-09-15T23:56:20.712560+0000","last_active":"2024-09-15T23:56:32.721056+0000","last_peered":"2024-09-15T23:56:32.721056+0000","last_clean":"2024-09-15T23:56:32.721056+0000","last_became_active":"2024-09-15T23:56:20.712104+0000","last_became_peered":"2024-09-15T23:56:20.712104+0000","last_unstale":"2024-09-15T23:56:32.721056+0000","last_undegraded":"2024-09-15T23:56:32.721056+0000","last_fullsized":"2024-09-15T23:56:32.721056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:08.172185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718271+0000","last_change":"2024-09-15T23:56:19.689550+0000","last_active":"2024-09-15T23:56:32.718271+0000","last_peered":"2024-09-15T23:56:32.718271+0000","last_clean":"2024-09-15T23:56:32.718271+0000","last_became_active":"2024-09-15T23:56:19.689285+0000","last_became_peered":"2024-09-15T23:56:19.689285+0000","last_unstale":"2024-09-15T23:56:32.718271+0000","last_undegraded":"2024-09-15T23:56:32.718271+0000","last_fullsized":"2024-09-15T23:56:32.718271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:16.810725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.723854+0000","last_change":"2024-09-15T23:56:32.209239+0000","last_active":"2024-09-15T23:56:32.723854+0000","last_peered":"2024-09-15T23:56:32.723854+0000","last_clean":"2024-09-15T23:56:32.723854+0000","last_became_active":"2024-09-15T23:56:32.208942+0000","last_became_peered":"2024-09-15T23:56:32.208942+0000","last_unstale":"2024-09-15T23:56:32.723854+0000","last_undegraded":"2024-09-15T23:56:32.723854+0000","last_fullsized":"2024-09-15T23:56:32.723854+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:53.544616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736649+0000","last_change":"2024-09-15T23:56:32.733399+0000","last_active":"2024-09-15T23:56:32.736649+0000","last_peered":"2024-09-15T23:56:32.736649+0000","last_clean":"2024-09-15T23:56:32.736649+0000","last_became_active":"2024-09-15T23:56:32.731898+0000","last_became_peered":"2024-09-15T23:56:32.731898+0000","last_unstale":"2024-09-15T23:56:32.736649+0000","last_undegraded":"2024-09-15T23:56:32.736649+0000","last_fullsized":"2024-09-15T23:56:32.736649+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:58.676257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716482+0000","last_change":"2024-09-15T23:56:20.710525+0000","last_active":"2024-09-15T23:56:32.716482+0000","last_peered":"2024-09-15T23:56:32.716482+0000","last_clean":"2024-09-15T23:56:32.716482+0000","last_became_active":"2024-09-15T23:56:20.709915+0000","last_became_peered":"2024-09-15T23:56:20.709915+0000","last_unstale":"2024-09-15T23:56:32.716482+0000","last_undegraded":"2024-09-15T23:56:32.716482+0000","last_fullsized":"2024-09-15T23:56:32.716482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:13.590246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716495+0000","last_change":"2024-09-15T23:56:19.691077+0000","last_active":"2024-09-15T23:56:32.716495+0000","last_peered":"2024-09-15T23:56:32.716495+0000","last_clean":"2024-09-15T23:56:32.716495+0000","last_became_active":"2024-09-15T23:56:19.687845+0000","last_became_peered":"2024-09-15T23:56:19.687845+0000","last_unstale":"2024-09-15T23:56:32.716495+0000","last_undegraded":"2024-09-15T23:56:32.716495+0000","last_fullsized":"2024-09-15T23:56:32.716495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:04.973037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715604+0000","last_change":"2024-09-15T23:56:32.207971+0000","last_active":"2024-09-15T23:56:32.715604+0000","last_peered":"2024-09-15T23:56:32.715604+0000","last_clean":"2024-09-15T23:56:32.715604+0000","last_became_active":"2024-09-15T23:56:32.207686+0000","last_became_peered":"2024-09-15T23:56:32.207686+0000","last_unstale":"2024-09-15T23:56:32.715604+0000","last_undegraded":"2024-09-15T23:56:32.715604+0000","last_fullsized":"2024-09-15T23:56:32.715604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:13.814315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727660+0000","last_change":"2024-09-15T23:56:32.719964+0000","last_active":"2024-09-15T23:56:32.727660+0000","last_peered":"2024-09-15T23:56:32.727660+0000","last_clean":"2024-09-15T23:56:32.727660+0000","last_became_active":"2024-09-15T23:56:32.719699+0000","last_became_peered":"2024-09-15T23:56:32.719699+0000","last_unstale":"2024-09-15T23:56:32.727660+0000","last_undegraded":"2024-09-15T23:56:32.727660+0000","last_fullsized":"2024-09-15T23:56:32.727660+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:22.475445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709520+0000","last_change":"2024-09-15T23:56:20.694615+0000","last_active":"2024-09-15T23:56:32.709520+0000","last_peered":"2024-09-15T23:56:32.709520+0000","last_clean":"2024-09-15T23:56:32.709520+0000","last_became_active":"2024-09-15T23:56:20.692669+0000","last_became_peered":"2024-09-15T23:56:20.692669+0000","last_unstale":"2024-09-15T23:56:32.709520+0000","last_undegraded":"2024-09-15T23:56:32.709520+0000","last_fullsized":"2024-09-15T23:56:32.709520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.075768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718600+0000","last_change":"2024-09-15T23:56:19.692305+0000","last_active":"2024-09-15T23:56:32.718600+0000","last_peered":"2024-09-15T23:56:32.718600+0000","last_clean":"2024-09-15T23:56:32.718600+0000","last_became_active":"2024-09-15T23:56:19.692025+0000","last_became_peered":"2024-09-15T23:56:19.692025+0000","last_unstale":"2024-09-15T23:56:32.718600+0000","last_undegraded":"2024-09-15T23:56:32.718600+0000","last_fullsized":"2024-09-15T23:56:32.718600+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:32.822239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721936+0000","last_change":"2024-09-15T23:56:32.206741+0000","last_active":"2024-09-15T23:56:32.721936+0000","last_peered":"2024-09-15T23:56:32.721936+0000","last_clean":"2024-09-15T23:56:32.721936+0000","last_became_active":"2024-09-15T23:56:32.206500+0000","last_became_peered":"2024-09-15T23:56:32.206500+0000","last_unstale":"2024-09-15T23:56:32.721936+0000","last_undegraded":"2024-09-15T23:56:32.721936+0000","last_fullsized":"2024-09-15T23:56:32.721936+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:15.807132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730784+0000","last_change":"2024-09-15T23:56:32.725774+0000","last_active":"2024-09-15T23:56:32.730784+0000","last_peered":"2024-09-15T23:56:32.730784+0000","last_clean":"2024-09-15T23:56:32.730784+0000","last_became_active":"2024-09-15T23:56:32.725514+0000","last_became_peered":"2024-09-15T23:56:32.725514+0000","last_unstale":"2024-09-15T23:56:32.730784+0000","last_undegraded":"2024-09-15T23:56:32.730784+0000","last_fullsized":"2024-09-15T23:56:32.730784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:58.932334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718912+0000","last_change":"2024-09-15T23:56:20.710955+0000","last_active":"2024-09-15T23:56:32.718912+0000","last_peered":"2024-09-15T23:56:32.718912+0000","last_clean":"2024-09-15T23:56:32.718912+0000","last_became_active":"2024-09-15T23:56:20.710010+0000","last_became_peered":"2024-09-15T23:56:20.710010+0000","last_unstale":"2024-09-15T23:56:32.718912+0000","last_undegraded":"2024-09-15T23:56:32.718912+0000","last_fullsized":"2024-09-15T23:56:32.718912+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:24.036402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716651+0000","last_change":"2024-09-15T23:56:19.698114+0000","last_active":"2024-09-15T23:56:32.716651+0000","last_peered":"2024-09-15T23:56:32.716651+0000","last_clean":"2024-09-15T23:56:32.716651+0000","last_became_active":"2024-09-15T23:56:19.697798+0000","last_became_peered":"2024-09-15T23:56:19.697798+0000","last_unstale":"2024-09-15T23:56:32.716651+0000","last_undegraded":"2024-09-15T23:56:32.716651+0000","last_fullsized":"2024-09-15T23:56:32.716651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:08.484696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716091+0000","last_change":"2024-09-15T23:56:32.206648+0000","last_active":"2024-09-15T23:56:32.716091+0000","last_peered":"2024-09-15T23:56:32.716091+0000","last_clean":"2024-09-15T23:56:32.716091+0000","last_became_active":"2024-09-15T23:56:32.206312+0000","last_became_peered":"2024-09-15T23:56:32.206312+0000","last_unstale":"2024-09-15T23:56:32.716091+0000","last_undegraded":"2024-09-15T23:56:32.716091+0000","last_fullsized":"2024-09-15T23:56:32.716091+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:10.072338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736499+0000","last_change":"2024-09-15T23:56:32.732333+0000","last_active":"2024-09-15T23:56:32.736499+0000","last_peered":"2024-09-15T23:56:32.736499+0000","last_clean":"2024-09-15T23:56:32.736499+0000","last_became_active":"2024-09-15T23:56:32.731986+0000","last_became_peered":"2024-09-15T23:56:32.731986+0000","last_unstale":"2024-09-15T23:56:32.736499+0000","last_undegraded":"2024-09-15T23:56:32.736499+0000","last_fullsized":"2024-09-15T23:56:32.736499+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:17.543131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719251+0000","last_change":"2024-09-15T23:56:32.204658+0000","last_active":"2024-09-15T23:56:32.719251+0000","last_peered":"2024-09-15T23:56:32.719251+0000","last_clean":"2024-09-15T23:56:32.719251+0000","last_became_active":"2024-09-15T23:56:32.204403+0000","last_became_peered":"2024-09-15T23:56:32.204403+0000","last_unstale":"2024-09-15T23:56:32.719251+0000","last_undegraded":"2024-09-15T23:56:32.719251+0000","last_fullsized":"2024-09-15T23:56:32.719251+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:21.777398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715231+0000","last_change":"2024-09-15T23:56:20.716218+0000","last_active":"2024-09-15T23:56:32.715231+0000","last_peered":"2024-09-15T23:56:32.715231+0000","last_clean":"2024-09-15T23:56:32.715231+0000","last_became_active":"2024-09-15T23:56:20.715898+0000","last_became_peered":"2024-09-15T23:56:20.715898+0000","last_unstale":"2024-09-15T23:56:32.715231+0000","last_undegraded":"2024-09-15T23:56:32.715231+0000","last_fullsized":"2024-09-15T23:56:32.715231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:11.938755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":28,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708348+0000","last_change":"2024-09-15T23:56:19.700486+0000","last_active":"2024-09-15T23:56:32.708348+0000","last_peered":"2024-09-15T23:56:32.708348+0000","last_clean":"2024-09-15T23:56:32.708348+0000","last_became_active":"2024-09-15T23:56:19.697214+0000","last_became_peered":"2024-09-15T23:56:19.697214+0000","last_unstale":"2024-09-15T23:56:32.708348+0000","last_undegraded":"2024-09-15T23:56:32.708348+0000","last_fullsized":"2024-09-15T23:56:32.708348+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:29.487850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727808+0000","last_change":"2024-09-15T23:56:32.720778+0000","last_active":"2024-09-15T23:56:32.727808+0000","last_peered":"2024-09-15T23:56:32.727808+0000","last_clean":"2024-09-15T23:56:32.727808+0000","last_became_active":"2024-09-15T23:56:32.720521+0000","last_became_peered":"2024-09-15T23:56:32.720521+0000","last_unstale":"2024-09-15T23:56:32.727808+0000","last_undegraded":"2024-09-15T23:56:32.727808+0000","last_fullsized":"2024-09-15T23:56:32.727808+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:03.647972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712163+0000","last_change":"2024-09-15T23:56:32.201583+0000","last_active":"2024-09-15T23:56:32.712163+0000","last_peered":"2024-09-15T23:56:32.712163+0000","last_clean":"2024-09-15T23:56:32.712163+0000","last_became_active":"2024-09-15T23:56:32.201370+0000","last_became_peered":"2024-09-15T23:56:32.201370+0000","last_unstale":"2024-09-15T23:56:32.712163+0000","last_undegraded":"2024-09-15T23:56:32.712163+0000","last_fullsized":"2024-09-15T23:56:32.712163+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:39.445210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719420+0000","last_change":"2024-09-15T23:56:20.710055+0000","last_active":"2024-09-15T23:56:32.719420+0000","last_peered":"2024-09-15T23:56:32.719420+0000","last_clean":"2024-09-15T23:56:32.719420+0000","last_became_active":"2024-09-15T23:56:20.709780+0000","last_became_peered":"2024-09-15T23:56:20.709780+0000","last_unstale":"2024-09-15T23:56:32.719420+0000","last_undegraded":"2024-09-15T23:56:32.719420+0000","last_fullsized":"2024-09-15T23:56:32.719420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:26.341983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715081+0000","last_change":"2024-09-15T23:56:19.699359+0000","last_active":"2024-09-15T23:56:32.715081+0000","last_peered":"2024-09-15T23:56:32.715081+0000","last_clean":"2024-09-15T23:56:32.715081+0000","last_became_active":"2024-09-15T23:56:19.698476+0000","last_became_peered":"2024-09-15T23:56:19.698476+0000","last_unstale":"2024-09-15T23:56:32.715081+0000","last_undegraded":"2024-09-15T23:56:32.715081+0000","last_fullsized":"2024-09-15T23:56:32.715081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:05.758453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728136+0000","last_change":"2024-09-15T23:56:32.722140+0000","last_active":"2024-09-15T23:56:32.728136+0000","last_peered":"2024-09-15T23:56:32.728136+0000","last_clean":"2024-09-15T23:56:32.728136+0000","last_became_active":"2024-09-15T23:56:32.721224+0000","last_became_peered":"2024-09-15T23:56:32.721224+0000","last_unstale":"2024-09-15T23:56:32.728136+0000","last_undegraded":"2024-09-15T23:56:32.728136+0000","last_fullsized":"2024-09-15T23:56:32.728136+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:44:19.190101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712279+0000","last_change":"2024-09-15T23:56:20.708637+0000","last_active":"2024-09-15T23:56:32.712279+0000","last_peered":"2024-09-15T23:56:32.712279+0000","last_clean":"2024-09-15T23:56:32.712279+0000","last_became_active":"2024-09-15T23:56:20.708101+0000","last_became_peered":"2024-09-15T23:56:20.708101+0000","last_unstale":"2024-09-15T23:56:32.712279+0000","last_undegraded":"2024-09-15T23:56:32.712279+0000","last_fullsized":"2024-09-15T23:56:32.712279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:05.040048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708738+0000","last_change":"2024-09-15T23:56:19.700204+0000","last_active":"2024-09-15T23:56:32.708738+0000","last_peered":"2024-09-15T23:56:32.708738+0000","last_clean":"2024-09-15T23:56:32.708738+0000","last_became_active":"2024-09-15T23:56:19.699920+0000","last_became_peered":"2024-09-15T23:56:19.699920+0000","last_unstale":"2024-09-15T23:56:32.708738+0000","last_undegraded":"2024-09-15T23:56:32.708738+0000","last_fullsized":"2024-09-15T23:56:32.708738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:30.371927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725007+0000","last_change":"2024-09-15T23:56:32.207347+0000","last_active":"2024-09-15T23:56:32.725007+0000","last_peered":"2024-09-15T23:56:32.725007+0000","last_clean":"2024-09-15T23:56:32.725007+0000","last_became_active":"2024-09-15T23:56:32.207105+0000","last_became_peered":"2024-09-15T23:56:32.207105+0000","last_unstale":"2024-09-15T23:56:32.725007+0000","last_undegraded":"2024-09-15T23:56:32.725007+0000","last_fullsized":"2024-09-15T23:56:32.725007+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:41.837755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.725134+0000","last_change":"2024-09-15T23:56:32.719233+0000","last_active":"2024-09-15T23:56:32.725134+0000","last_peered":"2024-09-15T23:56:32.725134+0000","last_clean":"2024-09-15T23:56:32.725134+0000","last_became_active":"2024-09-15T23:56:32.718198+0000","last_became_peered":"2024-09-15T23:56:32.718198+0000","last_unstale":"2024-09-15T23:56:32.725134+0000","last_undegraded":"2024-09-15T23:56:32.725134+0000","last_fullsized":"2024-09-15T23:56:32.725134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:17.324681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716503+0000","last_change":"2024-09-15T23:56:20.696227+0000","last_active":"2024-09-15T23:56:32.716503+0000","last_peered":"2024-09-15T23:56:32.716503+0000","last_clean":"2024-09-15T23:56:32.716503+0000","last_became_active":"2024-09-15T23:56:20.695959+0000","last_became_peered":"2024-09-15T23:56:20.695959+0000","last_unstale":"2024-09-15T23:56:32.716503+0000","last_undegraded":"2024-09-15T23:56:32.716503+0000","last_fullsized":"2024-09-15T23:56:32.716503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:14.825952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":22,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716878+0000","last_change":"2024-09-15T23:56:19.696212+0000","last_active":"2024-09-15T23:56:32.716878+0000","last_peered":"2024-09-15T23:56:32.716878+0000","last_clean":"2024-09-15T23:56:32.716878+0000","last_became_active":"2024-09-15T23:56:19.695986+0000","last_became_peered":"2024-09-15T23:56:19.695986+0000","last_unstale":"2024-09-15T23:56:32.716878+0000","last_undegraded":"2024-09-15T23:56:32.716878+0000","last_fullsized":"2024-09-15T23:56:32.716878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:07.146610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712920+0000","last_change":"2024-09-15T23:56:32.203254+0000","last_active":"2024-09-15T23:56:32.712920+0000","last_peered":"2024-09-15T23:56:32.712920+0000","last_clean":"2024-09-15T23:56:32.712920+0000","last_became_active":"2024-09-15T23:56:32.203003+0000","last_became_peered":"2024-09-15T23:56:32.203003+0000","last_unstale":"2024-09-15T23:56:32.712920+0000","last_undegraded":"2024-09-15T23:56:32.712920+0000","last_fullsized":"2024-09-15T23:56:32.712920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:43.633540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737225+0000","last_change":"2024-09-15T23:56:32.735249+0000","last_active":"2024-09-15T23:56:32.737225+0000","last_peered":"2024-09-15T23:56:32.737225+0000","last_clean":"2024-09-15T23:56:32.737225+0000","last_became_active":"2024-09-15T23:56:32.735014+0000","last_became_peered":"2024-09-15T23:56:32.735014+0000","last_unstale":"2024-09-15T23:56:32.737225+0000","last_undegraded":"2024-09-15T23:56:32.737225+0000","last_fullsized":"2024-09-15T23:56:32.737225+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:48.865433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716338+0000","last_change":"2024-09-15T23:56:20.709094+0000","last_active":"2024-09-15T23:56:32.716338+0000","last_peered":"2024-09-15T23:56:32.716338+0000","last_clean":"2024-09-15T23:56:32.716338+0000","last_became_active":"2024-09-15T23:56:20.708654+0000","last_became_peered":"2024-09-15T23:56:20.708654+0000","last_unstale":"2024-09-15T23:56:32.716338+0000","last_undegraded":"2024-09-15T23:56:32.716338+0000","last_fullsized":"2024-09-15T23:56:32.716338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:39.903610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"41'12","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716277+0000","last_change":"2024-09-15T23:56:19.703061+0000","last_active":"2024-09-15T23:56:32.716277+0000","last_peered":"2024-09-15T23:56:32.716277+0000","last_clean":"2024-09-15T23:56:32.716277+0000","last_became_active":"2024-09-15T23:56:19.702750+0000","last_became_peered":"2024-09-15T23:56:19.702750+0000","last_unstale":"2024-09-15T23:56:32.716277+0000","last_undegraded":"2024-09-15T23:56:32.716277+0000","last_fullsized":"2024-09-15T23:56:32.716277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:23.575094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4248,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710511+0000","last_change":"2024-09-15T23:56:32.203939+0000","last_active":"2024-09-15T23:56:32.710511+0000","last_peered":"2024-09-15T23:56:32.710511+0000","last_clean":"2024-09-15T23:56:32.710511+0000","last_became_active":"2024-09-15T23:56:32.203686+0000","last_became_peered":"2024-09-15T23:56:32.203686+0000","last_unstale":"2024-09-15T23:56:32.710511+0000","last_undegraded":"2024-09-15T23:56:32.710511+0000","last_fullsized":"2024-09-15T23:56:32.710511+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:48.851672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736631+0000","last_change":"2024-09-15T23:56:32.733279+0000","last_active":"2024-09-15T23:56:32.736631+0000","last_peered":"2024-09-15T23:56:32.736631+0000","last_clean":"2024-09-15T23:56:32.736631+0000","last_became_active":"2024-09-15T23:56:32.733035+0000","last_became_peered":"2024-09-15T23:56:32.733035+0000","last_unstale":"2024-09-15T23:56:32.736631+0000","last_undegraded":"2024-09-15T23:56:32.736631+0000","last_fullsized":"2024-09-15T23:56:32.736631+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:54.451064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718096+0000","last_change":"2024-09-15T23:56:20.708385+0000","last_active":"2024-09-15T23:56:32.718096+0000","last_peered":"2024-09-15T23:56:32.718096+0000","last_clean":"2024-09-15T23:56:32.718096+0000","last_became_active":"2024-09-15T23:56:20.708115+0000","last_became_peered":"2024-09-15T23:56:20.708115+0000","last_unstale":"2024-09-15T23:56:32.718096+0000","last_undegraded":"2024-09-15T23:56:32.718096+0000","last_fullsized":"2024-09-15T23:56:32.718096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:21.865995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":23,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716588+0000","last_change":"2024-09-15T23:56:19.701230+0000","last_active":"2024-09-15T23:56:32.716588+0000","last_peered":"2024-09-15T23:56:32.716588+0000","last_clean":"2024-09-15T23:56:32.716588+0000","last_became_active":"2024-09-15T23:56:19.700977+0000","last_became_peered":"2024-09-15T23:56:19.700977+0000","last_unstale":"2024-09-15T23:56:32.716588+0000","last_undegraded":"2024-09-15T23:56:32.716588+0000","last_fullsized":"2024-09-15T23:56:32.716588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:25.148499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721793+0000","last_change":"2024-09-15T23:56:32.206496+0000","last_active":"2024-09-15T23:56:32.721793+0000","last_peered":"2024-09-15T23:56:32.721793+0000","last_clean":"2024-09-15T23:56:32.721793+0000","last_became_active":"2024-09-15T23:56:32.206291+0000","last_became_peered":"2024-09-15T23:56:32.206291+0000","last_unstale":"2024-09-15T23:56:32.721793+0000","last_undegraded":"2024-09-15T23:56:32.721793+0000","last_fullsized":"2024-09-15T23:56:32.721793+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:25.640696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735050+0000","last_change":"2024-09-15T23:56:32.731170+0000","last_active":"2024-09-15T23:56:32.735050+0000","last_peered":"2024-09-15T23:56:32.735050+0000","last_clean":"2024-09-15T23:56:32.735050+0000","last_became_active":"2024-09-15T23:56:32.730891+0000","last_became_peered":"2024-09-15T23:56:32.730891+0000","last_unstale":"2024-09-15T23:56:32.735050+0000","last_undegraded":"2024-09-15T23:56:32.735050+0000","last_fullsized":"2024-09-15T23:56:32.735050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:51.982360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720385+0000","last_change":"2024-09-15T23:56:20.705825+0000","last_active":"2024-09-15T23:56:32.720385+0000","last_peered":"2024-09-15T23:56:32.720385+0000","last_clean":"2024-09-15T23:56:32.720385+0000","last_became_active":"2024-09-15T23:56:20.705487+0000","last_became_peered":"2024-09-15T23:56:20.705487+0000","last_unstale":"2024-09-15T23:56:32.720385+0000","last_undegraded":"2024-09-15T23:56:32.720385+0000","last_fullsized":"2024-09-15T23:56:32.720385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:12.470216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708947+0000","last_change":"2024-09-15T23:56:19.684971+0000","last_active":"2024-09-15T23:56:32.708947+0000","last_peered":"2024-09-15T23:56:32.708947+0000","last_clean":"2024-09-15T23:56:32.708947+0000","last_became_active":"2024-09-15T23:56:19.684181+0000","last_became_peered":"2024-09-15T23:56:19.684181+0000","last_unstale":"2024-09-15T23:56:32.708947+0000","last_undegraded":"2024-09-15T23:56:32.708947+0000","last_fullsized":"2024-09-15T23:56:32.708947+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:43.447800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709222+0000","last_change":"2024-09-15T23:56:32.200239+0000","last_active":"2024-09-15T23:56:32.709222+0000","last_peered":"2024-09-15T23:56:32.709222+0000","last_clean":"2024-09-15T23:56:32.709222+0000","last_became_active":"2024-09-15T23:56:32.199789+0000","last_became_peered":"2024-09-15T23:56:32.199789+0000","last_unstale":"2024-09-15T23:56:32.709222+0000","last_undegraded":"2024-09-15T23:56:32.709222+0000","last_fullsized":"2024-09-15T23:56:32.709222+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:45:54.872715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736239+0000","last_change":"2024-09-15T23:56:32.733176+0000","last_active":"2024-09-15T23:56:32.736239+0000","last_peered":"2024-09-15T23:56:32.736239+0000","last_clean":"2024-09-15T23:56:32.736239+0000","last_became_active":"2024-09-15T23:56:32.732585+0000","last_became_peered":"2024-09-15T23:56:32.732585+0000","last_unstale":"2024-09-15T23:56:32.736239+0000","last_undegraded":"2024-09-15T23:56:32.736239+0000","last_fullsized":"2024-09-15T23:56:32.736239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:49.177636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718851+0000","last_change":"2024-09-15T23:56:20.701720+0000","last_active":"2024-09-15T23:56:32.718851+0000","last_peered":"2024-09-15T23:56:32.718851+0000","last_clean":"2024-09-15T23:56:32.718851+0000","last_became_active":"2024-09-15T23:56:20.701136+0000","last_became_peered":"2024-09-15T23:56:20.701136+0000","last_unstale":"2024-09-15T23:56:32.718851+0000","last_undegraded":"2024-09-15T23:56:32.718851+0000","last_fullsized":"2024-09-15T23:56:32.718851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:45.530229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719623+0000","last_change":"2024-09-15T23:56:19.690833+0000","last_active":"2024-09-15T23:56:32.719623+0000","last_peered":"2024-09-15T23:56:32.719623+0000","last_clean":"2024-09-15T23:56:32.719623+0000","last_became_active":"2024-09-15T23:56:19.690087+0000","last_became_peered":"2024-09-15T23:56:19.690087+0000","last_unstale":"2024-09-15T23:56:32.719623+0000","last_undegraded":"2024-09-15T23:56:32.719623+0000","last_fullsized":"2024-09-15T23:56:32.719623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:03.627378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715367+0000","last_change":"2024-09-15T23:56:32.206644+0000","last_active":"2024-09-15T23:56:32.715367+0000","last_peered":"2024-09-15T23:56:32.715367+0000","last_clean":"2024-09-15T23:56:32.715367+0000","last_became_active":"2024-09-15T23:56:32.206355+0000","last_became_peered":"2024-09-15T23:56:32.206355+0000","last_unstale":"2024-09-15T23:56:32.715367+0000","last_undegraded":"2024-09-15T23:56:32.715367+0000","last_fullsized":"2024-09-15T23:56:32.715367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.400112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736764+0000","last_change":"2024-09-15T23:56:32.728163+0000","last_active":"2024-09-15T23:56:32.736764+0000","last_peered":"2024-09-15T23:56:32.736764+0000","last_clean":"2024-09-15T23:56:32.736764+0000","last_became_active":"2024-09-15T23:56:32.727916+0000","last_became_peered":"2024-09-15T23:56:32.727916+0000","last_unstale":"2024-09-15T23:56:32.736764+0000","last_undegraded":"2024-09-15T23:56:32.736764+0000","last_fullsized":"2024-09-15T23:56:32.736764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:33.862005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709033+0000","last_change":"2024-09-15T23:56:19.694496+0000","last_active":"2024-09-15T23:56:32.709033+0000","last_peered":"2024-09-15T23:56:32.709033+0000","last_clean":"2024-09-15T23:56:32.709033+0000","last_became_active":"2024-09-15T23:56:19.694220+0000","last_became_peered":"2024-09-15T23:56:19.694220+0000","last_unstale":"2024-09-15T23:56:32.709033+0000","last_undegraded":"2024-09-15T23:56:32.709033+0000","last_fullsized":"2024-09-15T23:56:32.709033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:18.666847+0000","last_clean_scrub_stamp":"2024-09-15T23:56:18.666847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:37.594382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712363+0000","last_change":"2024-09-15T23:56:20.714864+0000","last_active":"2024-09-15T23:56:32.712363+0000","last_peered":"2024-09-15T23:56:32.712363+0000","last_clean":"2024-09-15T23:56:32.712363+0000","last_became_active":"2024-09-15T23:56:20.713754+0000","last_became_peered":"2024-09-15T23:56:20.713754+0000","last_unstale":"2024-09-15T23:56:32.712363+0000","last_undegraded":"2024-09-15T23:56:32.712363+0000","last_fullsized":"2024-09-15T23:56:32.712363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:40.128706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709168+0000","last_change":"2024-09-15T23:56:32.202917+0000","last_active":"2024-09-15T23:56:32.709168+0000","last_peered":"2024-09-15T23:56:32.709168+0000","last_clean":"2024-09-15T23:56:32.709168+0000","last_became_active":"2024-09-15T23:56:32.201606+0000","last_became_peered":"2024-09-15T23:56:32.201606+0000","last_unstale":"2024-09-15T23:56:32.709168+0000","last_undegraded":"2024-09-15T23:56:32.709168+0000","last_fullsized":"2024-09-15T23:56:32.709168+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:31.699359+0000","last_clean_scrub_stamp":"2024-09-15T23:56:31.699359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:46.023626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736826+0000","last_change":"2024-09-15T23:56:32.731736+0000","last_active":"2024-09-15T23:56:32.736826+0000","last_peered":"2024-09-15T23:56:32.736826+0000","last_clean":"2024-09-15T23:56:32.736826+0000","last_became_active":"2024-09-15T23:56:32.731506+0000","last_became_peered":"2024-09-15T23:56:32.731506+0000","last_unstale":"2024-09-15T23:56:32.736826+0000","last_undegraded":"2024-09-15T23:56:32.736826+0000","last_fullsized":"2024-09-15T23:56:32.736826+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:19.250971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716919+0000","last_change":"2024-09-15T23:56:20.710057+0000","last_active":"2024-09-15T23:56:32.716919+0000","last_peered":"2024-09-15T23:56:32.716919+0000","last_clean":"2024-09-15T23:56:32.716919+0000","last_became_active":"2024-09-15T23:56:20.709097+0000","last_became_peered":"2024-09-15T23:56:20.709097+0000","last_unstale":"2024-09-15T23:56:32.716919+0000","last_undegraded":"2024-09-15T23:56:32.716919+0000","last_fullsized":"2024-09-15T23:56:32.716919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:25.639372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737875+0000","last_change":"2024-09-15T23:56:32.734053+0000","last_active":"2024-09-15T23:56:32.737875+0000","last_peered":"2024-09-15T23:56:32.737875+0000","last_clean":"2024-09-15T23:56:32.737875+0000","last_became_active":"2024-09-15T23:56:32.732568+0000","last_became_peered":"2024-09-15T23:56:32.732568+0000","last_unstale":"2024-09-15T23:56:32.737875+0000","last_undegraded":"2024-09-15T23:56:32.737875+0000","last_fullsized":"2024-09-15T23:56:32.737875+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:58.655594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715911+0000","last_change":"2024-09-15T23:56:20.698982+0000","last_active":"2024-09-15T23:56:32.715911+0000","last_peered":"2024-09-15T23:56:32.715911+0000","last_clean":"2024-09-15T23:56:32.715911+0000","last_became_active":"2024-09-15T23:56:20.697467+0000","last_became_peered":"2024-09-15T23:56:20.697467+0000","last_unstale":"2024-09-15T23:56:32.715911+0000","last_undegraded":"2024-09-15T23:56:32.715911+0000","last_fullsized":"2024-09-15T23:56:32.715911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:32.776991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736580+0000","last_change":"2024-09-15T23:56:32.727764+0000","last_active":"2024-09-15T23:56:32.736580+0000","last_peered":"2024-09-15T23:56:32.736580+0000","last_clean":"2024-09-15T23:56:32.736580+0000","last_became_active":"2024-09-15T23:56:32.727523+0000","last_became_peered":"2024-09-15T23:56:32.727523+0000","last_unstale":"2024-09-15T23:56:32.736580+0000","last_undegraded":"2024-09-15T23:56:32.736580+0000","last_fullsized":"2024-09-15T23:56:32.736580+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:58.284148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718734+0000","last_change":"2024-09-15T23:56:20.716888+0000","last_active":"2024-09-15T23:56:32.718734+0000","last_peered":"2024-09-15T23:56:32.718734+0000","last_clean":"2024-09-15T23:56:32.718734+0000","last_became_active":"2024-09-15T23:56:20.716614+0000","last_became_peered":"2024-09-15T23:56:20.716614+0000","last_unstale":"2024-09-15T23:56:32.718734+0000","last_undegraded":"2024-09-15T23:56:32.718734+0000","last_fullsized":"2024-09-15T23:56:32.718734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:18.551676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735067+0000","last_change":"2024-09-15T23:56:32.732574+0000","last_active":"2024-09-15T23:56:32.735067+0000","last_peered":"2024-09-15T23:56:32.735067+0000","last_clean":"2024-09-15T23:56:32.735067+0000","last_became_active":"2024-09-15T23:56:32.732327+0000","last_became_peered":"2024-09-15T23:56:32.732327+0000","last_unstale":"2024-09-15T23:56:32.735067+0000","last_undegraded":"2024-09-15T23:56:32.735067+0000","last_fullsized":"2024-09-15T23:56:32.735067+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:43.487198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712448+0000","last_change":"2024-09-15T23:56:20.693934+0000","last_active":"2024-09-15T23:56:32.712448+0000","last_peered":"2024-09-15T23:56:32.712448+0000","last_clean":"2024-09-15T23:56:32.712448+0000","last_became_active":"2024-09-15T23:56:20.692241+0000","last_became_peered":"2024-09-15T23:56:20.692241+0000","last_unstale":"2024-09-15T23:56:32.712448+0000","last_undegraded":"2024-09-15T23:56:32.712448+0000","last_fullsized":"2024-09-15T23:56:32.712448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:26.574264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737793+0000","last_change":"2024-09-15T23:56:32.734580+0000","last_active":"2024-09-15T23:56:32.737793+0000","last_peered":"2024-09-15T23:56:32.737793+0000","last_clean":"2024-09-15T23:56:32.737793+0000","last_became_active":"2024-09-15T23:56:32.734177+0000","last_became_peered":"2024-09-15T23:56:32.734177+0000","last_unstale":"2024-09-15T23:56:32.737793+0000","last_undegraded":"2024-09-15T23:56:32.737793+0000","last_fullsized":"2024-09-15T23:56:32.737793+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:08.171277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716729+0000","last_change":"2024-09-15T23:56:20.710738+0000","last_active":"2024-09-15T23:56:32.716729+0000","last_peered":"2024-09-15T23:56:32.716729+0000","last_clean":"2024-09-15T23:56:32.716729+0000","last_became_active":"2024-09-15T23:56:20.710350+0000","last_became_peered":"2024-09-15T23:56:20.710350+0000","last_unstale":"2024-09-15T23:56:32.716729+0000","last_undegraded":"2024-09-15T23:56:32.716729+0000","last_fullsized":"2024-09-15T23:56:32.716729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:33.024255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728222+0000","last_change":"2024-09-15T23:56:32.720379+0000","last_active":"2024-09-15T23:56:32.728222+0000","last_peered":"2024-09-15T23:56:32.728222+0000","last_clean":"2024-09-15T23:56:32.728222+0000","last_became_active":"2024-09-15T23:56:32.720131+0000","last_became_peered":"2024-09-15T23:56:32.720131+0000","last_unstale":"2024-09-15T23:56:32.728222+0000","last_undegraded":"2024-09-15T23:56:32.728222+0000","last_fullsized":"2024-09-15T23:56:32.728222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:49.795009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712598+0000","last_change":"2024-09-15T23:56:20.698003+0000","last_active":"2024-09-15T23:56:32.712598+0000","last_peered":"2024-09-15T23:56:32.712598+0000","last_clean":"2024-09-15T23:56:32.712598+0000","last_became_active":"2024-09-15T23:56:20.697750+0000","last_became_peered":"2024-09-15T23:56:20.697750+0000","last_unstale":"2024-09-15T23:56:32.712598+0000","last_undegraded":"2024-09-15T23:56:32.712598+0000","last_fullsized":"2024-09-15T23:56:32.712598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:31.167780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736546+0000","last_change":"2024-09-15T23:56:32.730186+0000","last_active":"2024-09-15T23:56:32.736546+0000","last_peered":"2024-09-15T23:56:32.736546+0000","last_clean":"2024-09-15T23:56:32.736546+0000","last_became_active":"2024-09-15T23:56:32.728714+0000","last_became_peered":"2024-09-15T23:56:32.728714+0000","last_unstale":"2024-09-15T23:56:32.736546+0000","last_undegraded":"2024-09-15T23:56:32.736546+0000","last_fullsized":"2024-09-15T23:56:32.736546+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:35.837243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.718998+0000","last_change":"2024-09-15T23:56:20.708903+0000","last_active":"2024-09-15T23:56:32.718998+0000","last_peered":"2024-09-15T23:56:32.718998+0000","last_clean":"2024-09-15T23:56:32.718998+0000","last_became_active":"2024-09-15T23:56:20.708615+0000","last_became_peered":"2024-09-15T23:56:20.708615+0000","last_unstale":"2024-09-15T23:56:32.718998+0000","last_undegraded":"2024-09-15T23:56:32.718998+0000","last_fullsized":"2024-09-15T23:56:32.718998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:10.895459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736441+0000","last_change":"2024-09-15T23:56:32.728772+0000","last_active":"2024-09-15T23:56:32.736441+0000","last_peered":"2024-09-15T23:56:32.736441+0000","last_clean":"2024-09-15T23:56:32.736441+0000","last_became_active":"2024-09-15T23:56:32.728496+0000","last_became_peered":"2024-09-15T23:56:32.728496+0000","last_unstale":"2024-09-15T23:56:32.736441+0000","last_undegraded":"2024-09-15T23:56:32.736441+0000","last_fullsized":"2024-09-15T23:56:32.736441+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:27.568548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709688+0000","last_change":"2024-09-15T23:56:20.704206+0000","last_active":"2024-09-15T23:56:32.709688+0000","last_peered":"2024-09-15T23:56:32.709688+0000","last_clean":"2024-09-15T23:56:32.709688+0000","last_became_active":"2024-09-15T23:56:20.703587+0000","last_became_peered":"2024-09-15T23:56:20.703587+0000","last_unstale":"2024-09-15T23:56:32.709688+0000","last_undegraded":"2024-09-15T23:56:32.709688+0000","last_fullsized":"2024-09-15T23:56:32.709688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:42.099710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.729825+0000","last_change":"2024-09-15T23:56:32.725884+0000","last_active":"2024-09-15T23:56:32.729825+0000","last_peered":"2024-09-15T23:56:32.729825+0000","last_clean":"2024-09-15T23:56:32.729825+0000","last_became_active":"2024-09-15T23:56:32.725636+0000","last_became_peered":"2024-09-15T23:56:32.725636+0000","last_unstale":"2024-09-15T23:56:32.729825+0000","last_undegraded":"2024-09-15T23:56:32.729825+0000","last_fullsized":"2024-09-15T23:56:32.729825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:29.820066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717000+0000","last_change":"2024-09-15T23:56:20.709433+0000","last_active":"2024-09-15T23:56:32.717000+0000","last_peered":"2024-09-15T23:56:32.717000+0000","last_clean":"2024-09-15T23:56:32.717000+0000","last_became_active":"2024-09-15T23:56:20.708730+0000","last_became_peered":"2024-09-15T23:56:20.708730+0000","last_unstale":"2024-09-15T23:56:32.717000+0000","last_undegraded":"2024-09-15T23:56:32.717000+0000","last_fullsized":"2024-09-15T23:56:32.717000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:18:12.070024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737947+0000","last_change":"2024-09-15T23:56:32.735323+0000","last_active":"2024-09-15T23:56:32.737947+0000","last_peered":"2024-09-15T23:56:32.737947+0000","last_clean":"2024-09-15T23:56:32.737947+0000","last_became_active":"2024-09-15T23:56:32.732975+0000","last_became_peered":"2024-09-15T23:56:32.732975+0000","last_unstale":"2024-09-15T23:56:32.737947+0000","last_undegraded":"2024-09-15T23:56:32.737947+0000","last_fullsized":"2024-09-15T23:56:32.737947+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:38.246476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708861+0000","last_change":"2024-09-15T23:56:20.696531+0000","last_active":"2024-09-15T23:56:32.708861+0000","last_peered":"2024-09-15T23:56:32.708861+0000","last_clean":"2024-09-15T23:56:32.708861+0000","last_became_active":"2024-09-15T23:56:20.694733+0000","last_became_peered":"2024-09-15T23:56:20.694733+0000","last_unstale":"2024-09-15T23:56:32.708861+0000","last_undegraded":"2024-09-15T23:56:32.708861+0000","last_fullsized":"2024-09-15T23:56:32.708861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736839+0000","last_change":"2024-09-15T23:56:32.730535+0000","last_active":"2024-09-15T23:56:32.736839+0000","last_peered":"2024-09-15T23:56:32.736839+0000","last_clean":"2024-09-15T23:56:32.736839+0000","last_became_active":"2024-09-15T23:56:32.730217+0000","last_became_peered":"2024-09-15T23:56:32.730217+0000","last_unstale":"2024-09-15T23:56:32.736839+0000","last_undegraded":"2024-09-15T23:56:32.736839+0000","last_fullsized":"2024-09-15T23:56:32.736839+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:26.514162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709173+0000","last_change":"2024-09-15T23:56:20.693536+0000","last_active":"2024-09-15T23:56:32.709173+0000","last_peered":"2024-09-15T23:56:32.709173+0000","last_clean":"2024-09-15T23:56:32.709173+0000","last_became_active":"2024-09-15T23:56:20.691876+0000","last_became_peered":"2024-09-15T23:56:20.691876+0000","last_unstale":"2024-09-15T23:56:32.709173+0000","last_undegraded":"2024-09-15T23:56:32.709173+0000","last_fullsized":"2024-09-15T23:56:32.709173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:23.334160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.728115+0000","last_change":"2024-09-15T23:56:32.721939+0000","last_active":"2024-09-15T23:56:32.728115+0000","last_peered":"2024-09-15T23:56:32.728115+0000","last_clean":"2024-09-15T23:56:32.728115+0000","last_became_active":"2024-09-15T23:56:32.720088+0000","last_became_peered":"2024-09-15T23:56:32.720088+0000","last_unstale":"2024-09-15T23:56:32.728115+0000","last_undegraded":"2024-09-15T23:56:32.728115+0000","last_fullsized":"2024-09-15T23:56:32.728115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716981+0000","last_change":"2024-09-15T23:56:20.719041+0000","last_active":"2024-09-15T23:56:32.716981+0000","last_peered":"2024-09-15T23:56:32.716981+0000","last_clean":"2024-09-15T23:56:32.716981+0000","last_became_active":"2024-09-15T23:56:20.718733+0000","last_became_peered":"2024-09-15T23:56:20.718733+0000","last_unstale":"2024-09-15T23:56:32.716981+0000","last_undegraded":"2024-09-15T23:56:32.716981+0000","last_fullsized":"2024-09-15T23:56:32.716981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:32.018437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736613+0000","last_change":"2024-09-15T23:56:32.729122+0000","last_active":"2024-09-15T23:56:32.736613+0000","last_peered":"2024-09-15T23:56:32.736613+0000","last_clean":"2024-09-15T23:56:32.736613+0000","last_became_active":"2024-09-15T23:56:32.728699+0000","last_became_peered":"2024-09-15T23:56:32.728699+0000","last_unstale":"2024-09-15T23:56:32.736613+0000","last_undegraded":"2024-09-15T23:56:32.736613+0000","last_fullsized":"2024-09-15T23:56:32.736613+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:39.077347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.716821+0000","last_change":"2024-09-15T23:56:20.716052+0000","last_active":"2024-09-15T23:56:32.716821+0000","last_peered":"2024-09-15T23:56:32.716821+0000","last_clean":"2024-09-15T23:56:32.716821+0000","last_became_active":"2024-09-15T23:56:20.715747+0000","last_became_peered":"2024-09-15T23:56:20.715747+0000","last_unstale":"2024-09-15T23:56:32.716821+0000","last_undegraded":"2024-09-15T23:56:32.716821+0000","last_fullsized":"2024-09-15T23:56:32.716821+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:38.811325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737786+0000","last_change":"2024-09-15T23:56:32.734495+0000","last_active":"2024-09-15T23:56:32.737786+0000","last_peered":"2024-09-15T23:56:32.737786+0000","last_clean":"2024-09-15T23:56:32.737786+0000","last_became_active":"2024-09-15T23:56:32.734047+0000","last_became_peered":"2024-09-15T23:56:32.734047+0000","last_unstale":"2024-09-15T23:56:32.737786+0000","last_undegraded":"2024-09-15T23:56:32.737786+0000","last_fullsized":"2024-09-15T23:56:32.737786+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:41.398372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712381+0000","last_change":"2024-09-15T23:56:20.695194+0000","last_active":"2024-09-15T23:56:32.712381+0000","last_peered":"2024-09-15T23:56:32.712381+0000","last_clean":"2024-09-15T23:56:32.712381+0000","last_became_active":"2024-09-15T23:56:20.694922+0000","last_became_peered":"2024-09-15T23:56:20.694922+0000","last_unstale":"2024-09-15T23:56:32.712381+0000","last_undegraded":"2024-09-15T23:56:32.712381+0000","last_fullsized":"2024-09-15T23:56:32.712381+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:52.021672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737242+0000","last_change":"2024-09-15T23:56:32.735047+0000","last_active":"2024-09-15T23:56:32.737242+0000","last_peered":"2024-09-15T23:56:32.737242+0000","last_clean":"2024-09-15T23:56:32.737242+0000","last_became_active":"2024-09-15T23:56:32.734797+0000","last_became_peered":"2024-09-15T23:56:32.734797+0000","last_unstale":"2024-09-15T23:56:32.737242+0000","last_undegraded":"2024-09-15T23:56:32.737242+0000","last_fullsized":"2024-09-15T23:56:32.737242+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:53.066266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.719299+0000","last_change":"2024-09-15T23:56:20.698132+0000","last_active":"2024-09-15T23:56:32.719299+0000","last_peered":"2024-09-15T23:56:32.719299+0000","last_clean":"2024-09-15T23:56:32.719299+0000","last_became_active":"2024-09-15T23:56:20.697871+0000","last_became_peered":"2024-09-15T23:56:20.697871+0000","last_unstale":"2024-09-15T23:56:32.719299+0000","last_undegraded":"2024-09-15T23:56:32.719299+0000","last_fullsized":"2024-09-15T23:56:32.719299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:12.969830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.734944+0000","last_change":"2024-09-15T23:56:32.729743+0000","last_active":"2024-09-15T23:56:32.734944+0000","last_peered":"2024-09-15T23:56:32.734944+0000","last_clean":"2024-09-15T23:56:32.734944+0000","last_became_active":"2024-09-15T23:56:32.729475+0000","last_became_peered":"2024-09-15T23:56:32.729475+0000","last_unstale":"2024-09-15T23:56:32.734944+0000","last_undegraded":"2024-09-15T23:56:32.734944+0000","last_fullsized":"2024-09-15T23:56:32.734944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:07.434547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717086+0000","last_change":"2024-09-15T23:56:20.702847+0000","last_active":"2024-09-15T23:56:32.717086+0000","last_peered":"2024-09-15T23:56:32.717086+0000","last_clean":"2024-09-15T23:56:32.717086+0000","last_became_active":"2024-09-15T23:56:20.702549+0000","last_became_peered":"2024-09-15T23:56:20.702549+0000","last_unstale":"2024-09-15T23:56:32.717086+0000","last_undegraded":"2024-09-15T23:56:32.717086+0000","last_fullsized":"2024-09-15T23:56:32.717086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:17.413803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737741+0000","last_change":"2024-09-15T23:56:32.733950+0000","last_active":"2024-09-15T23:56:32.737741+0000","last_peered":"2024-09-15T23:56:32.737741+0000","last_clean":"2024-09-15T23:56:32.737741+0000","last_became_active":"2024-09-15T23:56:32.733228+0000","last_became_peered":"2024-09-15T23:56:32.733228+0000","last_unstale":"2024-09-15T23:56:32.737741+0000","last_undegraded":"2024-09-15T23:56:32.737741+0000","last_fullsized":"2024-09-15T23:56:32.737741+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:00.202502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709054+0000","last_change":"2024-09-15T23:56:20.694911+0000","last_active":"2024-09-15T23:56:32.709054+0000","last_peered":"2024-09-15T23:56:32.709054+0000","last_clean":"2024-09-15T23:56:32.709054+0000","last_became_active":"2024-09-15T23:56:20.694301+0000","last_became_peered":"2024-09-15T23:56:20.694301+0000","last_unstale":"2024-09-15T23:56:32.709054+0000","last_undegraded":"2024-09-15T23:56:32.709054+0000","last_fullsized":"2024-09-15T23:56:32.709054+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:35.233940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736129+0000","last_change":"2024-09-15T23:56:32.732846+0000","last_active":"2024-09-15T23:56:32.736129+0000","last_peered":"2024-09-15T23:56:32.736129+0000","last_clean":"2024-09-15T23:56:32.736129+0000","last_became_active":"2024-09-15T23:56:32.732219+0000","last_became_peered":"2024-09-15T23:56:32.732219+0000","last_unstale":"2024-09-15T23:56:32.736129+0000","last_undegraded":"2024-09-15T23:56:32.736129+0000","last_fullsized":"2024-09-15T23:56:32.736129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:57.951954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.715279+0000","last_change":"2024-09-15T23:56:20.707737+0000","last_active":"2024-09-15T23:56:32.715279+0000","last_peered":"2024-09-15T23:56:32.715279+0000","last_clean":"2024-09-15T23:56:32.715279+0000","last_became_active":"2024-09-15T23:56:20.707475+0000","last_became_peered":"2024-09-15T23:56:20.707475+0000","last_unstale":"2024-09-15T23:56:32.715279+0000","last_undegraded":"2024-09-15T23:56:32.715279+0000","last_fullsized":"2024-09-15T23:56:32.715279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:06.221910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730838+0000","last_change":"2024-09-15T23:56:32.727925+0000","last_active":"2024-09-15T23:56:32.730838+0000","last_peered":"2024-09-15T23:56:32.730838+0000","last_clean":"2024-09-15T23:56:32.730838+0000","last_became_active":"2024-09-15T23:56:32.726974+0000","last_became_peered":"2024-09-15T23:56:32.726974+0000","last_unstale":"2024-09-15T23:56:32.730838+0000","last_undegraded":"2024-09-15T23:56:32.730838+0000","last_fullsized":"2024-09-15T23:56:32.730838+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:49.029923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709321+0000","last_change":"2024-09-15T23:56:20.693453+0000","last_active":"2024-09-15T23:56:32.709321+0000","last_peered":"2024-09-15T23:56:32.709321+0000","last_clean":"2024-09-15T23:56:32.709321+0000","last_became_active":"2024-09-15T23:56:20.692979+0000","last_became_peered":"2024-09-15T23:56:20.692979+0000","last_unstale":"2024-09-15T23:56:32.709321+0000","last_undegraded":"2024-09-15T23:56:32.709321+0000","last_fullsized":"2024-09-15T23:56:32.709321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:19.407966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735047+0000","last_change":"2024-09-15T23:56:32.729707+0000","last_active":"2024-09-15T23:56:32.735047+0000","last_peered":"2024-09-15T23:56:32.735047+0000","last_clean":"2024-09-15T23:56:32.735047+0000","last_became_active":"2024-09-15T23:56:32.729445+0000","last_became_peered":"2024-09-15T23:56:32.729445+0000","last_unstale":"2024-09-15T23:56:32.735047+0000","last_undegraded":"2024-09-15T23:56:32.735047+0000","last_fullsized":"2024-09-15T23:56:32.735047+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:13.159664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.717067+0000","last_change":"2024-09-15T23:56:20.707715+0000","last_active":"2024-09-15T23:56:32.717067+0000","last_peered":"2024-09-15T23:56:32.717067+0000","last_clean":"2024-09-15T23:56:32.717067+0000","last_became_active":"2024-09-15T23:56:20.707482+0000","last_became_peered":"2024-09-15T23:56:20.707482+0000","last_unstale":"2024-09-15T23:56:32.717067+0000","last_undegraded":"2024-09-15T23:56:32.717067+0000","last_fullsized":"2024-09-15T23:56:32.717067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:04.217570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.730932+0000","last_change":"2024-09-15T23:56:32.727665+0000","last_active":"2024-09-15T23:56:32.730932+0000","last_peered":"2024-09-15T23:56:32.730932+0000","last_clean":"2024-09-15T23:56:32.730932+0000","last_became_active":"2024-09-15T23:56:32.727396+0000","last_became_peered":"2024-09-15T23:56:32.727396+0000","last_unstale":"2024-09-15T23:56:32.730932+0000","last_undegraded":"2024-09-15T23:56:32.730932+0000","last_fullsized":"2024-09-15T23:56:32.730932+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:30.127957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.724529+0000","last_change":"2024-09-15T23:56:20.715787+0000","last_active":"2024-09-15T23:56:32.724529+0000","last_peered":"2024-09-15T23:56:32.724529+0000","last_clean":"2024-09-15T23:56:32.724529+0000","last_became_active":"2024-09-15T23:56:20.715520+0000","last_became_peered":"2024-09-15T23:56:20.715520+0000","last_unstale":"2024-09-15T23:56:32.724529+0000","last_undegraded":"2024-09-15T23:56:32.724529+0000","last_fullsized":"2024-09-15T23:56:32.724529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:23.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.735119+0000","last_change":"2024-09-15T23:56:32.730385+0000","last_active":"2024-09-15T23:56:32.735119+0000","last_peered":"2024-09-15T23:56:32.735119+0000","last_clean":"2024-09-15T23:56:32.735119+0000","last_became_active":"2024-09-15T23:56:32.729452+0000","last_became_peered":"2024-09-15T23:56:32.729452+0000","last_unstale":"2024-09-15T23:56:32.735119+0000","last_undegraded":"2024-09-15T23:56:32.735119+0000","last_fullsized":"2024-09-15T23:56:32.735119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:59.914470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.712686+0000","last_change":"2024-09-15T23:56:20.697597+0000","last_active":"2024-09-15T23:56:32.712686+0000","last_peered":"2024-09-15T23:56:32.712686+0000","last_clean":"2024-09-15T23:56:32.712686+0000","last_became_active":"2024-09-15T23:56:20.697269+0000","last_became_peered":"2024-09-15T23:56:20.697269+0000","last_unstale":"2024-09-15T23:56:32.712686+0000","last_undegraded":"2024-09-15T23:56:32.712686+0000","last_fullsized":"2024-09-15T23:56:32.712686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:40.413575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736222+0000","last_change":"2024-09-15T23:56:32.733151+0000","last_active":"2024-09-15T23:56:32.736222+0000","last_peered":"2024-09-15T23:56:32.736222+0000","last_clean":"2024-09-15T23:56:32.736222+0000","last_became_active":"2024-09-15T23:56:32.732877+0000","last_became_peered":"2024-09-15T23:56:32.732877+0000","last_unstale":"2024-09-15T23:56:32.736222+0000","last_undegraded":"2024-09-15T23:56:32.736222+0000","last_fullsized":"2024-09-15T23:56:32.736222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:55.835877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709220+0000","last_change":"2024-09-15T23:56:20.710594+0000","last_active":"2024-09-15T23:56:32.709220+0000","last_peered":"2024-09-15T23:56:32.709220+0000","last_clean":"2024-09-15T23:56:32.709220+0000","last_became_active":"2024-09-15T23:56:20.709407+0000","last_became_peered":"2024-09-15T23:56:20.709407+0000","last_unstale":"2024-09-15T23:56:32.709220+0000","last_undegraded":"2024-09-15T23:56:32.709220+0000","last_fullsized":"2024-09-15T23:56:32.709220+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:50.538712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727737+0000","last_change":"2024-09-15T23:56:32.722039+0000","last_active":"2024-09-15T23:56:32.727737+0000","last_peered":"2024-09-15T23:56:32.727737+0000","last_clean":"2024-09-15T23:56:32.727737+0000","last_became_active":"2024-09-15T23:56:32.721282+0000","last_became_peered":"2024-09-15T23:56:32.721282+0000","last_unstale":"2024-09-15T23:56:32.727737+0000","last_undegraded":"2024-09-15T23:56:32.727737+0000","last_fullsized":"2024-09-15T23:56:32.727737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:41.824395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710089+0000","last_change":"2024-09-15T23:56:20.692345+0000","last_active":"2024-09-15T23:56:32.710089+0000","last_peered":"2024-09-15T23:56:32.710089+0000","last_clean":"2024-09-15T23:56:32.710089+0000","last_became_active":"2024-09-15T23:56:20.691997+0000","last_became_peered":"2024-09-15T23:56:20.691997+0000","last_unstale":"2024-09-15T23:56:32.710089+0000","last_undegraded":"2024-09-15T23:56:32.710089+0000","last_fullsized":"2024-09-15T23:56:32.710089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:32.210271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736086+0000","last_change":"2024-09-15T23:56:32.727714+0000","last_active":"2024-09-15T23:56:32.736086+0000","last_peered":"2024-09-15T23:56:32.736086+0000","last_clean":"2024-09-15T23:56:32.736086+0000","last_became_active":"2024-09-15T23:56:32.727463+0000","last_became_peered":"2024-09-15T23:56:32.727463+0000","last_unstale":"2024-09-15T23:56:32.736086+0000","last_undegraded":"2024-09-15T23:56:32.736086+0000","last_fullsized":"2024-09-15T23:56:32.736086+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:47.737023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709279+0000","last_change":"2024-09-15T23:56:20.713004+0000","last_active":"2024-09-15T23:56:32.709279+0000","last_peered":"2024-09-15T23:56:32.709279+0000","last_clean":"2024-09-15T23:56:32.709279+0000","last_became_active":"2024-09-15T23:56:20.712725+0000","last_became_peered":"2024-09-15T23:56:20.712725+0000","last_unstale":"2024-09-15T23:56:32.709279+0000","last_undegraded":"2024-09-15T23:56:32.709279+0000","last_fullsized":"2024-09-15T23:56:32.709279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:45.781065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736478+0000","last_change":"2024-09-15T23:56:32.728278+0000","last_active":"2024-09-15T23:56:32.736478+0000","last_peered":"2024-09-15T23:56:32.736478+0000","last_clean":"2024-09-15T23:56:32.736478+0000","last_became_active":"2024-09-15T23:56:32.728013+0000","last_became_peered":"2024-09-15T23:56:32.728013+0000","last_unstale":"2024-09-15T23:56:32.736478+0000","last_undegraded":"2024-09-15T23:56:32.736478+0000","last_fullsized":"2024-09-15T23:56:32.736478+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:34.722829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.708916+0000","last_change":"2024-09-15T23:56:20.690748+0000","last_active":"2024-09-15T23:56:32.708916+0000","last_peered":"2024-09-15T23:56:32.708916+0000","last_clean":"2024-09-15T23:56:32.708916+0000","last_became_active":"2024-09-15T23:56:20.690331+0000","last_became_peered":"2024-09-15T23:56:20.690331+0000","last_unstale":"2024-09-15T23:56:32.708916+0000","last_undegraded":"2024-09-15T23:56:32.708916+0000","last_fullsized":"2024-09-15T23:56:32.708916+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:09:49.052824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736598+0000","last_change":"2024-09-15T23:56:32.729590+0000","last_active":"2024-09-15T23:56:32.736598+0000","last_peered":"2024-09-15T23:56:32.736598+0000","last_clean":"2024-09-15T23:56:32.736598+0000","last_became_active":"2024-09-15T23:56:32.728783+0000","last_became_peered":"2024-09-15T23:56:32.728783+0000","last_unstale":"2024-09-15T23:56:32.736598+0000","last_undegraded":"2024-09-15T23:56:32.736598+0000","last_fullsized":"2024-09-15T23:56:32.736598+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:52.631789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710093+0000","last_change":"2024-09-15T23:56:20.693245+0000","last_active":"2024-09-15T23:56:32.710093+0000","last_peered":"2024-09-15T23:56:32.710093+0000","last_clean":"2024-09-15T23:56:32.710093+0000","last_became_active":"2024-09-15T23:56:20.692604+0000","last_became_peered":"2024-09-15T23:56:20.692604+0000","last_unstale":"2024-09-15T23:56:32.710093+0000","last_undegraded":"2024-09-15T23:56:32.710093+0000","last_fullsized":"2024-09-15T23:56:32.710093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:15.065465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.736782+0000","last_change":"2024-09-15T23:56:32.732604+0000","last_active":"2024-09-15T23:56:32.736782+0000","last_peered":"2024-09-15T23:56:32.736782+0000","last_clean":"2024-09-15T23:56:32.736782+0000","last_became_active":"2024-09-15T23:56:32.731603+0000","last_became_peered":"2024-09-15T23:56:32.731603+0000","last_unstale":"2024-09-15T23:56:32.736782+0000","last_undegraded":"2024-09-15T23:56:32.736782+0000","last_fullsized":"2024-09-15T23:56:32.736782+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:03.041794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.713158+0000","last_change":"2024-09-15T23:56:20.694156+0000","last_active":"2024-09-15T23:56:32.713158+0000","last_peered":"2024-09-15T23:56:32.713158+0000","last_clean":"2024-09-15T23:56:32.713158+0000","last_became_active":"2024-09-15T23:56:20.693864+0000","last_became_peered":"2024-09-15T23:56:20.693864+0000","last_unstale":"2024-09-15T23:56:32.713158+0000","last_undegraded":"2024-09-15T23:56:32.713158+0000","last_fullsized":"2024-09-15T23:56:32.713158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:22.219746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.738011+0000","last_change":"2024-09-15T23:56:32.735699+0000","last_active":"2024-09-15T23:56:32.738011+0000","last_peered":"2024-09-15T23:56:32.738011+0000","last_clean":"2024-09-15T23:56:32.738011+0000","last_became_active":"2024-09-15T23:56:32.735449+0000","last_became_peered":"2024-09-15T23:56:32.735449+0000","last_unstale":"2024-09-15T23:56:32.738011+0000","last_undegraded":"2024-09-15T23:56:32.738011+0000","last_fullsized":"2024-09-15T23:56:32.738011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:27.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.709215+0000","last_change":"2024-09-15T23:56:20.706407+0000","last_active":"2024-09-15T23:56:32.709215+0000","last_peered":"2024-09-15T23:56:32.709215+0000","last_clean":"2024-09-15T23:56:32.709215+0000","last_became_active":"2024-09-15T23:56:20.706098+0000","last_became_peered":"2024-09-15T23:56:20.706098+0000","last_unstale":"2024-09-15T23:56:32.709215+0000","last_undegraded":"2024-09-15T23:56:32.709215+0000","last_fullsized":"2024-09-15T23:56:32.709215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:41.711451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.737528+0000","last_change":"2024-09-15T23:56:32.735999+0000","last_active":"2024-09-15T23:56:32.737528+0000","last_peered":"2024-09-15T23:56:32.737528+0000","last_clean":"2024-09-15T23:56:32.737528+0000","last_became_active":"2024-09-15T23:56:32.735642+0000","last_became_peered":"2024-09-15T23:56:32.735642+0000","last_unstale":"2024-09-15T23:56:32.737528+0000","last_undegraded":"2024-09-15T23:56:32.737528+0000","last_fullsized":"2024-09-15T23:56:32.737528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:44.565334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.721273+0000","last_change":"2024-09-15T23:56:20.712420+0000","last_active":"2024-09-15T23:56:32.721273+0000","last_peered":"2024-09-15T23:56:32.721273+0000","last_clean":"2024-09-15T23:56:32.721273+0000","last_became_active":"2024-09-15T23:56:20.711746+0000","last_became_peered":"2024-09-15T23:56:20.711746+0000","last_unstale":"2024-09-15T23:56:32.721273+0000","last_undegraded":"2024-09-15T23:56:32.721273+0000","last_fullsized":"2024-09-15T23:56:32.721273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:41:21.080902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727887+0000","last_change":"2024-09-15T23:56:32.720667+0000","last_active":"2024-09-15T23:56:32.727887+0000","last_peered":"2024-09-15T23:56:32.727887+0000","last_clean":"2024-09-15T23:56:32.727887+0000","last_became_active":"2024-09-15T23:56:32.720185+0000","last_became_peered":"2024-09-15T23:56:32.720185+0000","last_unstale":"2024-09-15T23:56:32.727887+0000","last_undegraded":"2024-09-15T23:56:32.727887+0000","last_fullsized":"2024-09-15T23:56:32.727887+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:27.603363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.720467+0000","last_change":"2024-09-15T23:56:20.715838+0000","last_active":"2024-09-15T23:56:32.720467+0000","last_peered":"2024-09-15T23:56:32.720467+0000","last_clean":"2024-09-15T23:56:32.720467+0000","last_became_active":"2024-09-15T23:56:20.715553+0000","last_became_peered":"2024-09-15T23:56:20.715553+0000","last_unstale":"2024-09-15T23:56:32.720467+0000","last_undegraded":"2024-09-15T23:56:32.720467+0000","last_fullsized":"2024-09-15T23:56:32.720467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:36.218180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.727705+0000","last_change":"2024-09-15T23:56:32.722294+0000","last_active":"2024-09-15T23:56:32.727705+0000","last_peered":"2024-09-15T23:56:32.727705+0000","last_clean":"2024-09-15T23:56:32.727705+0000","last_became_active":"2024-09-15T23:56:32.721596+0000","last_became_peered":"2024-09-15T23:56:32.721596+0000","last_unstale":"2024-09-15T23:56:32.727705+0000","last_undegraded":"2024-09-15T23:56:32.727705+0000","last_fullsized":"2024-09-15T23:56:32.727705+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:32.172840+0000","last_clean_scrub_stamp":"2024-09-15T23:56:32.172840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:04.406292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":18,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T23:56:32.710147+0000","last_change":"2024-09-15T23:56:20.704497+0000","last_active":"2024-09-15T23:56:32.710147+0000","last_peered":"2024-09-15T23:56:32.710147+0000","last_clean":"2024-09-15T23:56:32.710147+0000","last_became_active":"2024-09-15T23:56:20.703942+0000","last_became_peered":"2024-09-15T23:56:20.703942+0000","last_unstale":"2024-09-15T23:56:32.710147+0000","last_undegraded":"2024-09-15T23:56:32.710147+0000","last_fullsized":"2024-09-15T23:56:32.710147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:56:19.669757+0000","last_clean_scrub_stamp":"2024-09-15T23:56:19.669757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:29.810129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":5046,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":298,"num_read_kb":503,"num_write":177,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705684,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":393216,"data_stored":142506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705684,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":983040,"data_stored":733611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705684,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":995328,"data_stored":738475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:56:36.492 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:56:36.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.645+0000 7f0c1e423640 1 Processor -- start 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.645+0000 7f0c1e423640 1 -- start start 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c1e423640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c18135b50 0x7f0c1809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c1e423640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1809b020 con 0x7f0c18135f30 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c1e423640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0c1809b310 con 0x7f0c18135b50 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c17fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c18135b50 0x7f0c1809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c17fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c18135b50 0x7f0c1809aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39324/0 (socket says 172.21.15.121:39324) 2024-09-15T23:56:36.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c17fff640 1 -- 172.21.15.121:0/453309016 learned_addr learned my addr 172.21.15.121:0/453309016 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c17fff640 1 -- 172.21.15.121:0/453309016 >> v1:172.21.15.121:6789/0 conn(0x7f0c18135f30 legacy=0x7f0c180a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c17fff640 1 -- 172.21.15.121:0/453309016 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c180a08c0 con 0x7f0c18135b50 2024-09-15T23:56:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.646+0000 7f0c16ffd640 1 -- 172.21.15.121:0/453309016 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664270476 0 0) 0x7f0c1809b020 con 0x7f0c18135f30 2024-09-15T23:56:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c17fff640 1 --2- 172.21.15.121:0/453309016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c1809aae0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097f0 tx=0x7f0c0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28a181de6456910 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c16ffd640 1 -- 172.21.15.121:0/453309016 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08037070 con 0x7f0c18135b50 2024-09-15T23:56:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c16ffd640 1 -- 172.21.15.121:0/453309016 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c08032440 con 0x7f0c18135b50 2024-09-15T23:56:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c16ffd640 1 -- 172.21.15.121:0/453309016 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08032740 con 0x7f0c18135b50 2024-09-15T23:56:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c1e423640 1 -- 172.21.15.121:0/453309016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 msgr2=0x7f0c1809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.647+0000 7f0c1e423640 1 --2- 172.21.15.121:0/453309016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c1809aae0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0c080097f0 tx=0x7f0c0802a270 comp rx=0 tx=0).stop 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 -- 172.21.15.121:0/453309016 shutdown_connections 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 --2- 172.21.15.121:0/453309016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c1809aae0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 -- 172.21.15.121:0/453309016 >> 172.21.15.121:0/453309016 conn(0x7f0c180a85e0 msgr2=0x7f0c180a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 -- 172.21.15.121:0/453309016 shutdown_connections 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 -- 172.21.15.121:0/453309016 wait complete. 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.648+0000 7f0c1e423640 1 Processor -- start 2024-09-15T23:56:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c1e423640 1 -- start start 2024-09-15T23:56:36.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c1e423640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c1e423640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c180a5430 con 0x7f0c18135b50 2024-09-15T23:56:36.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c17fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39334/0 (socket says 172.21.15.121:39334) 2024-09-15T23:56:36.652 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c17fff640 1 -- 172.21.15.121:0/570638559 learned_addr learned my addr 172.21.15.121:0/570638559 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c17fff640 1 -- 172.21.15.121:0/570638559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c18072b10 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.649+0000 7f0c17fff640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0c0802a2b0 tx=0x7f0c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.650+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08037040 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.650+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c08004160 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.650+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c18071d00 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.650+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08004440 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.650+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c18071960 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 45792+0+0 (secure 0 0 0) 0x7f0c08003610 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c180a1f10 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c14ff9640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 0x7f0c0403a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f0c0806c7a0 con 0x7f0c18135b50 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c177fe640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 0x7f0c0403a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:36.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.651+0000 7f0c177fe640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 0x7f0c0403a840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007fd0 tx=0x7f0c0c007900 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:36.656 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.655+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c0803dc70 con 0x7f0c18135b50 2024-09-15T23:56:36.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.717+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 20) ==== 45848+0+0 (secure 0 0 0) 0x7f0c08030920 con 0x7f0c18135b50 2024-09-15T23:56:36.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.862+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0c18073870 con 0x7f0c18135b50 2024-09-15T23:56:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.863+0000 7f0c14ff9640 1 -- 172.21.15.121:0/570638559 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+152 (secure 0 0 0) 0x7f0c0802f730 con 0x7f0c18135b50 2024-09-15T23:56:36.864 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:36.864 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs_b, metadata pool: cephfs_b_metadata, data pools: [cephfs_b_data ] 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 msgr2=0x7f0c0403a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 0x7f0c0403a840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c007fd0 tx=0x7f0c0c007900 comp rx=0 tx=0).stop 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 msgr2=0x7f0c180709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0c0802a2b0 tx=0x7f0c080046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 shutdown_connections 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0c04038380 0x7f0c0403a840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 --2- 172.21.15.121:0/570638559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c18135b50 0x7f0c180709b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 >> 172.21.15.121:0/570638559 conn(0x7f0c180a85e0 msgr2=0x7f0c180a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 shutdown_connections 2024-09-15T23:56:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:36.865+0000 7f0c1e423640 1 -- 172.21.15.121:0/570638559 wait complete. 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs_b; just confirmed its presence on cluster 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs_b 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:36.876 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:36.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:36.877 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:56:36.893 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:56:36.894 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.895 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:36.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:36.896 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:36.964 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:56:36.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:36.965 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:56:37.028 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:56:37.028 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:37.028 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:37.028 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:37.028 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:37.029 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:56:37.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:37.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:37.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.160 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:56:37.176 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:56:37.177 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:37.177 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:37.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:56:37.241 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:56:37.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:37.242 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:37.297 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:37.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:37.298 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:37.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:37.426 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:37.484 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:37.485 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:37.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.487 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:37.539 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:37.540 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:56:37.540 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs_b) 2024-09-15T23:56:37.583 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:37.607 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:37.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:56:37.664+0000 7f62a692d480 -1 init, newargv = 0x558809eecee0 newargc=15 2024-09-15T23:56:37.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[50053]: starting ceph client 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:37.666 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:37.667 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:37.668 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:37.669 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:37.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.669 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:37.670 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[50053]: starting fuse 2024-09-15T23:56:37.684 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:37.684 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:56:37.685 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:37.685 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:37.686 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:37.687 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:37.804 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:37.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:37.814 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok status 2024-09-15T23:56:37.951 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:37.951 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:56:37.951 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:37.951 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "50053", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:37.952 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:37.953 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 192.168.0.2:0/3186534736", 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/3186534736", 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 22, 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 43, 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs_b" 2024-09-15T23:56:37.954 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:37.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.960 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:56:37.960 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:37.977 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:56:37.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:37.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:37.977 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:38.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.045 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:38.168 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:38.175 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:38.176 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:38.177 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:38.180 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-09-15T23:56:38.179+0000 7fc9d1bfd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:38.254 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:38.265 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:38.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:38.265 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:38.399 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:38.399 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:38.399 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:38.399 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:38.400 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:38.402 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:38.402 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:38.402 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:38.403 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:38.403 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:38.403 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:38.404 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:37.669151+0000", 2024-09-15T23:56:38.405 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:37.669151+0000", 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 1, 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:38.406 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:39.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:39.409 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:39.500 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:39.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:39.507 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:39.508 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:39.509 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:39.588 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:39.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:39.598 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:39.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:39.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:39.732 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:39.732 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:39.732 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:39.732 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:39.732 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:39.733 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:39.734 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:39.735 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:40.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.742 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:40.822 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:40.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:40.829 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:40.829 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:40.829 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:40.829 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:40.830 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:40.831 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:40.908 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:40.911 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:40.919 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:40.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:40.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:41.052 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:41.053 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:41.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:41.055 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:42.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:42.062 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:42.152 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:42.160 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:42.161 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:42.162 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:42.240 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:42.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:42.251 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:42.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:42.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:42.382 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:42.382 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:42.383 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:42.384 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:42.385 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:42.386 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:42.386 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:42.386 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:42.386 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:42.386 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:43.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:43.391 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:43.481 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:43.489 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:43.490 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:43.570 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:43.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:43.580 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:43.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:43.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:43.715 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:43.716 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:43.717 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:43.718 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:44.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:44.725 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:44.812 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:44.820 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:44.821 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:44.822 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:44.822 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:44.822 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:44.822 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:44.899 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:44.902 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:44.909 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:44.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:44.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:45.041 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:45.042 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:45.043 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:45.044 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:45.045 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:45.045 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:45.045 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:46.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:46.051 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:46.140 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:46.148 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:46.148 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:46.148 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:46.148 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:46.148 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:46.149 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:46.150 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:46.230 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:46.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:46.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:46.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:46.241 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:46.375 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:46.376 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:46.377 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:46.378 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:47.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:47.382 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:47.468 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {}} 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:47.476 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:47.477 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:47.478 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:47.478 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:47.478 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:47.555 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:47.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:47.565 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:47.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:47.566 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:47.699 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:47.700 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:47.701 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:47.702 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:48.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:48.708 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --dumpfs=cephfs_b) 2024-09-15T23:56:48.801 INFO:teuthology.orchestra.run.smithi121.stdout:{"cephfs_b": {"4672": {"mount_root": "/", "chit": 66.67, "dlease": 0.0, "ofiles": "0", "oicaps": "1", "oinodes": "0", "rtio": 0.0, "raio": 0.0, "rsp": 0.0, "wtio": 0.0, "waio": 0.0, "wsp": 0.0, "rlatavg": 0.0, "rlatsd": 0.0, "wlatavg": 0.0, "wlatsd": 0.0, "mlatavg": 0.4, "mlatsd": 0.08, "mount_point@host/addr": "/home/ubuntu/cephtest/mnt.1@smithi121/192.168.0.2"}}} 2024-09-15T23:56:48.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:48.809 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:48.809 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:48.809 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:48.809 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:48.810 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:48.811 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:48.891 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:48.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:48.901 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50053.asok 2024-09-15T23:56:48.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:48.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50053.asok mds_sessions 2024-09-15T23:56:49.034 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4672, 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4672 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3186534736 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:49.035 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4672 v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "v1:192.168.0.2:0/3186534736", 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions": [ 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": 0, 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "addrs": { 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "addrvec": [ 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v2", 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6824", 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:49.036 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "172.21.15.121:6826", 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 537106624 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "seq": 0, 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_gen": 0, 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_ttl": "2024-09-15T23:57:38.667208+0000", 2024-09-15T23:56:49.037 INFO:teuthology.orchestra.run.smithi121.stdout: "last_cap_renew_request": "2024-09-15T23:56:38.667208+0000", 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_renew_seq": 2, 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: "num_caps": 1, 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "open" 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: ], 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 22 2024-09-15T23:56:49.038 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:49.043 DEBUG:tasks.cephfs.test_fstop:metrics={'cephfs_b': {'4672': {'mount_root': '/', 'chit': 66.67, 'dlease': 0.0, 'ofiles': '0', 'oicaps': '1', 'oinodes': '0', 'rtio': 0.0, 'raio': 0.0, 'rsp': 0.0, 'wtio': 0.0, 'waio': 0.0, 'wsp': 0.0, 'rlatavg': 0.0, 'rlatsd': 0.0, 'wlatavg': 0.0, 'wlatsd': 0.0, 'mlatavg': 0.4, 'mlatsd': 0.08, 'mount_point@host/addr': '/home/ubuntu/cephtest/mnt.1@smithi121/192.168.0.2'}}} 2024-09-15T23:56:49.043 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:49.043 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:49.062 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.199+0000 7fcd494d2640 1 Processor -- start 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.199+0000 7fcd494d2640 1 -- start start 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd494d2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd440a39c0 0x7fcd44132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd494d2640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd440a16c0 con 0x7fcd44133470 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd494d2640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcd440a1490 con 0x7fcd440a39c0 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd42ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd440a39c0 0x7fcd44132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd427fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcd44133470 0x7fcd44135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:36792/0 (socket says 172.21.15.121:36792) 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd42ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd440a39c0 0x7fcd44132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36220/0 (socket says 172.21.15.121:36220) 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd427fc640 1 -- 172.21.15.121:0/2477267983 learned_addr learned my addr 172.21.15.121:0/2477267983 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:49.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd42ffd640 1 -- 172.21.15.121:0/2477267983 >> v1:172.21.15.121:6789/0 conn(0x7fcd44133470 legacy=0x7fcd44135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd42ffd640 1 -- 172.21.15.121:0/2477267983 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd440a4010 con 0x7fcd440a39c0 2024-09-15T23:56:49.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.200+0000 7fcd41ffb640 1 -- 172.21.15.121:0/2477267983 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129618344 0 0) 0x7fcd440a16c0 con 0x7fcd44133470 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd42ffd640 1 --2- 172.21.15.121:0/2477267983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44132f30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a8c0 tx=0x7fcd3402b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85b6bdb72a2406d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd41ffb640 1 -- 172.21.15.121:0/2477267983 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd3400b040 con 0x7fcd440a39c0 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd41ffb640 1 -- 172.21.15.121:0/2477267983 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34030640 con 0x7fcd440a39c0 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd41ffb640 1 -- 172.21.15.121:0/2477267983 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd34030940 con 0x7fcd440a39c0 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd494d2640 1 -- 172.21.15.121:0/2477267983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 msgr2=0x7fcd44132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.201+0000 7fcd494d2640 1 --2- 172.21.15.121:0/2477267983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44132f30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a8c0 tx=0x7fcd3402b4d0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.202+0000 7fcd494d2640 1 -- 172.21.15.121:0/2477267983 shutdown_connections 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.202+0000 7fcd494d2640 1 --2- 172.21.15.121:0/2477267983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44132f30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.202+0000 7fcd494d2640 1 -- 172.21.15.121:0/2477267983 >> 172.21.15.121:0/2477267983 conn(0x7fcd440a85e0 msgr2=0x7fcd440a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:49.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.202+0000 7fcd494d2640 1 -- 172.21.15.121:0/2477267983 shutdown_connections 2024-09-15T23:56:49.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.202+0000 7fcd494d2640 1 -- 172.21.15.121:0/2477267983 wait complete. 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd494d2640 1 Processor -- start 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd494d2640 1 -- start start 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd494d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd494d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441329c0 con 0x7fcd440a39c0 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd42ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36224/0 (socket says 172.21.15.121:36224) 2024-09-15T23:56:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd42ffd640 1 -- 172.21.15.121:0/1889099675 learned_addr learned my addr 172.21.15.121:0/1889099675 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.203+0000 7fcd42ffd640 1 -- 172.21.15.121:0/1889099675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4409e9e0 con 0x7fcd440a39c0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd42ffd640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a8c0 tx=0x7fcd340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd3403f030 con 0x7fcd440a39c0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd34033ad0 con 0x7fcd440a39c0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd34033df0 con 0x7fcd440a39c0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd44070240 con 0x7fcd440a39c0 2024-09-15T23:56:49.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.204+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4406ff30 con 0x7fcd440a39c0 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.205+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 45848+0+0 (secure 0 0 0) 0x7fcd34042030 con 0x7fcd440a39c0 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.205+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd440711d0 con 0x7fcd440a39c0 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.205+0000 7fcd2b7fe640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 0x7fcd3003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.205+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fcd34040070 con 0x7fcd440a39c0 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.205+0000 7fcd427fc640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 0x7fcd3003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.206+0000 7fcd427fc640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 0x7fcd3003a8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd38000c00 tx=0x7fcd38007a40 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.210+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd3403b900 con 0x7fcd440a39c0 2024-09-15T23:56:49.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.387+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcd440a23d0 con 0x7fcd440a39c0 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.388+0000 7fcd2b7fe640 1 -- 172.21.15.121:0/1889099675 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) ==== 80+0+359 (secure 0 0 0) 0x7fcd3406c080 con 0x7fcd440a39c0 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/110451684 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3314538443 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1594878766 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1255371049 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.390 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 msgr2=0x7fcd3003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 0x7fcd3003a8d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcd38000c00 tx=0x7fcd38007a40 comp rx=0 tx=0).stop 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 msgr2=0x7fcd44070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a8c0 tx=0x7fcd340046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 shutdown_connections 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd30038410 0x7fcd3003a8d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 --2- 172.21.15.121:0/1889099675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd440a39c0 0x7fcd44070c90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 >> 172.21.15.121:0/1889099675 conn(0x7fcd440a85e0 msgr2=0x7fcd440a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 shutdown_connections 2024-09-15T23:56:49.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.390+0000 7fcd494d2640 1 -- 172.21.15.121:0/1889099675 wait complete. 2024-09-15T23:56:49.403 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:49.403 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:49.420 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:49.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.557+0000 7f9652ac9640 1 Processor -- start 2024-09-15T23:56:49.559 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.557+0000 7f9652ac9640 1 -- start start 2024-09-15T23:56:49.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f9652ac9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f964c0a1c80 0x7f964c13a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.560 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f9652ac9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964c09f2f0 con 0x7f964c13a220 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f9652ac9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f964c0a07d0 con 0x7f964c0a1c80 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f964bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f964c0a1c80 0x7f964c13a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f9650865640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f964c13a220 0x7f964c136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:36802/0 (socket says 172.21.15.121:36802) 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f9650865640 1 -- 172.21.15.121:0/4018000552 learned_addr learned my addr 172.21.15.121:0/4018000552 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f964bfff640 1 -- 172.21.15.121:0/4018000552 >> v1:172.21.15.121:6789/0 conn(0x7f964c13a220 legacy=0x7f964c136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.561 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.558+0000 7f964bfff640 1 -- 172.21.15.121:0/4018000552 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c139dd0 con 0x7f964c0a1c80 2024-09-15T23:56:49.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.559+0000 7f964bfff640 1 --2- 172.21.15.121:0/4018000552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c13a600 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9640009720 tx=0x7f964002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9820c204bcc30c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.559+0000 7f964b7fe640 1 -- 172.21.15.121:0/4018000552 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9640037070 con 0x7f964c0a1c80 2024-09-15T23:56:49.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.559+0000 7f964b7fe640 1 -- 172.21.15.121:0/4018000552 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964002ad90 con 0x7f964c0a1c80 2024-09-15T23:56:49.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.559+0000 7f964b7fe640 1 -- 172.21.15.121:0/4018000552 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9640032590 con 0x7f964c0a1c80 2024-09-15T23:56:49.562 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 -- 172.21.15.121:0/4018000552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 msgr2=0x7f964c13a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 --2- 172.21.15.121:0/4018000552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c13a600 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9640009720 tx=0x7f964002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 -- 172.21.15.121:0/4018000552 shutdown_connections 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 --2- 172.21.15.121:0/4018000552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c13a600 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 -- 172.21.15.121:0/4018000552 >> 172.21.15.121:0/4018000552 conn(0x7f964c06d820 msgr2=0x7f964c06dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 -- 172.21.15.121:0/4018000552 shutdown_connections 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.560+0000 7f9652ac9640 1 -- 172.21.15.121:0/4018000552 wait complete. 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9652ac9640 1 Processor -- start 2024-09-15T23:56:49.563 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9652ac9640 1 -- start start 2024-09-15T23:56:49.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9652ac9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9652ac9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f964c139a20 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9650865640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9650865640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36248/0 (socket says 172.21.15.121:36248) 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.561+0000 7f9650865640 1 -- 172.21.15.121:0/3030763588 learned_addr learned my addr 172.21.15.121:0/3030763588 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f9650865640 1 -- 172.21.15.121:0/3030763588 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c0aa390 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f9650865640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c4a0 tx=0x7f963c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f963c017070 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963c005c10 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c0a97d0 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f963c007070 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.562+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c0a94c0 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.563+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 45848+0+0 (secure 0 0 0) 0x7f963c01a070 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.563+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964c0a0100 con 0x7f964c0a1c80 2024-09-15T23:56:49.567 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.563+0000 7f96497fa640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 0x7f963803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:49.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.563+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f963c04aad0 con 0x7f964c0a1c80 2024-09-15T23:56:49.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.563+0000 7f964bfff640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 0x7f963803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:49.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.564+0000 7f964bfff640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 0x7f963803a8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f964c0a20c0 tx=0x7f964002e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:49.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.568+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f964c09f2f0 con 0x7f964c0a1c80 2024-09-15T23:56:49.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.747+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f964c0a1200 con 0x7f964c0a1c80 2024-09-15T23:56:49.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.747+0000 7f96497fa640 1 -- 172.21.15.121:0/3030763588 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) ==== 80+0+359 (secure 0 0 0) 0x7f963c012450 con 0x7f964c0a1c80 2024-09-15T23:56:49.749 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/110451684 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.749 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3314538443 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.750 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.750 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.750 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1594878766 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.750 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1255371049 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:49.750 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 msgr2=0x7f963803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 0x7f963803a8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f964c0a20c0 tx=0x7f964002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 msgr2=0x7f964c0a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c4a0 tx=0x7f963c00c960 comp rx=0 tx=0).stop 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 shutdown_connections 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f9638038410 0x7f963803a8d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 --2- 172.21.15.121:0/3030763588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f964c0a1c80 0x7f964c0a5e50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:49.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 >> 172.21.15.121:0/3030763588 conn(0x7f964c06d820 msgr2=0x7f964c1362e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:49.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 shutdown_connections 2024-09-15T23:56:49.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:49.749+0000 7f9652ac9640 1 -- 172.21.15.121:0/3030763588 wait complete. 2024-09-15T23:56:49.762 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:49.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:49.762 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:49.785 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[50053]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:49.787 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:56:49.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:49.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:49.867 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:56:49.883 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:56:50.022 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.020+0000 7fd4c6b9f640 1 Processor -- start 2024-09-15T23:56:50.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c6b9f640 1 -- start start 2024-09-15T23:56:50.023 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c6b9f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4c0139f40 0x7fd4c00a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c6b9f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c009f510 con 0x7fd4c013a320 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c6b9f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c00a20b0 con 0x7fd4c0139f40 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c5b9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd4c0139f40 0x7fd4c00a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c539c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd4c013a320 0x7fd4c009da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:36804/0 (socket says 172.21.15.121:36804) 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.021+0000 7fd4c539c640 1 -- 172.21.15.121:0/590775609 learned_addr learned my addr 172.21.15.121:0/590775609 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c5b9d640 1 -- 172.21.15.121:0/590775609 >> v1:172.21.15.121:6789/0 conn(0x7fd4c013a320 legacy=0x7fd4c009da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c5b9d640 1 -- 172.21.15.121:0/590775609 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c00a0f60 con 0x7fd4c0139f40 2024-09-15T23:56:50.024 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c4b9b640 1 -- 172.21.15.121:0/590775609 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430240589 0 0) 0x7fd4c009f510 con 0x7fd4c013a320 2024-09-15T23:56:50.025 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c5b9d640 1 --2- 172.21.15.121:0/590775609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c00a19c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009720 tx=0x7fd4bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bd1392f7aef609 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c4b9b640 1 -- 172.21.15.121:0/590775609 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc037070 con 0x7fd4c0139f40 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c4b9b640 1 -- 172.21.15.121:0/590775609 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc02ad90 con 0x7fd4c0139f40 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.022+0000 7fd4c4b9b640 1 -- 172.21.15.121:0/590775609 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc032590 con 0x7fd4c0139f40 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/590775609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 msgr2=0x7fd4c00a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/590775609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c00a19c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009720 tx=0x7fd4bc02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/590775609 shutdown_connections 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/590775609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c00a19c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/590775609 >> 172.21.15.121:0/590775609 conn(0x7fd4c006d430 msgr2=0x7fd4c006d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/590775609 shutdown_connections 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.023+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/590775609 wait complete. 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c6b9f640 1 Processor -- start 2024-09-15T23:56:50.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c6b9f640 1 -- start start 2024-09-15T23:56:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c6b9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c6b9f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c00a0180 con 0x7fd4c0139f40 2024-09-15T23:56:50.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c5b9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c5b9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36270/0 (socket says 172.21.15.121:36270) 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.024+0000 7fd4c5b9d640 1 -- 172.21.15.121:0/1300055164 learned_addr learned my addr 172.21.15.121:0/1300055164 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4c5b9d640 1 -- 172.21.15.121:0/1300055164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c0123640 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4c5b9d640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009840 tx=0x7fd4bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc041020 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc03d550 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c0123330 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4bc037040 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.025+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c00ab030 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 45848+0+0 (secure 0 0 0) 0x7fd4bc044020 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c00008d0 con 0x7fd4c0139f40 2024-09-15T23:56:50.029 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4b27fc640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 0x7fd4a403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fd4bc06bee0 con 0x7fd4c0139f40 2024-09-15T23:56:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4c539c640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 0x7fd4a403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:50.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.026+0000 7fd4c539c640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 0x7fd4a403a8d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b4007910 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:50.032 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.031+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4bc04b030 con 0x7fd4c0139f40 2024-09-15T23:56:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.235+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4c0123860 con 0x7fd4c0139f40 2024-09-15T23:56:50.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.235+0000 7fd4b27fc640 1 -- 172.21.15.121:0/1300055164 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+152 (secure 0 0 0) 0x7fd4bc03d920 con 0x7fd4c0139f40 2024-09-15T23:56:50.237 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:56:50.237 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs_b, metadata pool: cephfs_b_metadata, data pools: [cephfs_b_data ] 2024-09-15T23:56:50.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 msgr2=0x7fd4a403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 0x7fd4a403a8d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4000c00 tx=0x7fd4b4007910 comp rx=0 tx=0).stop 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 msgr2=0x7fd4c0138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009840 tx=0x7fd4bc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 shutdown_connections 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fd4a4038410 0x7fd4a403a8d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.237+0000 7fd4c6b9f640 1 --2- 172.21.15.121:0/1300055164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4c0139f40 0x7fd4c0138bc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:50.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.238+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 >> 172.21.15.121:0/1300055164 conn(0x7fd4c006d430 msgr2=0x7fd4c01c1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:50.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.238+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 shutdown_connections 2024-09-15T23:56:50.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50.238+0000 7fd4c6b9f640 1 -- 172.21.15.121:0/1300055164 wait complete. 2024-09-15T23:56:50.251 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:56:50.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:56:50.252 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:50.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.252 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:50.270 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42722sec preferred_lft 42722sec 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:56:50.271 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:56:50.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.273 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:56:50.333 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:56:50.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.335 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:56:50.390 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:56:50.391 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:56:50.391 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:56:50.391 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:56:50.391 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:56:50.391 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:56:50.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:56:50.509 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:50.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.516 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:56:50.531 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:56:50.531 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:56:50.531 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:50.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.531 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:56:50.596 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:56:50.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:50.597 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:50.652 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:56:50.652 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:56:50.652 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:50.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:50.772 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:50.829 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:50.830 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:50.831 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:50.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:50.832 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:50.885 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:50.886 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:56:50.886 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=cephfs) 2024-09-15T23:56:50.928 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:56:50.952 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:56:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:56:51.010 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:51.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:51.012 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:56:51.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:56:51.007+0000 7f4e9048b480 -1 init, newargv = 0x563dfbb97ea0 newargc=15 2024-09-15T23:56:51.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[51257]: starting ceph client 2024-09-15T23:56:51.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[51257]: starting fuse 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:56:51.028 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:56:51.029 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:51.029 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:56:51.030 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:56:51.146 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.51257.asok 2024-09-15T23:56:51.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:56:51.156 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.51257.asok 2024-09-15T23:56:51.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:51.157 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.51257.asok status 2024-09-15T23:56:51.290 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:56:51.290 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:56:51.290 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "51257", 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4711, 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:56:51.291 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4711 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1765081306 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1765081306 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:56:51.292 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4711 192.168.0.2:0/1765081306", 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/1765081306", 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 18, 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 43, 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:56:51.293 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:56:51.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:51.299 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:56:51.299 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:51.315 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:56:51.315 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:51.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:51.315 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:51.379 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-15T23:56:51.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.518+0000 7f0500217640 1 Processor -- start 2024-09-15T23:56:51.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.518+0000 7f0500217640 1 -- start start 2024-09-15T23:56:51.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.518+0000 7f0500217640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04f80a3b90 0x7f04f80a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.518+0000 7f0500217640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f80a4560 con 0x7f04f80a37b0 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.518+0000 7f0500217640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f04f809b4f0 con 0x7f04f80a3b90 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fd7b2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04f80a3b90 0x7f04f80a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fdfb3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f04f80a37b0 0x7f04f809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:36810/0 (socket says 172.21.15.121:36810) 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fd7b2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f04f80a3b90 0x7f04f80a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36284/0 (socket says 172.21.15.121:36284) 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fdfb3640 1 -- 172.21.15.121:0/3979444364 learned_addr learned my addr 172.21.15.121:0/3979444364 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fd7b2640 1 -- 172.21.15.121:0/3979444364 >> v1:172.21.15.121:6789/0 conn(0x7f04f80a37b0 legacy=0x7f04f809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fd7b2640 1 -- 172.21.15.121:0/3979444364 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80a1c90 con 0x7f04f80a3b90 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.519+0000 7f04fcfb1640 1 -- 172.21.15.121:0/3979444364 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236051414 0 0) 0x7f04f80a4560 con 0x7f04f80a37b0 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f04fd7b2640 1 --2- 172.21.15.121:0/3979444364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a3b90 0x7f04f80a4020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009720 tx=0x7f04e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceab813380dff1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f04fcfb1640 1 -- 172.21.15.121:0/3979444364 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04e8037070 con 0x7f04f80a3b90 2024-09-15T23:56:51.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f04fcfb1640 1 -- 172.21.15.121:0/3979444364 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e802ad90 con 0x7f04f80a3b90 2024-09-15T23:56:51.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f04fcfb1640 1 -- 172.21.15.121:0/3979444364 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04e8032590 con 0x7f04f80a3b90 2024-09-15T23:56:51.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 -- 172.21.15.121:0/3979444364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a3b90 msgr2=0x7f04f80a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 --2- 172.21.15.121:0/3979444364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a3b90 0x7f04f80a4020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009720 tx=0x7f04e802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:51.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 -- 172.21.15.121:0/3979444364 shutdown_connections 2024-09-15T23:56:51.526 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 --2- 172.21.15.121:0/3979444364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a3b90 0x7f04f80a4020 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 -- 172.21.15.121:0/3979444364 >> 172.21.15.121:0/3979444364 conn(0x7f04f80a8430 msgr2=0x7f04f80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 -- 172.21.15.121:0/3979444364 shutdown_connections 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.520+0000 7f0500217640 1 -- 172.21.15.121:0/3979444364 wait complete. 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.521+0000 7f0500217640 1 Processor -- start 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.521+0000 7f0500217640 1 -- start start 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f0500217640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f0500217640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80a5220 con 0x7f04f80a37b0 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04fdfb3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04fdfb3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36298/0 (socket says 172.21.15.121:36298) 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04fdfb3640 1 -- 172.21.15.121:0/3758451194 learned_addr learned my addr 172.21.15.121:0/3758451194 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04fdfb3640 1 -- 172.21.15.121:0/3758451194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f8070810 con 0x7f04f80a37b0 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04fdfb3640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c420 tx=0x7f04f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f4018070 con 0x7f04f80a37b0 2024-09-15T23:56:51.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f40074d0 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04f4004950 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f811e9a0 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.522+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f8071ff0 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.523+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 45848+0+0 (secure 0 0 0) 0x7f04f401b070 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.523+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f80a4020 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.524+0000 7f04ee7fc640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 0x7f04dc03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.524+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f04f404ab90 con 0x7f04f80a37b0 2024-09-15T23:56:51.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.524+0000 7f04fd7b2640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 0x7f04dc03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.524+0000 7f04fd7b2640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 0x7f04dc03a8d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009720 tx=0x7f04e802e000 comp rx=0 tx=0).ready entity=mgr.4609 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.528+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04f8070810 con 0x7f04f80a37b0 2024-09-15T23:56:51.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.741+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7f04f80a1f00 con 0x7f04f80a37b0 2024-09-15T23:56:51.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.745+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v21) ==== 85+0+0 (secure 0 0 0) 0x7f04f4011950 con 0x7f04f80a37b0 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.747+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 msgr2=0x7f04dc03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.747+0000 7f0500217640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 0x7f04dc03a8d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009720 tx=0x7f04e802e000 comp rx=0 tx=0).stop 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.747+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 msgr2=0x7f04f80710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.747+0000 7f0500217640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f04f400c420 tx=0x7f04f400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.747+0000 7f04ee7fc640 1 -- 172.21.15.121:0/3758451194 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f04f401c8d0 con 0x7f04f80a37b0 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 shutdown_connections 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f04dc038410 0x7f04dc03a8d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 --2- 172.21.15.121:0/3758451194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f04f80a37b0 0x7f04f80710e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 >> 172.21.15.121:0/3758451194 conn(0x7f04f80a8430 msgr2=0x7f04f81bee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:51.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 shutdown_connections 2024-09-15T23:56:51.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.748+0000 7f0500217640 1 -- 172.21.15.121:0/3758451194 wait complete. 2024-09-15T23:56:51.761 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:56:51.761 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:56:51.809 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:56:51.809 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:51.809 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:51.809 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:51.825 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:51.870 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:51.868+0000 7f4067a16040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:56:51.913 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:51.912+0000 7f4067a16040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.964+0000 7fcd7d627640 1 Processor -- start 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.964+0000 7fcd7d627640 1 -- start start 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.964+0000 7fcd7d627640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd78135b50 0x7fcd7809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.964+0000 7fcd7d627640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7809b020 con 0x7fcd78135f30 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.964+0000 7fcd7d627640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7809b310 con 0x7fcd78135b50 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd76ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcd78135b50 0x7fcd7809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd767fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcd78135f30 0x7fcd780a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:36842/0 (socket says 172.21.15.121:36842) 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd767fc640 1 -- 172.21.15.121:0/813798848 learned_addr learned my addr 172.21.15.121:0/813798848 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd76ffd640 1 -- 172.21.15.121:0/813798848 >> v1:172.21.15.121:6789/0 conn(0x7fcd78135f30 legacy=0x7fcd780a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd76ffd640 1 -- 172.21.15.121:0/813798848 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd780a08c0 con 0x7fcd78135b50 2024-09-15T23:56:51.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.965+0000 7fcd75ffb640 1 -- 172.21.15.121:0/813798848 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104704570 0 0) 0x7fcd7809b020 con 0x7fcd78135f30 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd76ffd640 1 --2- 172.21.15.121:0/813798848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809aae0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009720 tx=0x7fcd6002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea5d41dd77b5dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd75ffb640 1 -- 172.21.15.121:0/813798848 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd60037070 con 0x7fcd78135b50 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd75ffb640 1 -- 172.21.15.121:0/813798848 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6002ae20 con 0x7fcd78135b50 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd75ffb640 1 -- 172.21.15.121:0/813798848 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd60032590 con 0x7fcd78135b50 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 -- 172.21.15.121:0/813798848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 msgr2=0x7fcd7809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 --2- 172.21.15.121:0/813798848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809aae0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009720 tx=0x7fcd6002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 -- 172.21.15.121:0/813798848 shutdown_connections 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 --2- 172.21.15.121:0/813798848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809aae0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 -- 172.21.15.121:0/813798848 >> 172.21.15.121:0/813798848 conn(0x7fcd780a85e0 msgr2=0x7fcd780a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 -- 172.21.15.121:0/813798848 shutdown_connections 2024-09-15T23:56:51.969 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.966+0000 7fcd7d627640 1 -- 172.21.15.121:0/813798848 wait complete. 2024-09-15T23:56:51.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.967+0000 7fcd7d627640 1 Processor -- start 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.967+0000 7fcd7d627640 1 -- start start 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd7d627640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd7d627640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcd780a5430 con 0x7fcd78135b50 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd76ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36346/0 (socket says 172.21.15.121:36346) 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd76ffd640 1 -- 172.21.15.121:0/2076531361 learned_addr learned my addr 172.21.15.121:0/2076531361 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd76ffd640 1 -- 172.21.15.121:0/2076531361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7809d460 con 0x7fcd78135b50 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.968+0000 7fcd76ffd640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd60035040 tx=0x7fcd600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.969+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd60037040 con 0x7fcd78135b50 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.969+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd60032e30 con 0x7fcd78135b50 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.969+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd78125d80 con 0x7fcd78135b50 2024-09-15T23:56:51.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.969+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd60004160 con 0x7fcd78135b50 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.969+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7809d180 con 0x7fcd78135b50 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd78136350 con 0x7fcd78135b50 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7fcd6003a040 con 0x7fcd78135b50 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd6f7fe640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 0x7fcd5803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fcd6006c100 con 0x7fcd78135b50 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd767fc640 1 -- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 msgr2=0x7fcd5803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:51.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.970+0000 7fcd767fc640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 0x7fcd5803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:51.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:51.974+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd60042020 con 0x7fcd78135b50 2024-09-15T23:56:52.051 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.048+0000 7f4067a16040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:56:52.099 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.097+0000 7f4067a16040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:56:52.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.156+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcd780a1f10 con 0x7fcd78135b50 2024-09-15T23:56:52.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.156+0000 7fcd6f7fe640 1 -- 172.21.15.121:0/2076531361 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) ==== 80+0+359 (secure 0 0 0) 0x7fcd6006e230 con 0x7fcd78135b50 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/110451684 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3314538443 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1594878766 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1255371049 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.159 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 msgr2=0x7fcd5803a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:52.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 0x7fcd5803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 msgr2=0x7fcd7809b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcd60035040 tx=0x7fcd600046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 shutdown_connections 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fcd580383c0 0x7fcd5803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 --2- 172.21.15.121:0/2076531361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcd78135b50 0x7fcd7809b570 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.158+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 >> 172.21.15.121:0/2076531361 conn(0x7fcd780a85e0 msgr2=0x7fcd780a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.159+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 shutdown_connections 2024-09-15T23:56:52.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.159+0000 7fcd7d627640 1 -- 172.21.15.121:0/2076531361 wait complete. 2024-09-15T23:56:52.172 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:52.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:52.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:56:52.210 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.208+0000 7f4067a16040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:52.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[48282]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:52.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:52.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:52.235 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:56:52.292 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:56:52.292 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:56:52.292 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:56:52.309 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.307+0000 7f4067a16040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:56:52.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:56:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.462+0000 7f8b2e7e8640 1 Processor -- start 2024-09-15T23:56:52.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.462+0000 7f8b2e7e8640 1 -- start start 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b2e7e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b280a4c20 0x7f8b2813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b2e7e8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2813a080 con 0x7f8b2813a280 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b2e7e8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8b280a3d50 con 0x7f8b280a4c20 2024-09-15T23:56:52.465 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b277fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8b280a4c20 0x7f8b2813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b27fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8b2813a280 0x7f8b2813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57392/0 (socket says 172.21.15.121:57392) 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b27fff640 1 -- 172.21.15.121:0/1266021708 learned_addr learned my addr 172.21.15.121:0/1266021708 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b277fe640 1 -- 172.21.15.121:0/1266021708 >> v1:172.21.15.121:6789/0 conn(0x7f8b2813a280 legacy=0x7f8b2813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.463+0000 7f8b277fe640 1 -- 172.21.15.121:0/1266021708 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b280a3f80 con 0x7f8b280a4c20 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.464+0000 7f8b277fe640 1 --2- 172.21.15.121:0/1266021708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b2813f060 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009720 tx=0x7f8b1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15077681e5cd1ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.464+0000 7f8b26ffd640 1 -- 172.21.15.121:0/1266021708 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b10037070 con 0x7f8b280a4c20 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.464+0000 7f8b26ffd640 1 -- 172.21.15.121:0/1266021708 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1002ad90 con 0x7f8b280a4c20 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.464+0000 7f8b26ffd640 1 -- 172.21.15.121:0/1266021708 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b10032590 con 0x7f8b280a4c20 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/1266021708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 msgr2=0x7f8b2813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/1266021708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b2813f060 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b10009720 tx=0x7f8b1002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/1266021708 shutdown_connections 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/1266021708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b2813f060 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/1266021708 >> 172.21.15.121:0/1266021708 conn(0x7f8b280ac3e0 msgr2=0x7f8b280ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/1266021708 shutdown_connections 2024-09-15T23:56:52.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.465+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/1266021708 wait complete. 2024-09-15T23:56:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b2e7e8640 1 Processor -- start 2024-09-15T23:56:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b2e7e8640 1 -- start start 2024-09-15T23:56:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b2e7e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b2e7e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b280a7ec0 con 0x7f8b280a4c20 2024-09-15T23:56:52.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b27fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37862/0 (socket says 172.21.15.121:37862) 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.466+0000 7f8b27fff640 1 -- 172.21.15.121:0/2770273285 learned_addr learned my addr 172.21.15.121:0/2770273285 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b27fff640 1 -- 172.21.15.121:0/2770273285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28125070 con 0x7f8b280a4c20 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b27fff640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c4a0 tx=0x7f8b1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18017070 con 0x7f8b280a4c20 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b18005c10 con 0x7f8b280a4c20 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b28124780 con 0x7f8b280a4c20 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18007070 con 0x7f8b280a4c20 2024-09-15T23:56:52.470 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.467+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b28124470 con 0x7f8b280a4c20 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f8b1801a070 con 0x7f8b280a4c20 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b28122c20 con 0x7f8b280a4c20 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b24ff9640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 0x7f8b0803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b277fe640 1 -- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 msgr2=0x7f8b0803a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f8b1804ab40 con 0x7f8b280a4c20 2024-09-15T23:56:52.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.468+0000 7f8b277fe640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 0x7f8b0803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:52.474 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.473+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b18012450 con 0x7f8b280a4c20 2024-09-15T23:56:52.599 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.597+0000 7f4067a16040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:56:52.643 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.641+0000 7f4067a16040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:56:52.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.669+0000 7f8b277fe640 1 -- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 msgr2=0x7f8b0803a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:52.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.669+0000 7f8b277fe640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 0x7f8b0803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:52.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.672+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8b28124950 con 0x7f8b280a4c20 2024-09-15T23:56:52.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.672+0000 7f8b24ff9640 1 -- 172.21.15.121:0/2770273285 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) ==== 80+0+359 (secure 0 0 0) 0x7f8b1801ac10 con 0x7f8b280a4c20 2024-09-15T23:56:52.674 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/110451684 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3314538443 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6827/1410518606 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1594878766 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1255371049 2024-09-16T23:56:32.172781+0000 2024-09-15T23:56:52.675 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:56:52.676 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 msgr2=0x7f8b0803a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 0x7f8b0803a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 msgr2=0x7f8b280a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c4a0 tx=0x7f8b1800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 shutdown_connections 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f8b08038370 0x7f8b0803a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 --2- 172.21.15.121:0/2770273285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b280a4c20 0x7f8b280a0ff0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 >> 172.21.15.121:0/2770273285 conn(0x7f8b280ac3e0 msgr2=0x7f8b280aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.674+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 shutdown_connections 2024-09-15T23:56:52.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.675+0000 7f8b2e7e8640 1 -- 172.21.15.121:0/2770273285 wait complete. 2024-09-15T23:56:52.688 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:56:52.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:52.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:56:52.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[51257]: fuse finished with error 0 and tester_r 0 2024-09-15T23:56:52.715 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:56:52.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:56:52.716 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:56:52.770 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:52.768+0000 7f4067a16040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:56:52.799 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:52.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfcd40e640 1 Processor -- start 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfcd40e640 1 -- start start 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfcd40e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdfc809ba80 0x7fdfc809be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfcd40e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc809ef60 con 0x7fdfc809c3a0 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfcd40e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc80a0060 con 0x7fdfc809ba80 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfc6ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdfc809ba80 0x7fdfc809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfbffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdfc809c3a0 0x7fdfc8137ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57398/0 (socket says 172.21.15.121:57398) 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.937+0000 7fdfbffff640 1 -- 172.21.15.121:0/591139744 learned_addr learned my addr 172.21.15.121:0/591139744 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.938+0000 7fdfc6ffd640 1 -- 172.21.15.121:0/591139744 >> v1:172.21.15.121:6789/0 conn(0x7fdfc809c3a0 legacy=0x7fdfc8137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.938+0000 7fdfc67fc640 1 -- 172.21.15.121:0/591139744 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871265592 0 0) 0x7fdfc809ef60 con 0x7fdfc809c3a0 2024-09-15T23:56:52.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.938+0000 7fdfc6ffd640 1 -- 172.21.15.121:0/591139744 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc809e6e0 con 0x7fdfc809ba80 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.938+0000 7fdfc6ffd640 1 --2- 172.21.15.121:0/591139744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc809be60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009720 tx=0x7fdfb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2a35651da887a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.938+0000 7fdfc67fc640 1 -- 172.21.15.121:0/591139744 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb8037070 con 0x7fdfc809ba80 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfc67fc640 1 -- 172.21.15.121:0/591139744 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb802ad90 con 0x7fdfc809ba80 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfc67fc640 1 -- 172.21.15.121:0/591139744 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb8032590 con 0x7fdfc809ba80 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 -- 172.21.15.121:0/591139744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 msgr2=0x7fdfc809be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/591139744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc809be60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009720 tx=0x7fdfb802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 -- 172.21.15.121:0/591139744 shutdown_connections 2024-09-15T23:56:52.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/591139744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc809be60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:52.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 -- 172.21.15.121:0/591139744 >> 172.21.15.121:0/591139744 conn(0x7fdfc8070cc0 msgr2=0x7fdfc80730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:52.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 -- 172.21.15.121:0/591139744 shutdown_connections 2024-09-15T23:56:52.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.939+0000 7fdfcd40e640 1 -- 172.21.15.121:0/591139744 wait complete. 2024-09-15T23:56:52.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.940+0000 7fdfcd40e640 1 Processor -- start 2024-09-15T23:56:52.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfcd40e640 1 -- start start 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfcd40e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfcd40e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80aa7f0 con 0x7fdfc809ba80 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37876/0 (socket says 172.21.15.121:37876) 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.941+0000 7fdfc6ffd640 1 -- 172.21.15.121:0/4089969100 learned_addr learned my addr 172.21.15.121:0/4089969100 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfc6ffd640 1 -- 172.21.15.121:0/4089969100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8136f00 con 0x7fdfc809ba80 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfc6ffd640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8035040 tx=0x7fdfb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb8037040 con 0x7fdfc809ba80 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8004030 con 0x7fdfc809ba80 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb8004310 con 0x7fdfc809ba80 2024-09-15T23:56:52.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc80a8550 con 0x7fdfc809ba80 2024-09-15T23:56:52.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.942+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc80a8210 con 0x7fdfc809ba80 2024-09-15T23:56:52.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7fdfb803a040 con 0x7fdfc809ba80 2024-09-15T23:56:52.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfbf7fe640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 0x7fdfa803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:52.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8137250 con 0x7fdfc809ba80 2024-09-15T23:56:52.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fdfb806c1d0 con 0x7fdfc809ba80 2024-09-15T23:56:52.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfbffff640 1 -- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 msgr2=0x7fdfa803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:52.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.943+0000 7fdfbffff640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 0x7fdfa803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:52.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:52.948+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfb8042020 con 0x7fdfc809ba80 2024-09-15T23:56:53.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.144+0000 7fdfbffff640 1 -- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 msgr2=0x7fdfa803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:53.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.144+0000 7fdfbffff640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 0x7fdfa803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:53.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.156+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc809dfb0 con 0x7fdfc809ba80 2024-09-15T23:56:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.157+0000 7fdfbf7fe640 1 -- 172.21.15.121:0/4089969100 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+4890 (secure 0 0 0) 0x7fdfb803ee20 con 0x7fdfc809ba80 2024-09-15T23:56:53.159 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:53.159 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-09-15T23:56:35:184080+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:53.159 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 msgr2=0x7fdfa803a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 0x7fdfa803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 msgr2=0x7fdfc80a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8035040 tx=0x7fdfb80046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 shutdown_connections 2024-09-15T23:56:53.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdfa80383c0 0x7fdfa803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 --2- 172.21.15.121:0/4089969100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfc809ba80 0x7fdfc80a7cd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 >> 172.21.15.121:0/4089969100 conn(0x7fdfc8070cc0 msgr2=0x7fdfc8138230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 shutdown_connections 2024-09-15T23:56:53.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.159+0000 7fdfcd40e640 1 -- 172.21.15.121:0/4089969100 wait complete. 2024-09-15T23:56:53.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:53.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.270+0000 7f29a07bd640 1 Processor -- start 2024-09-15T23:56:53.272 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.270+0000 7f29a07bd640 1 -- start start 2024-09-15T23:56:53.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.270+0000 7f29a07bd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f299813a280 0x7f299813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.270+0000 7f29a07bd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299813a080 con 0x7f29980a4c20 2024-09-15T23:56:53.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.270+0000 7f29a07bd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f29980a3d50 con 0x7f299813a280 2024-09-15T23:56:53.273 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.271+0000 7f299e559640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f299813a280 0x7f299813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.271+0000 7f299dd58640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f29980a4c20 0x7f29980a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57406/0 (socket says 172.21.15.121:57406) 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.271+0000 7f299dd58640 1 -- 172.21.15.121:0/3478031966 learned_addr learned my addr 172.21.15.121:0/3478031966 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.271+0000 7f299e559640 1 -- 172.21.15.121:0/3478031966 >> v1:172.21.15.121:6789/0 conn(0x7f29980a4c20 legacy=0x7f29980a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.271+0000 7f299e559640 1 -- 172.21.15.121:0/3478031966 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29980a3f80 con 0x7f299813a280 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f299e559640 1 --2- 172.21.15.121:0/3478031966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299813a280 0x7f299813a660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2994009720 tx=0x7f299402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86de90b1e062fdb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f299d557640 1 -- 172.21.15.121:0/3478031966 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2994037070 con 0x7f299813a280 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f299d557640 1 -- 172.21.15.121:0/3478031966 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299402ad90 con 0x7f299813a280 2024-09-15T23:56:53.274 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f299d557640 1 -- 172.21.15.121:0/3478031966 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2994032590 con 0x7f299813a280 2024-09-15T23:56:53.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 -- 172.21.15.121:0/3478031966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299813a280 msgr2=0x7f299813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 --2- 172.21.15.121:0/3478031966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299813a280 0x7f299813a660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2994009720 tx=0x7f299402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:53.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 -- 172.21.15.121:0/3478031966 shutdown_connections 2024-09-15T23:56:53.276 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 --2- 172.21.15.121:0/3478031966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f299813a280 0x7f299813a660 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 -- 172.21.15.121:0/3478031966 >> 172.21.15.121:0/3478031966 conn(0x7f29980ac3e0 msgr2=0x7f29980ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 -- 172.21.15.121:0/3478031966 shutdown_connections 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.272+0000 7f29a07bd640 1 -- 172.21.15.121:0/3478031966 wait complete. 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.273+0000 7f29a07bd640 1 Processor -- start 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.273+0000 7f29a07bd640 1 -- start start 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f29a07bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f29a07bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2998139d40 con 0x7f29980a4c20 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f299e559640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f299e559640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37898/0 (socket says 172.21.15.121:37898) 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f299e559640 1 -- 172.21.15.121:0/2018580990 learned_addr learned my addr 172.21.15.121:0/2018580990 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f299e559640 1 -- 172.21.15.121:0/2018580990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2998124ff0 con 0x7f29980a4c20 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f299e559640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2994009840 tx=0x7f29940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2994041020 con 0x7f29980a4c20 2024-09-15T23:56:53.277 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299403d550 con 0x7f29980a4c20 2024-09-15T23:56:53.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2998125270 con 0x7f29980a4c20 2024-09-15T23:56:53.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.274+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2994037040 con 0x7f29980a4c20 2024-09-15T23:56:53.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.275+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2998138290 con 0x7f29980a4c20 2024-09-15T23:56:53.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.275+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f2994044020 con 0x7f29980a4c20 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.275+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299806dab0 con 0x7f29980a4c20 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.276+0000 7f298effd640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 0x7f297c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.276+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f299406bf10 con 0x7f29980a4c20 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.276+0000 7f299dd58640 1 -- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 msgr2=0x7f297c03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.276+0000 7f299dd58640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 0x7f297c03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:53.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.280+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f299404b030 con 0x7f29980a4c20 2024-09-15T23:56:53.478 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.477+0000 7f299dd58640 1 -- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 msgr2=0x7f297c03a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:53.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.477+0000 7f299dd58640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 0x7f297c03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:53.489 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.487+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29980a2f50 con 0x7f29980a4c20 2024-09-15T23:56:53.490 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.488+0000 7f298effd640 1 -- 172.21.15.121:0/2018580990 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+4890 (secure 0 0 0) 0x7f2998124ff0 con 0x7f29980a4c20 2024-09-15T23:56:53.490 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:53.490 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-09-15T23:56:35:184080+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:53.491 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-09-15T23:56:53.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 msgr2=0x7f297c03a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:53.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 0x7f297c03a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 msgr2=0x7f29980a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2994009840 tx=0x7f29940046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 shutdown_connections 2024-09-15T23:56:53.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f297c0383c0 0x7f297c03a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.494 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 --2- 172.21.15.121:0/2018580990 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29980a4c20 0x7f29980a1150 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 >> 172.21.15.121:0/2018580990 conn(0x7f29980ac3e0 msgr2=0x7f29980aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 shutdown_connections 2024-09-15T23:56:53.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.490+0000 7f29a07bd640 1 -- 172.21.15.121:0/2018580990 wait complete. 2024-09-15T23:56:53.503 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:53.512 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:53.510+0000 7f4067a16040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:56:53.559 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:53.556+0000 7f4067a16040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:56:53.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.600+0000 7f87a4a65640 1 Processor -- start 2024-09-15T23:56:53.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.600+0000 7f87a4a65640 1 -- start start 2024-09-15T23:56:53.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f87a4a65640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87a013a280 0x7f87a013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f87a4a65640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a013a080 con 0x7f87a00a4c20 2024-09-15T23:56:53.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f87a4a65640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f87a00a3d50 con 0x7f87a013a280 2024-09-15T23:56:53.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f879e59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87a013a280 0x7f87a013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f879dd9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f87a00a4c20 0x7f87a00a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57408/0 (socket says 172.21.15.121:57408) 2024-09-15T23:56:53.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.601+0000 7f879dd9b640 1 -- 172.21.15.121:0/2855215527 learned_addr learned my addr 172.21.15.121:0/2855215527 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:53.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879e59c640 1 -- 172.21.15.121:0/2855215527 >> v1:172.21.15.121:6789/0 conn(0x7f87a00a4c20 legacy=0x7f87a00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.604 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879e59c640 1 -- 172.21.15.121:0/2855215527 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a00a3f80 con 0x7f87a013a280 2024-09-15T23:56:53.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879e59c640 1 --2- 172.21.15.121:0/2855215527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a013a280 0x7f87a013a660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8790009720 tx=0x7f879002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c625503bdedaff6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879d59a640 1 -- 172.21.15.121:0/2855215527 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790037070 con 0x7f87a013a280 2024-09-15T23:56:53.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879d59a640 1 -- 172.21.15.121:0/2855215527 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879002ad90 con 0x7f87a013a280 2024-09-15T23:56:53.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.602+0000 7f879d59a640 1 -- 172.21.15.121:0/2855215527 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790032590 con 0x7f87a013a280 2024-09-15T23:56:53.605 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 -- 172.21.15.121:0/2855215527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a013a280 msgr2=0x7f87a013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 --2- 172.21.15.121:0/2855215527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a013a280 0x7f87a013a660 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8790009720 tx=0x7f879002a110 comp rx=0 tx=0).stop 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 -- 172.21.15.121:0/2855215527 shutdown_connections 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 --2- 172.21.15.121:0/2855215527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a013a280 0x7f87a013a660 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 -- 172.21.15.121:0/2855215527 >> 172.21.15.121:0/2855215527 conn(0x7f87a00ac3e0 msgr2=0x7f87a00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 -- 172.21.15.121:0/2855215527 shutdown_connections 2024-09-15T23:56:53.606 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.603+0000 7f87a4a65640 1 -- 172.21.15.121:0/2855215527 wait complete. 2024-09-15T23:56:53.607 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.604+0000 7f87a4a65640 1 Processor -- start 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.604+0000 7f87a4a65640 1 -- start start 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f87a4a65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f87a4a65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87a0139d40 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f879e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f879e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37908/0 (socket says 172.21.15.121:37908) 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f879e59c640 1 -- 172.21.15.121:0/3438742753 learned_addr learned my addr 172.21.15.121:0/3438742753 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f879e59c640 1 -- 172.21.15.121:0/3438742753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a0124ff0 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f879e59c640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8790009840 tx=0x7f87900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790041020 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879003d550 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8790037040 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.605+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a0125270 con 0x7f87a00a4c20 2024-09-15T23:56:53.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.606+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a0138290 con 0x7f87a00a4c20 2024-09-15T23:56:53.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.606+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f8790044020 con 0x7f87a00a4c20 2024-09-15T23:56:53.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.606+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a006dab0 con 0x7f87a00a4c20 2024-09-15T23:56:53.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.607+0000 7f878effd640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 0x7f878003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.607+0000 7f879dd9b640 1 -- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 msgr2=0x7f878003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:53.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.607+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f879006bf10 con 0x7f87a00a4c20 2024-09-15T23:56:53.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.607+0000 7f879dd9b640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 0x7f878003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:53.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.615+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f879004b030 con 0x7f87a00a4c20 2024-09-15T23:56:53.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.788+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87a00a2f50 con 0x7f87a00a4c20 2024-09-15T23:56:53.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.789+0000 7f878effd640 1 -- 172.21.15.121:0/3438742753 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+14947 (secure 0 0 0) 0x7f87a0124ff0 con 0x7f87a00a4c20 2024-09-15T23:56:53.791 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:53.791 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:33.704066+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 msgr2=0x7f878003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 0x7f878003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 msgr2=0x7f87a00a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f8790009840 tx=0x7f87900046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 shutdown_connections 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f87800383c0 0x7f878003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 --2- 172.21.15.121:0/3438742753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87a00a4c20 0x7f87a00a1150 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 >> 172.21.15.121:0/3438742753 conn(0x7f87a00ac3e0 msgr2=0x7f87a00aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 shutdown_connections 2024-09-15T23:56:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.791+0000 7f87a4a65640 1 -- 172.21.15.121:0/3438742753 wait complete. 2024-09-15T23:56:53.806 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:56:53.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:53.886 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:53.884+0000 7f4067a16040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:56:53.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.943+0000 7f36fb237640 1 Processor -- start 2024-09-15T23:56:53.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.943+0000 7f36fb237640 1 -- start start 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36fb237640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36f413a280 0x7f36f413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36fb237640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f413a080 con 0x7f36f40a4c20 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36fb237640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f36f40a3d50 con 0x7f36f413a280 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36f8fd3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f36f413a280 0x7f36f413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36f3fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f36f40a4c20 0x7f36f40a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57414/0 (socket says 172.21.15.121:57414) 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36f3fff640 1 -- 172.21.15.121:0/71646894 learned_addr learned my addr 172.21.15.121:0/71646894 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36f8fd3640 1 -- 172.21.15.121:0/71646894 >> v1:172.21.15.121:6789/0 conn(0x7f36f40a4c20 legacy=0x7f36f40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.944+0000 7f36f8fd3640 1 -- 172.21.15.121:0/71646894 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f40a3f80 con 0x7f36f413a280 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.945+0000 7f36f8fd3640 1 --2- 172.21.15.121:0/71646894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f413a280 0x7f36f413a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009720 tx=0x7f36e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a95119efb2273 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.945+0000 7f36f37fe640 1 -- 172.21.15.121:0/71646894 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e8037070 con 0x7f36f413a280 2024-09-15T23:56:53.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.945+0000 7f36f37fe640 1 -- 172.21.15.121:0/71646894 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e802ad90 con 0x7f36f413a280 2024-09-15T23:56:53.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.945+0000 7f36f37fe640 1 -- 172.21.15.121:0/71646894 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e8032590 con 0x7f36f413a280 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 -- 172.21.15.121:0/71646894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f413a280 msgr2=0x7f36f413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 --2- 172.21.15.121:0/71646894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f413a280 0x7f36f413a660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009720 tx=0x7f36e802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 -- 172.21.15.121:0/71646894 shutdown_connections 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 --2- 172.21.15.121:0/71646894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f413a280 0x7f36f413a660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 -- 172.21.15.121:0/71646894 >> 172.21.15.121:0/71646894 conn(0x7f36f40ac3e0 msgr2=0x7f36f40ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 -- 172.21.15.121:0/71646894 shutdown_connections 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.946+0000 7f36fb237640 1 -- 172.21.15.121:0/71646894 wait complete. 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.947+0000 7f36fb237640 1 Processor -- start 2024-09-15T23:56:53.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.947+0000 7f36fb237640 1 -- start start 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.947+0000 7f36fb237640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.947+0000 7f36fb237640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f36f4139d40 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.947+0000 7f36f8fd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f8fd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37932/0 (socket says 172.21.15.121:37932) 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f8fd3640 1 -- 172.21.15.121:0/3412220733 learned_addr learned my addr 172.21.15.121:0/3412220733 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f8fd3640 1 -- 172.21.15.121:0/3412220733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f4125a30 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f8fd3640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009720 tx=0x7f36e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e8041020 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f4123a80 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e803d550 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36e8037040 con 0x7f36f40a4c20 2024-09-15T23:56:53.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.948+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f40a21c0 con 0x7f36f40a4c20 2024-09-15T23:56:53.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f36e8044020 con 0x7f36f40a4c20 2024-09-15T23:56:53.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f406dab0 con 0x7f36f40a4c20 2024-09-15T23:56:53.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36f17fa640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 0x7f36d803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:53.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f36e806c000 con 0x7f36f40a4c20 2024-09-15T23:56:53.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36f3fff640 1 -- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 msgr2=0x7f36d803a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:53.953 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.949+0000 7f36f3fff640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 0x7f36d803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:53.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:53.954+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36e804b030 con 0x7f36f40a4c20 2024-09-15T23:56:53.974 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:53.973+0000 7f4067a16040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:56:54.085 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.083+0000 7f4067a16040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:56:54.129 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.127+0000 7f4067a16040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:56:54.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.150+0000 7f36f3fff640 1 -- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 msgr2=0x7f36d803a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:54.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.150+0000 7f36f3fff640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 0x7f36d803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:54.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.160+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36f40a2f50 con 0x7f36f40a4c20 2024-09-15T23:56:54.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.161+0000 7f36f17fa640 1 -- 172.21.15.121:0/3412220733 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+4890 (secure 0 0 0) 0x7f36e8045570 con 0x7f36f40a4c20 2024-09-15T23:56:54.163 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:54.163 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-09-15T23:56:35:184080+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:54.163 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 msgr2=0x7f36d803a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 0x7f36d803a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 msgr2=0x7f36f4125450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009720 tx=0x7f36e80046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 shutdown_connections 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f36d80383a0 0x7f36d803a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 --2- 172.21.15.121:0/3412220733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f36f40a4c20 0x7f36f4125450 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.165 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 >> 172.21.15.121:0/3412220733 conn(0x7f36f40ac3e0 msgr2=0x7f36f40ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 shutdown_connections 2024-09-15T23:56:54.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.163+0000 7f36fb237640 1 -- 172.21.15.121:0/3412220733 wait complete. 2024-09-15T23:56:54.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:54.246 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.244+0000 7f4067a16040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:56:54.300 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.298+0000 7f4067a16040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:56:54.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.315+0000 7fdd92653640 1 Processor -- start 2024-09-15T23:56:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd92653640 1 -- start start 2024-09-15T23:56:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd92653640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd8c13a280 0x7fdd8c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd92653640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd8c13a080 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd92653640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdd8c0a3d50 con 0x7fdd8c13a280 2024-09-15T23:56:54.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd8bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd8c13a280 0x7fdd8c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd8b7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdd8c0a4c20 0x7fdd8c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57430/0 (socket says 172.21.15.121:57430) 2024-09-15T23:56:54.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd8b7fe640 1 -- 172.21.15.121:0/4214808402 learned_addr learned my addr 172.21.15.121:0/4214808402 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:54.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd8bfff640 1 -- 172.21.15.121:0/4214808402 >> v1:172.21.15.121:6789/0 conn(0x7fdd8c0a4c20 legacy=0x7fdd8c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.316+0000 7fdd8bfff640 1 -- 172.21.15.121:0/4214808402 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c0a3f80 con 0x7fdd8c13a280 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.317+0000 7fdd8bfff640 1 --2- 172.21.15.121:0/4214808402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c13a280 0x7fdd8c13a660 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009720 tx=0x7fdd7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdeb4246e8eee13c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.317+0000 7fdd8affd640 1 -- 172.21.15.121:0/4214808402 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c037070 con 0x7fdd8c13a280 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.317+0000 7fdd8affd640 1 -- 172.21.15.121:0/4214808402 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c02ad90 con 0x7fdd8c13a280 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.317+0000 7fdd8affd640 1 -- 172.21.15.121:0/4214808402 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c032590 con 0x7fdd8c13a280 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 -- 172.21.15.121:0/4214808402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c13a280 msgr2=0x7fdd8c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 --2- 172.21.15.121:0/4214808402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c13a280 0x7fdd8c13a660 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009720 tx=0x7fdd7c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 -- 172.21.15.121:0/4214808402 shutdown_connections 2024-09-15T23:56:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 --2- 172.21.15.121:0/4214808402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c13a280 0x7fdd8c13a660 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 -- 172.21.15.121:0/4214808402 >> 172.21.15.121:0/4214808402 conn(0x7fdd8c0ac3e0 msgr2=0x7fdd8c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 -- 172.21.15.121:0/4214808402 shutdown_connections 2024-09-15T23:56:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.318+0000 7fdd92653640 1 -- 172.21.15.121:0/4214808402 wait complete. 2024-09-15T23:56:54.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.319+0000 7fdd92653640 1 Processor -- start 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.319+0000 7fdd92653640 1 -- start start 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd92653640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd92653640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c139d40 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd8bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd8bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37946/0 (socket says 172.21.15.121:37946) 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd8bfff640 1 -- 172.21.15.121:0/3304334277 learned_addr learned my addr 172.21.15.121:0/3304334277 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd8bfff640 1 -- 172.21.15.121:0/3304334277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c124ff0 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd8bfff640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009840 tx=0x7fdd7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c041020 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c03d550 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c125270 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd7c037040 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.320+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c138290 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.321+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7fdd7c044020 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.321+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c06dab0 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.322+0000 7fdd88ff9640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 0x7fdd7803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.322+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fdd7c06be80 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.322+0000 7fdd8b7fe640 1 -- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 msgr2=0x7fdd7803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:54.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.322+0000 7fdd8b7fe640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 0x7fdd7803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:54.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.326+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd7c04b030 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.345 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.342+0000 7f4067a16040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:56:54.461 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.459+0000 7f4067a16040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:56:54.510 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.508+0000 7f4067a16040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:56:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.523+0000 7fdd8b7fe640 1 -- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 msgr2=0x7fdd7803a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:54.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.523+0000 7fdd8b7fe640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 0x7fdd7803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:54.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.535+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd8c0a2f50 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.536+0000 7fdd88ff9640 1 -- 172.21.15.121:0/3304334277 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+4890 (secure 0 0 0) 0x7fdd8c124ff0 con 0x7fdd8c0a4c20 2024-09-15T23:56:54.538 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:54.538 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":22,"btime":"2024-09-15T23:56:35:184080+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:20.014531+0000","modified":"2024-09-15T23:56:22.003662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4537},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4537":{"gid":4537,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6828/469179342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":469179342},{"type":"v1","addr":"172.21.15.121:6828","nonce":469179342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4537,"qdb_cluster":[4537]},"id":3},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:54.538 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 22 2024-09-15T23:56:54.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 msgr2=0x7fdd7803a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:54.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 0x7fdd7803a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 msgr2=0x7fdd8c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009840 tx=0x7fdd7c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 shutdown_connections 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fdd780383c0 0x7fdd7803a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 --2- 172.21.15.121:0/3304334277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd8c0a4c20 0x7fdd8c0a1150 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 >> 172.21.15.121:0/3304334277 conn(0x7fdd8c0ac3e0 msgr2=0x7fdd8c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 shutdown_connections 2024-09-15T23:56:54.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.538+0000 7fdd92653640 1 -- 172.21.15.121:0/3304334277 wait complete. 2024-09-15T23:56:54.551 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:54.561 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.559+0000 7f4067a16040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:56:54.617 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.615+0000 7f4067a16040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:56:54.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.658+0000 7fa694427640 1 Processor -- start 2024-09-15T23:56:54.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.658+0000 7fa694427640 1 -- start start 2024-09-15T23:56:54.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa694427640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa68c13a280 0x7fa68c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa694427640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c13a080 con 0x7fa68c0a4c20 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa694427640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c0a3d50 con 0x7fa68c13a280 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa6921c3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa68c13a280 0x7fa68c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa6919c2640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa68c0a4c20 0x7fa68c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57444/0 (socket says 172.21.15.121:57444) 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa6919c2640 1 -- 172.21.15.121:0/3756105225 learned_addr learned my addr 172.21.15.121:0/3756105225 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa6921c3640 1 -- 172.21.15.121:0/3756105225 >> v1:172.21.15.121:6789/0 conn(0x7fa68c0a4c20 legacy=0x7fa68c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.659+0000 7fa6911c1640 1 -- 172.21.15.121:0/3756105225 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878460070 0 0) 0x7fa68c13a080 con 0x7fa68c0a4c20 2024-09-15T23:56:54.663 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.660+0000 7f4067a16040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.660+0000 7fa6921c3640 1 -- 172.21.15.121:0/3756105225 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c0a3f80 con 0x7fa68c13a280 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa6921c3640 1 --2- 172.21.15.121:0/3756105225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c13a280 0x7fa68c13a660 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa688009720 tx=0x7fa68802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f357a394326417 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa6911c1640 1 -- 172.21.15.121:0/3756105225 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa688037070 con 0x7fa68c13a280 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa6911c1640 1 -- 172.21.15.121:0/3756105225 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68802ad90 con 0x7fa68c13a280 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa6911c1640 1 -- 172.21.15.121:0/3756105225 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa688032590 con 0x7fa68c13a280 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 -- 172.21.15.121:0/3756105225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c13a280 msgr2=0x7fa68c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 --2- 172.21.15.121:0/3756105225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c13a280 0x7fa68c13a660 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa688009720 tx=0x7fa68802a110 comp rx=0 tx=0).stop 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 -- 172.21.15.121:0/3756105225 shutdown_connections 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 --2- 172.21.15.121:0/3756105225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c13a280 0x7fa68c13a660 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 -- 172.21.15.121:0/3756105225 >> 172.21.15.121:0/3756105225 conn(0x7fa68c0ac3e0 msgr2=0x7fa68c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 -- 172.21.15.121:0/3756105225 shutdown_connections 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.661+0000 7fa694427640 1 -- 172.21.15.121:0/3756105225 wait complete. 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.662+0000 7fa694427640 1 Processor -- start 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.662+0000 7fa694427640 1 -- start start 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa694427640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa694427640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c139d40 con 0x7fa68c0a4c20 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa6921c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa6921c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37960/0 (socket says 172.21.15.121:37960) 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa6921c3640 1 -- 172.21.15.121:0/1529333671 learned_addr learned my addr 172.21.15.121:0/1529333671 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:54.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa6921c3640 1 -- 172.21.15.121:0/1529333671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c124fa0 con 0x7fa68c0a4c20 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.663+0000 7fa6921c3640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa688009720 tx=0x7fa6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.664+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa688041070 con 0x7fa68c0a4c20 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.664+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68803c460 con 0x7fa68c0a4c20 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.664+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c137fd0 con 0x7fa68c0a4c20 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.664+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa688037040 con 0x7fa68c0a4c20 2024-09-15T23:56:54.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.664+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1228e0 con 0x7fa68c0a4c20 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c06dab0 con 0x7fa68c0a4c20 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7fa688044070 con 0x7fa68c0a4c20 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa682ffd640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 0x7fa67003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7fa68806c270 con 0x7fa68c0a4c20 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa6919c2640 1 -- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 msgr2=0x7fa67003a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:54.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.665+0000 7fa6919c2640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 0x7fa67003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:54.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.670+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa68803bdd0 con 0x7fa68c0a4c20 2024-09-15T23:56:54.707 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:54.705+0000 7f4067a16040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:56:54.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.844+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa68c0a2f50 con 0x7fa68c0a4c20 2024-09-15T23:56:54.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.846+0000 7fa682ffd640 1 -- 172.21.15.121:0/1529333671 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+14947 (secure 0 0 0) 0x7fa68803a520 con 0x7fa68c0a4c20 2024-09-15T23:56:54.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:54.848 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":43,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:33.704066+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:56:18.630647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:56:18.982272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:54.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 msgr2=0x7fa67003a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:54.850 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 0x7fa67003a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 msgr2=0x7fa68c0a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa688009720 tx=0x7fa6880046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 shutdown_connections 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7fa6700383c0 0x7fa67003a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 --2- 172.21.15.121:0/1529333671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa68c0a4c20 0x7fa68c0a1020 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.851 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 >> 172.21.15.121:0/1529333671 conn(0x7fa68c0ac3e0 msgr2=0x7fa68c0aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 shutdown_connections 2024-09-15T23:56:54.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.848+0000 7fa694427640 1 -- 172.21.15.121:0/1529333671 wait complete. 2024-09-15T23:56:54.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:56:54.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.961+0000 7f0b8d874640 1 Processor -- start 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b8d874640 1 -- start start 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b8d874640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0b8809ee30 0x7f0b8813ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b8d874640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b880a2280 con 0x7f0b880a39c0 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b8d874640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0b8809e6e0 con 0x7f0b8809ee30 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b867fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0b8809ee30 0x7f0b8813ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b86ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0b880a39c0 0x7f0b880a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57452/0 (socket says 172.21.15.121:57452) 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b867fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0b8809ee30 0x7f0b8813ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37970/0 (socket says 172.21.15.121:37970) 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.962+0000 7f0b86ffd640 1 -- 172.21.15.121:0/4092761094 learned_addr learned my addr 172.21.15.121:0/4092761094 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.963+0000 7f0b867fc640 1 -- 172.21.15.121:0/4092761094 >> v1:172.21.15.121:6789/0 conn(0x7f0b880a39c0 legacy=0x7f0b880a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.963+0000 7f0b867fc640 1 -- 172.21.15.121:0/4092761094 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8809e3d0 con 0x7f0b8809ee30 2024-09-15T23:56:54.965 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.963+0000 7f0b85ffb640 1 -- 172.21.15.121:0/4092761094 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183880930 0 0) 0x7f0b880a2280 con 0x7f0b880a39c0 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b867fc640 1 --2- 172.21.15.121:0/4092761094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b8813ced0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009720 tx=0x7f0b7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939cfba18026c424 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b85ffb640 1 -- 172.21.15.121:0/4092761094 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b7c037070 con 0x7f0b8809ee30 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b85ffb640 1 -- 172.21.15.121:0/4092761094 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7c02ad90 con 0x7f0b8809ee30 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b85ffb640 1 -- 172.21.15.121:0/4092761094 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b7c032590 con 0x7f0b8809ee30 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 -- 172.21.15.121:0/4092761094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 msgr2=0x7f0b8813ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 --2- 172.21.15.121:0/4092761094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b8813ced0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c009720 tx=0x7f0b7c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:54.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 -- 172.21.15.121:0/4092761094 shutdown_connections 2024-09-15T23:56:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 --2- 172.21.15.121:0/4092761094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b8813ced0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 -- 172.21.15.121:0/4092761094 >> 172.21.15.121:0/4092761094 conn(0x7f0b880a85e0 msgr2=0x7f0b880a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.964+0000 7f0b8d874640 1 -- 172.21.15.121:0/4092761094 shutdown_connections 2024-09-15T23:56:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.965+0000 7f0b8d874640 1 -- 172.21.15.121:0/4092761094 wait complete. 2024-09-15T23:56:54.968 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.965+0000 7f0b8d874640 1 Processor -- start 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b8d874640 1 -- start start 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b8d874640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b8d874640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b880a1ed0 con 0x7f0b8809ee30 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:37976/0 (socket says 172.21.15.121:37976) 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b86ffd640 1 -- 172.21.15.121:0/68510760 learned_addr learned my addr 172.21.15.121:0/68510760 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.966+0000 7f0b86ffd640 1 -- 172.21.15.121:0/68510760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b88070dd0 con 0x7f0b8809ee30 2024-09-15T23:56:54.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b86ffd640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c420 tx=0x7f0b7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b78018070 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b780074d0 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b88071ee0 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b78004950 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.967+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b8809ca20 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 21) ==== 45839+0+0 (secure 0 0 0) 0x7f0b7801b070 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b88071d10 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b6ffff640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 0x7f0b7403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4557+0+0 (secure 0 0 0) 0x7f0b7804ab30 con 0x7f0b8809ee30 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b867fc640 1 -- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 msgr2=0x7f0b7403a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:54.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.968+0000 7f0b867fc640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 0x7f0b7403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:56:54.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:54.972+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b78011980 con 0x7f0b8809ee30 2024-09-15T23:56:55.170 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.169+0000 7f0b867fc640 1 -- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 msgr2=0x7f0b7403a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6827/3398364693 2024-09-15T23:56:55.171 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.169+0000 7f0b867fc640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 0x7f0b7403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:56:55.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.181+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0b88070a00 con 0x7f0b8809ee30 2024-09-15T23:56:55.183 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:56:55.181+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:56:55.184 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.182+0000 7f0b6ffff640 1 -- 172.21.15.121:0/68510760 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7f0b78011be0 con 0x7f0b8809ee30 2024-09-15T23:56:55.184 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:56:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 msgr2=0x7f0b7403a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:56:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 0x7f0b7403a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 msgr2=0x7f0b880704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c420 tx=0x7f0b7800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 shutdown_connections 2024-09-15T23:56:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x7f0b740383c0 0x7f0b7403a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 --2- 172.21.15.121:0/68510760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b8809ee30 0x7f0b880704c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.185+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 >> 172.21.15.121:0/68510760 conn(0x7f0b880a85e0 msgr2=0x7f0b880a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:55.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.186+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 shutdown_connections 2024-09-15T23:56:55.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.186+0000 7f0b8d874640 1 -- 172.21.15.121:0/68510760 wait complete. 2024-09-15T23:56:55.189 INFO:tasks.ceph.mds.a.smithi121.stderr: -3476> 2024-09-15T23:56:21.966+0000 7f050ea7c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:56:55.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:56:55.222 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:56:55.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.303+0000 7f8f9b42e640 1 Processor -- start 2024-09-15T23:56:55.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.303+0000 7f8f9b42e640 1 -- start start 2024-09-15T23:56:55.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f9b42e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8f940a4ab0 0x7f8f9413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f9b42e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f940a6d10 con 0x7f8f940a7140 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f9b42e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9406e230 con 0x7f8f940a4ab0 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f989c9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8f940a4ab0 0x7f8f9413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f991ca640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8f940a7140 0x7f8f940a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57470/0 (socket says 172.21.15.121:57470) 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f989c9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8f940a4ab0 0x7f8f9413eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38006/0 (socket says 172.21.15.121:38006) 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f991ca640 1 -- 172.21.15.121:0/3786805035 learned_addr learned my addr 172.21.15.121:0/3786805035 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f989c9640 1 -- 172.21.15.121:0/3786805035 >> v1:172.21.15.121:6789/0 conn(0x7f8f940a7140 legacy=0x7f8f940a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.307 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f8f989c9640 1 -- 172.21.15.121:0/3786805035 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f940a3ae0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.308 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.304+0000 7f4067a16040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:56:55.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.305+0000 7f8f989c9640 1 --2- 172.21.15.121:0/3786805035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f9413eef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009720 tx=0x7f8f8402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d23d23320ed380f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:55.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.305+0000 7f8f8bfff640 1 -- 172.21.15.121:0/3786805035 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f84037070 con 0x7f8f940a4ab0 2024-09-15T23:56:55.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.305+0000 7f8f8bfff640 1 -- 172.21.15.121:0/3786805035 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8402ad90 con 0x7f8f940a4ab0 2024-09-15T23:56:55.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.305+0000 7f8f8bfff640 1 -- 172.21.15.121:0/3786805035 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f84032590 con 0x7f8f940a4ab0 2024-09-15T23:56:55.310 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.305+0000 7f4064cf5640 -1 --2- 172.21.15.121:0/3866538121 >> [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] conn(0x562e03a46c00 0x562e0b5bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner peer [v2:172.21.15.121:6827/3398364693,v1:172.21.15.121:6829/3398364693] is using msgr V1 protocol 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 -- 172.21.15.121:0/3786805035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 msgr2=0x7f8f9413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 --2- 172.21.15.121:0/3786805035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f9413eef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009720 tx=0x7f8f8402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 -- 172.21.15.121:0/3786805035 shutdown_connections 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 --2- 172.21.15.121:0/3786805035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f9413eef0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 -- 172.21.15.121:0/3786805035 >> 172.21.15.121:0/3786805035 conn(0x7f8f940ac370 msgr2=0x7f8f940ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:55.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 -- 172.21.15.121:0/3786805035 shutdown_connections 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.306+0000 7f8f9b42e640 1 -- 172.21.15.121:0/3786805035 wait complete. 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.307+0000 7f8f9b42e640 1 Processor -- start 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.307+0000 7f8f9b42e640 1 -- start start 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.308+0000 7f8f9b42e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.308+0000 7f8f9b42e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940a7fc0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.308+0000 7f8f991ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.308+0000 7f8f991ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38010/0 (socket says 172.21.15.121:38010) 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.308+0000 7f8f991ca640 1 -- 172.21.15.121:0/1156479619 learned_addr learned my addr 172.21.15.121:0/1156479619 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.309+0000 7f8f991ca640 1 -- 172.21.15.121:0/1156479619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f941250b0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.309+0000 7f8f991ca640 1 --2- 172.21.15.121:0/1156479619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00cb20 tx=0x7f8f8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.310+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c017070 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.310+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00abf0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.310+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8c012400 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.311+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f941246c0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.311+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f94124960 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.312+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 22) ==== 45448+0+0 (secure 0 0 0) 0x7f8f8c01a070 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.313+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f94122e00 con 0x7f8f940a4ab0 2024-09-15T23:56:55.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.313+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4987+0+0 (secure 0 0 0) 0x7f8f8c04b110 con 0x7f8f940a4ab0 2024-09-15T23:56:55.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.318+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f941250b0 con 0x7f8f940a4ab0 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3fe8520640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3fe8520640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3fe8520640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3feb526640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3feb526640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3feb526640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3feb526640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3feb526640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3fe8520640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:56:55.356+0000 7f3fe8520640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:56:55.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:55.523+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8f94139df0 con 0x7f8f940a4ab0 2024-09-15T23:56:56.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.186+0000 7f8f89ffb640 1 -- 172.21.15.121:0/1156479619 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f8f8c0125a0 con 0x7f8f940a4ab0 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 msgr2=0x7f8f940a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 --2- 172.21.15.121:0/1156479619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00cb20 tx=0x7f8f8c00a060 comp rx=0 tx=0).stop 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 shutdown_connections 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 --2- 172.21.15.121:0/1156479619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8f940a4ab0 0x7f8f940a1290 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 >> 172.21.15.121:0/1156479619 conn(0x7f8f940ac370 msgr2=0x7f8f940aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 shutdown_connections 2024-09-15T23:56:56.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.189+0000 7f8f9b42e640 1 -- 172.21.15.121:0/1156479619 wait complete. 2024-09-15T23:56:56.204 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:56:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.352+0000 7ff794e53640 1 Processor -- start 2024-09-15T23:56:56.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.352+0000 7ff794e53640 1 -- start start 2024-09-15T23:56:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff794e53640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7900a42a0 0x7ff79009f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff794e53640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79009ce40 con 0x7ff7900a37b0 2024-09-15T23:56:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff794e53640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff79009f960 con 0x7ff7900a42a0 2024-09-15T23:56:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff7900a42a0 0x7ff79009f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff7900a37b0 0x7ff7900a3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57478/0 (socket says 172.21.15.121:57478) 2024-09-15T23:56:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78e59c640 1 -- 172.21.15.121:0/1238158281 learned_addr learned my addr 172.21.15.121:0/1238158281 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78dd9b640 1 -- 172.21.15.121:0/1238158281 >> v1:172.21.15.121:6789/0 conn(0x7ff7900a37b0 legacy=0x7ff7900a3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78dd9b640 1 -- 172.21.15.121:0/1238158281 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79009d7a0 con 0x7ff7900a42a0 2024-09-15T23:56:56.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.353+0000 7ff78d59a640 1 -- 172.21.15.121:0/1238158281 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289565139 0 0) 0x7ff79009ce40 con 0x7ff7900a37b0 2024-09-15T23:56:56.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff78dd9b640 1 --2- 172.21.15.121:0/1238158281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a42a0 0x7ff79009f230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff784009720 tx=0x7ff78402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7b8683db8c26b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff78d59a640 1 -- 172.21.15.121:0/1238158281 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff784037070 con 0x7ff7900a42a0 2024-09-15T23:56:56.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff78d59a640 1 -- 172.21.15.121:0/1238158281 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78402ad90 con 0x7ff7900a42a0 2024-09-15T23:56:56.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff78d59a640 1 -- 172.21.15.121:0/1238158281 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff784032590 con 0x7ff7900a42a0 2024-09-15T23:56:56.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff794e53640 1 -- 172.21.15.121:0/1238158281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a42a0 msgr2=0x7ff79009f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:56.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.354+0000 7ff794e53640 1 --2- 172.21.15.121:0/1238158281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a42a0 0x7ff79009f230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff784009720 tx=0x7ff78402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:56.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.355+0000 7ff794e53640 1 -- 172.21.15.121:0/1238158281 shutdown_connections 2024-09-15T23:56:56.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.355+0000 7ff794e53640 1 --2- 172.21.15.121:0/1238158281 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a42a0 0x7ff79009f230 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:56.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.355+0000 7ff794e53640 1 -- 172.21.15.121:0/1238158281 >> 172.21.15.121:0/1238158281 conn(0x7ff7900a8430 msgr2=0x7ff7900a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:56.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.355+0000 7ff794e53640 1 -- 172.21.15.121:0/1238158281 shutdown_connections 2024-09-15T23:56:56.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.355+0000 7ff794e53640 1 -- 172.21.15.121:0/1238158281 wait complete. 2024-09-15T23:56:56.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff794e53640 1 Processor -- start 2024-09-15T23:56:56.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff794e53640 1 -- start start 2024-09-15T23:56:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff794e53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff794e53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7900a5220 con 0x7ff7900a37b0 2024-09-15T23:56:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff78e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff78e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38110/0 (socket says 172.21.15.121:38110) 2024-09-15T23:56:56.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff78e59c640 1 -- 172.21.15.121:0/2982058095 learned_addr learned my addr 172.21.15.121:0/2982058095 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.356+0000 7ff78e59c640 1 -- 172.21.15.121:0/2982058095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff790070da0 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff78e59c640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c420 tx=0x7ff78000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff780018070 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7800074d0 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff790070a90 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff780004950 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.357+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff790071060 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 23) ==== 45575+0+0 (secure 0 0 0) 0x7ff78001b070 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79009f230 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff77effd640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 0x7ff77003a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4987+0+0 (secure 0 0 0) 0x7ff78004a8c0 con 0x7ff7900a37b0 2024-09-15T23:56:56.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff78dd9b640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 0x7ff77003a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:56.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.358+0000 7ff78dd9b640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 0x7ff77003a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff784034000 tx=0x7ff78402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:56.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.363+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff780011980 con 0x7ff7900a37b0 2024-09-15T23:56:56.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:56.530+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff79009e840 con 0x7ff7900a37b0 2024-09-15T23:56:57.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.317+0000 7ff77effd640 1 -- 172.21.15.121:0/2982058095 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) ==== 181+0+0 (secure 0 0 0) 0x7ff780011be0 con 0x7ff7900a37b0 2024-09-15T23:56:57.319 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 msgr2=0x7ff77003a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 0x7ff77003a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff784034000 tx=0x7ff78402e000 comp rx=0 tx=0).stop 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 msgr2=0x7ff79009ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c420 tx=0x7ff78000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 shutdown_connections 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff7700380f0 0x7ff77003a5b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 --2- 172.21.15.121:0/2982058095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7900a37b0 0x7ff79009ba80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 >> 172.21.15.121:0/2982058095 conn(0x7ff7900a8430 msgr2=0x7ff7900a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:57.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 shutdown_connections 2024-09-15T23:56:57.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.319+0000 7ff794e53640 1 -- 172.21.15.121:0/2982058095 wait complete. 2024-09-15T23:56:57.336 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.446+0000 7f43fa28d640 1 Processor -- start 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.446+0000 7f43fa28d640 1 -- start start 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.446+0000 7f43fa28d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43f4133020 0x7f43f40a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43fa28d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f409abc0 con 0x7f43f4133400 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43fa28d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f43f40a2310 con 0x7f43f4133020 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43f3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43f4133020 0x7f43f40a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43f37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f43f4133400 0x7f43f4135fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57482/0 (socket says 172.21.15.121:57482) 2024-09-15T23:56:57.449 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43f37fe640 1 -- 172.21.15.121:0/1798214409 learned_addr learned my addr 172.21.15.121:0/1798214409 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43f3fff640 1 -- 172.21.15.121:0/1798214409 >> v1:172.21.15.121:6789/0 conn(0x7f43f4133400 legacy=0x7f43f4135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.450 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.447+0000 7f43f3fff640 1 -- 172.21.15.121:0/1798214409 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f4132bf0 con 0x7f43f4133020 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43f3fff640 1 --2- 172.21.15.121:0/1798214409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f40a04b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009720 tx=0x7f43e402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561e030ec03eee45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43f2ffd640 1 -- 172.21.15.121:0/1798214409 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4037070 con 0x7f43f4133020 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43f2ffd640 1 -- 172.21.15.121:0/1798214409 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e402ad90 con 0x7f43f4133020 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43f2ffd640 1 -- 172.21.15.121:0/1798214409 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4032590 con 0x7f43f4133020 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 -- 172.21.15.121:0/1798214409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 msgr2=0x7f43f40a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1798214409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f40a04b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009720 tx=0x7f43e402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 -- 172.21.15.121:0/1798214409 shutdown_connections 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1798214409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f40a04b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 -- 172.21.15.121:0/1798214409 >> 172.21.15.121:0/1798214409 conn(0x7f43f40a8430 msgr2=0x7f43f40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 -- 172.21.15.121:0/1798214409 shutdown_connections 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.448+0000 7f43fa28d640 1 -- 172.21.15.121:0/1798214409 wait complete. 2024-09-15T23:56:57.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.449+0000 7f43fa28d640 1 Processor -- start 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.449+0000 7f43fa28d640 1 -- start start 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43fa28d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43fa28d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43f40a19c0 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38142/0 (socket says 172.21.15.121:38142) 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f3fff640 1 -- 172.21.15.121:0/1334404026 learned_addr learned my addr 172.21.15.121:0/1334404026 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f3fff640 1 -- 172.21.15.121:0/1334404026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f4070cb0 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f3fff640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009840 tx=0x7f43e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.450+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4041020 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e403d550 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f4071c80 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43e4037040 con 0x7f43f4133020 2024-09-15T23:56:57.454 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f409e060 con 0x7f43f4133020 2024-09-15T23:56:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 23) ==== 45575+0+0 (secure 0 0 0) 0x7f43e4044020 con 0x7f43f4133020 2024-09-15T23:56:57.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.451+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f4133830 con 0x7f43f4133020 2024-09-15T23:56:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.452+0000 7f43f0ff9640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 0x7f43e003a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.452+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 4549+0+0 (secure 0 0 0) 0x7f43e406ba30 con 0x7f43f4133020 2024-09-15T23:56:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.452+0000 7f43f37fe640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 0x7f43e003a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:57.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.452+0000 7f43f37fe640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 0x7f43e003a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:57.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.456+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43e406de20 con 0x7f43f4133020 2024-09-15T23:56:57.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.627+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f43f4071e50 con 0x7f43f4133020 2024-09-15T23:56:57.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:57.760+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7f43e403b3f0 con 0x7f43f4133020 2024-09-15T23:56:58.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.317+0000 7f43f0ff9640 1 -- 172.21.15.121:0/1334404026 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) ==== 169+0+0 (secure 0 0 0) 0x7f43e404b030 con 0x7f43f4133020 2024-09-15T23:56:58.320 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-15T23:56:58.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.321+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 msgr2=0x7f43e003a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.321+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 0x7f43e003a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.321+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 msgr2=0x7f43f412f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.321+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009840 tx=0x7f43e40046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.322+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 shutdown_connections 2024-09-15T23:56:58.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.322+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f43e00380f0 0x7f43e003a5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.322+0000 7f43fa28d640 1 --2- 172.21.15.121:0/1334404026 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43f4133020 0x7f43f412f9c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.322+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 >> 172.21.15.121:0/1334404026 conn(0x7f43f40a8430 msgr2=0x7f43f40a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.322+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 shutdown_connections 2024-09-15T23:56:58.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.323+0000 7f43fa28d640 1 -- 172.21.15.121:0/1334404026 wait complete. 2024-09-15T23:56:58.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:58.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.443+0000 7f2bb8874640 1 Processor -- start 2024-09-15T23:56:58.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.443+0000 7f2bb8874640 1 -- start start 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb8874640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bb413a280 0x7f2bb413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb8874640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb413a080 con 0x7f2bb40a4c20 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb8874640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb40a3d50 con 0x7f2bb413a280 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2bb413a280 0x7f2bb413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb1d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2bb40a4c20 0x7f2bb40a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57498/0 (socket says 172.21.15.121:57498) 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb1d9b640 1 -- 172.21.15.121:0/2518569492 learned_addr learned my addr 172.21.15.121:0/2518569492 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb259c640 1 -- 172.21.15.121:0/2518569492 >> v1:172.21.15.121:6789/0 conn(0x7f2bb40a4c20 legacy=0x7f2bb40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb259c640 1 -- 172.21.15.121:0/2518569492 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb40a3f80 con 0x7f2bb413a280 2024-09-15T23:56:58.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.444+0000 7f2bb159a640 1 -- 172.21.15.121:0/2518569492 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091514647 0 0) 0x7f2bb413a080 con 0x7f2bb40a4c20 2024-09-15T23:56:58.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.445+0000 7f2bb259c640 1 --2- 172.21.15.121:0/2518569492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb413a280 0x7f2bb413a660 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009720 tx=0x7f2ba402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ab1557c763ab68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.445+0000 7f2bb159a640 1 -- 172.21.15.121:0/2518569492 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4037070 con 0x7f2bb413a280 2024-09-15T23:56:58.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.445+0000 7f2bb159a640 1 -- 172.21.15.121:0/2518569492 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba402ad90 con 0x7f2bb413a280 2024-09-15T23:56:58.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.445+0000 7f2bb159a640 1 -- 172.21.15.121:0/2518569492 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4032590 con 0x7f2bb413a280 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 -- 172.21.15.121:0/2518569492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb413a280 msgr2=0x7f2bb413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2518569492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb413a280 0x7f2bb413a660 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009720 tx=0x7f2ba402a110 comp rx=0 tx=0).stop 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 -- 172.21.15.121:0/2518569492 shutdown_connections 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2518569492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb413a280 0x7f2bb413a660 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 -- 172.21.15.121:0/2518569492 >> 172.21.15.121:0/2518569492 conn(0x7f2bb40ac3e0 msgr2=0x7f2bb40ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 -- 172.21.15.121:0/2518569492 shutdown_connections 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.446+0000 7f2bb8874640 1 -- 172.21.15.121:0/2518569492 wait complete. 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb8874640 1 Processor -- start 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb8874640 1 -- start start 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb8874640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb8874640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4139d40 con 0x7f2bb40a4c20 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.451 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38160/0 (socket says 172.21.15.121:38160) 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb259c640 1 -- 172.21.15.121:0/2065944802 learned_addr learned my addr 172.21.15.121:0/2065944802 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.447+0000 7f2bb259c640 1 -- 172.21.15.121:0/2065944802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb4124fa0 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2bb259c640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009720 tx=0x7f2ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4041070 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba403c460 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb4137fd0 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ba4037040 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.448+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb41228e0 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7f2ba4044070 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb406dab0 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2ba2ffd640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 0x7f2b9403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7f2ba406be50 con 0x7f2bb40a4c20 2024-09-15T23:56:58.452 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2bb1d9b640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 0x7f2b9403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.453 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.449+0000 7f2bb1d9b640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 0x7f2b9403a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c00 tx=0x7f2ba8007a40 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.453+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ba403bdd0 con 0x7f2bb40a4c20 2024-09-15T23:56:58.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.652+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bb40a2f50 con 0x7f2bb40a4c20 2024-09-15T23:56:58.655 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.653+0000 7f2ba2ffd640 1 -- 172.21.15.121:0/2065944802 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3579 (secure 0 0 0) 0x7f2ba403a520 con 0x7f2bb40a4c20 2024-09-15T23:56:58.655 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:58.655 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":24,"btime":"2024-09-15T23:56:56:184355+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/3663683812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":3663683812},{"type":"v1","addr":"172.21.15.121:6827","nonce":3663683812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:58.655 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 24 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 msgr2=0x7f2b9403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 0x7f2b9403a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8000c00 tx=0x7f2ba8007a40 comp rx=0 tx=0).stop 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 msgr2=0x7f2bb40a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009720 tx=0x7f2ba40046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 shutdown_connections 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2b94038210 0x7f2b9403a6d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 --2- 172.21.15.121:0/2065944802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2bb40a4c20 0x7f2bb40a1020 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 >> 172.21.15.121:0/2065944802 conn(0x7f2bb40ac3e0 msgr2=0x7f2bb40aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 shutdown_connections 2024-09-15T23:56:58.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.655+0000 7f2bb8874640 1 -- 172.21.15.121:0/2065944802 wait complete. 2024-09-15T23:56:58.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:58.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.765+0000 7f8a8d5d6640 1 Processor -- start 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.765+0000 7f8a8d5d6640 1 -- start start 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.765+0000 7f8a8d5d6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8a88135f30 0x7f8a8813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.765+0000 7f8a8d5d6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880a08c0 con 0x7f8a88135b50 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.765+0000 7f8a8d5d6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8809b310 con 0x7f8a88135f30 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.766+0000 7f8a7ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8a88135f30 0x7f8a8813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.766+0000 7f8a86ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8a88135b50 0x7f8a8809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57508/0 (socket says 172.21.15.121:57508) 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.766+0000 7f8a86ffd640 1 -- 172.21.15.121:0/1433855729 learned_addr learned my addr 172.21.15.121:0/1433855729 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.766+0000 7f8a7ffff640 1 -- 172.21.15.121:0/1433855729 >> v1:172.21.15.121:6789/0 conn(0x7f8a88135b50 legacy=0x7f8a8809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.766+0000 7f8a7ffff640 1 -- 172.21.15.121:0/1433855729 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880a2270 con 0x7f8a88135f30 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a7ffff640 1 --2- 172.21.15.121:0/1433855729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135f30 0x7f8a8813bb80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009720 tx=0x7f8a7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d659a99fd7ce4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a867fc640 1 -- 172.21.15.121:0/1433855729 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70037070 con 0x7f8a88135f30 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a867fc640 1 -- 172.21.15.121:0/1433855729 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7002ae20 con 0x7f8a88135f30 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a867fc640 1 -- 172.21.15.121:0/1433855729 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70032590 con 0x7f8a88135f30 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/1433855729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135f30 msgr2=0x7f8a8813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/1433855729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135f30 0x7f8a8813bb80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009720 tx=0x7f8a7002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/1433855729 shutdown_connections 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/1433855729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135f30 0x7f8a8813bb80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/1433855729 >> 172.21.15.121:0/1433855729 conn(0x7f8a880a85e0 msgr2=0x7f8a880a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/1433855729 shutdown_connections 2024-09-15T23:56:58.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.767+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/1433855729 wait complete. 2024-09-15T23:56:58.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.768+0000 7f8a8d5d6640 1 Processor -- start 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.768+0000 7f8a8d5d6640 1 -- start start 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a8d5d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a8d5d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88136350 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a86ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38178/0 (socket says 172.21.15.121:38178) 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a86ffd640 1 -- 172.21.15.121:0/3395233084 learned_addr learned my addr 172.21.15.121:0/3395233084 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a86ffd640 1 -- 172.21.15.121:0/3395233084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a881237c0 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a86ffd640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c4a0 tx=0x7f8a7800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a78017070 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78005c10 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a78007070 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a881242b0 con 0x7f8a88135b50 2024-09-15T23:56:58.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.769+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a881230e0 con 0x7f8a88135b50 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.770+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7f8a7801a070 con 0x7f8a88135b50 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.770+0000 7f8a7f7fe640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 0x7f8a6803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.770+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a8809aae0 con 0x7f8a88135b50 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.770+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7f8a7804a670 con 0x7f8a88135b50 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.770+0000 7f8a7ffff640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 0x7f8a6803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:58.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.771+0000 7f8a7ffff640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 0x7f8a6803a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a70034000 tx=0x7f8a7002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:58.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.775+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a7801b3b0 con 0x7f8a88135b50 2024-09-15T23:56:58.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.940+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a880a1f10 con 0x7f8a88135b50 2024-09-15T23:56:58.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.941+0000 7f8a7f7fe640 1 -- 172.21.15.121:0/3395233084 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+11701 (secure 0 0 0) 0x7f8a7801cca0 con 0x7f8a88135b50 2024-09-15T23:56:58.943 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:58.943 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":47,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:58.318739+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/782013179":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/301835395":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/104251253":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6829/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6827/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6828/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:6825/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/391038332":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3129412638":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3001925135":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 msgr2=0x7f8a6803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 0x7f8a6803a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a70034000 tx=0x7f8a7002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 msgr2=0x7f8a8811fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c4a0 tx=0x7f8a7800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 shutdown_connections 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f8a68038210 0x7f8a6803a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 --2- 172.21.15.121:0/3395233084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a88135b50 0x7f8a8811fce0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 >> 172.21.15.121:0/3395233084 conn(0x7f8a880a85e0 msgr2=0x7f8a8809f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 shutdown_connections 2024-09-15T23:56:58.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:58.943+0000 7f8a8d5d6640 1 -- 172.21.15.121:0/3395233084 wait complete. 2024-09-15T23:56:58.956 INFO:tasks.cephfs.filesystem:Destroying file system cephfs_b and related pools 2024-09-15T23:56:58.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.054+0000 7fde498d0640 1 Processor -- start 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.054+0000 7fde498d0640 1 -- start start 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde498d0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fde440a39c0 0x7fde440a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde498d0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde440a2280 con 0x7fde4409ee30 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde498d0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fde4409e6e0 con 0x7fde440a39c0 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde42ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fde440a39c0 0x7fde440a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde427fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fde4409ee30 0x7fde44134760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57510/0 (socket says 172.21.15.121:57510) 2024-09-15T23:56:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde427fc640 1 -- 172.21.15.121:0/301295414 learned_addr learned my addr 172.21.15.121:0/301295414 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde42ffd640 1 -- 172.21.15.121:0/301295414 >> v1:172.21.15.121:6789/0 conn(0x7fde4409ee30 legacy=0x7fde44134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.055+0000 7fde42ffd640 1 -- 172.21.15.121:0/301295414 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4409e3d0 con 0x7fde440a39c0 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde42ffd640 1 --2- 172.21.15.121:0/301295414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde440a39c0 0x7fde440a3da0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009720 tx=0x7fde3c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741f4293901c787e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde41ffb640 1 -- 172.21.15.121:0/301295414 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3c037070 con 0x7fde440a39c0 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde41ffb640 1 -- 172.21.15.121:0/301295414 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c02ad90 con 0x7fde440a39c0 2024-09-15T23:56:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde41ffb640 1 -- 172.21.15.121:0/301295414 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3c032590 con 0x7fde440a39c0 2024-09-15T23:56:59.062 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 -- 172.21.15.121:0/301295414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde440a39c0 msgr2=0x7fde440a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 --2- 172.21.15.121:0/301295414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde440a39c0 0x7fde440a3da0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009720 tx=0x7fde3c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 -- 172.21.15.121:0/301295414 shutdown_connections 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 --2- 172.21.15.121:0/301295414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde440a39c0 0x7fde440a3da0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 -- 172.21.15.121:0/301295414 >> 172.21.15.121:0/301295414 conn(0x7fde440a85e0 msgr2=0x7fde440a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 -- 172.21.15.121:0/301295414 shutdown_connections 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.056+0000 7fde498d0640 1 -- 172.21.15.121:0/301295414 wait complete. 2024-09-15T23:56:59.063 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.057+0000 7fde498d0640 1 Processor -- start 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde498d0640 1 -- start start 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde498d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde498d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fde440a1ed0 con 0x7fde4409ee30 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde42ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38206/0 (socket says 172.21.15.121:38206) 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde42ffd640 1 -- 172.21.15.121:0/1226015650 learned_addr learned my addr 172.21.15.121:0/1226015650 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde42ffd640 1 -- 172.21.15.121:0/1226015650 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde44073030 con 0x7fde4409ee30 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.058+0000 7fde42ffd640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009840 tx=0x7fde3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3c041020 con 0x7fde4409ee30 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c03d550 con 0x7fde4409ee30 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde44137fd0 con 0x7fde4409ee30 2024-09-15T23:56:59.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3c037040 con 0x7fde4409ee30 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4406fd70 con 0x7fde4409ee30 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.059+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7fde3c044020 con 0x7fde4409ee30 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.060+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde440008d0 con 0x7fde4409ee30 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.060+0000 7fde2bfff640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 0x7fde3003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.060+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7fde3c06ba60 con 0x7fde4409ee30 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.060+0000 7fde427fc640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 0x7fde3003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.060+0000 7fde427fc640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 0x7fde3003a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde38002080 tx=0x7fde38001670 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.064+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde3c04b030 con 0x7fde4409ee30 2024-09-15T23:56:59.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.262+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde44071500 con 0x7fde4409ee30 2024-09-15T23:56:59.264 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.262+0000 7fde2bfff640 1 -- 172.21.15.121:0/1226015650 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3579 (secure 0 0 0) 0x7fde3c03d920 con 0x7fde4409ee30 2024-09-15T23:56:59.264 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:59.264 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":24,"btime":"2024-09-15T23:56:56:184355+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/3663683812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":3663683812},{"type":"v1","addr":"172.21.15.121:6827","nonce":3663683812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:59.265 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 24 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 msgr2=0x7fde3003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 0x7fde3003a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fde38002080 tx=0x7fde38001670 comp rx=0 tx=0).stop 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 msgr2=0x7fde4411e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fde3c009840 tx=0x7fde3c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 shutdown_connections 2024-09-15T23:56:59.266 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fde30038210 0x7fde3003a6d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 --2- 172.21.15.121:0/1226015650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fde4409ee30 0x7fde4411e600 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 >> 172.21.15.121:0/1226015650 conn(0x7fde440a85e0 msgr2=0x7fde440a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 shutdown_connections 2024-09-15T23:56:59.267 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.264+0000 7fde498d0640 1 -- 172.21.15.121:0/1226015650 wait complete. 2024-09-15T23:56:59.277 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:56:59.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.373+0000 7f9a5656d640 1 Processor -- start 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.373+0000 7f9a5656d640 1 -- start start 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.373+0000 7f9a5656d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9a50135b50 0x7f9a5009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.373+0000 7f9a5656d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5009b020 con 0x7f9a50135f30 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.373+0000 7f9a5656d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5009b310 con 0x7f9a50135b50 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.374+0000 7f9a4ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9a50135b50 0x7f9a5009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.374+0000 7f9a4f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9a50135f30 0x7f9a500a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57522/0 (socket says 172.21.15.121:57522) 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.374+0000 7f9a4f7fe640 1 -- 172.21.15.121:0/576605936 learned_addr learned my addr 172.21.15.121:0/576605936 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.374+0000 7f9a4ffff640 1 -- 172.21.15.121:0/576605936 >> v1:172.21.15.121:6789/0 conn(0x7f9a50135f30 legacy=0x7f9a500a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.376 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.374+0000 7f9a4ffff640 1 -- 172.21.15.121:0/576605936 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a500a08c0 con 0x7f9a50135b50 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a4ffff640 1 --2- 172.21.15.121:0/576605936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5009aae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009720 tx=0x7f9a4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf1e2d46f01c313 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a4effd640 1 -- 172.21.15.121:0/576605936 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40037070 con 0x7f9a50135b50 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a4effd640 1 -- 172.21.15.121:0/576605936 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4002ae20 con 0x7f9a50135b50 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a4effd640 1 -- 172.21.15.121:0/576605936 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40032590 con 0x7f9a50135b50 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 -- 172.21.15.121:0/576605936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 msgr2=0x7f9a5009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 --2- 172.21.15.121:0/576605936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5009aae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009720 tx=0x7f9a4002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 -- 172.21.15.121:0/576605936 shutdown_connections 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 --2- 172.21.15.121:0/576605936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5009aae0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 -- 172.21.15.121:0/576605936 >> 172.21.15.121:0/576605936 conn(0x7f9a500a85e0 msgr2=0x7f9a500a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 -- 172.21.15.121:0/576605936 shutdown_connections 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.375+0000 7f9a5656d640 1 -- 172.21.15.121:0/576605936 wait complete. 2024-09-15T23:56:59.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.376+0000 7f9a5656d640 1 Processor -- start 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.376+0000 7f9a5656d640 1 -- start start 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a5656d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a5656d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9a500a5430 con 0x7f9a50135b50 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38226/0 (socket says 172.21.15.121:38226) 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4ffff640 1 -- 172.21.15.121:0/3306347568 learned_addr learned my addr 172.21.15.121:0/3306347568 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4ffff640 1 -- 172.21.15.121:0/3306347568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50122d80 con 0x7f9a50135b50 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4ffff640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a4002adf0 tx=0x7f9a400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40041070 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4003c590 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a50122630 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a40037040 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.377+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a500a2f80 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.378+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7f9a40044070 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.378+0000 7f9a4cff9640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 0x7f9a3c03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.378+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a50136350 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.378+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7f9a4006bc00 con 0x7f9a50135b50 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.378+0000 7f9a4f7fe640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 0x7f9a3c03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.379+0000 7f9a4f7fe640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 0x7f9a3c03a6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a44007fd0 tx=0x7f9a44007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.385 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.383+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a4002ae20 con 0x7f9a50135b50 2024-09-15T23:56:59.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.580+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a500a1f10 con 0x7f9a50135b50 2024-09-15T23:56:59.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.580+0000 7f9a4cff9640 1 -- 172.21.15.121:0/3306347568 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3579 (secure 0 0 0) 0x7f9a50122d80 con 0x7f9a50135b50 2024-09-15T23:56:59.583 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:59.583 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":24,"btime":"2024-09-15T23:56:56:184355+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/3663683812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":3663683812},{"type":"v1","addr":"172.21.15.121:6827","nonce":3663683812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:56:32.625272+0000","modified":"2024-09-15T23:56:34.516856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4536},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4536":{"gid":4536,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6826/537106624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":537106624},{"type":"v1","addr":"172.21.15.121:6826","nonce":537106624}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs_b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4536,"qdb_cluster":[4536]},"id":4}]} 2024-09-15T23:56:59.583 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 24 2024-09-15T23:56:59.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 msgr2=0x7f9a3c03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 0x7f9a3c03a6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a44007fd0 tx=0x7f9a44007ac0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 msgr2=0x7f9a5011eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a4002adf0 tx=0x7f9a400046c0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 shutdown_connections 2024-09-15T23:56:59.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9a3c038210 0x7f9a3c03a6d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 --2- 172.21.15.121:0/3306347568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9a50135b50 0x7f9a5011eba0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 >> 172.21.15.121:0/3306347568 conn(0x7f9a500a85e0 msgr2=0x7f9a5009d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 shutdown_connections 2024-09-15T23:56:59.587 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.582+0000 7f9a5656d640 1 -- 172.21.15.121:0/3306347568 wait complete. 2024-09-15T23:56:59.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:56:59.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9eac7b640 1 Processor -- start 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9eac7b640 1 -- start start 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9eac7b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9e4135f30 0x7fe9e413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9eac7b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e40a08c0 con 0x7fe9e4135b50 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9eac7b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e409b310 con 0x7fe9e4135f30 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9e3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9e4135f30 0x7fe9e413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9e8a17640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe9e4135b50 0x7fe9e409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57530/0 (socket says 172.21.15.121:57530) 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.691+0000 7fe9e8a17640 1 -- 172.21.15.121:0/303393776 learned_addr learned my addr 172.21.15.121:0/303393776 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e3fff640 1 -- 172.21.15.121:0/303393776 >> v1:172.21.15.121:6789/0 conn(0x7fe9e4135b50 legacy=0x7fe9e409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e3fff640 1 -- 172.21.15.121:0/303393776 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e40a2270 con 0x7fe9e4135f30 2024-09-15T23:56:59.695 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e3fff640 1 --2- 172.21.15.121:0/303393776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135f30 0x7fe9e413bb80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009720 tx=0x7fe9d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1199b8a73fed6aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e37fe640 1 -- 172.21.15.121:0/303393776 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d0037070 con 0x7fe9e4135f30 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e37fe640 1 -- 172.21.15.121:0/303393776 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d002ae20 con 0x7fe9e4135f30 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.692+0000 7fe9e37fe640 1 -- 172.21.15.121:0/303393776 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d0032590 con 0x7fe9e4135f30 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 -- 172.21.15.121:0/303393776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135f30 msgr2=0x7fe9e413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/303393776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135f30 0x7fe9e413bb80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009720 tx=0x7fe9d002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 -- 172.21.15.121:0/303393776 shutdown_connections 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/303393776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135f30 0x7fe9e413bb80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 -- 172.21.15.121:0/303393776 >> 172.21.15.121:0/303393776 conn(0x7fe9e40a85e0 msgr2=0x7fe9e40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 -- 172.21.15.121:0/303393776 shutdown_connections 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.693+0000 7fe9eac7b640 1 -- 172.21.15.121:0/303393776 wait complete. 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.694+0000 7fe9eac7b640 1 Processor -- start 2024-09-15T23:56:59.696 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.694+0000 7fe9eac7b640 1 -- start start 2024-09-15T23:56:59.699 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9eac7b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9eac7b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4136350 con 0x7fe9e4135b50 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e8a17640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e8a17640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38240/0 (socket says 172.21.15.121:38240) 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e8a17640 1 -- 172.21.15.121:0/238032292 learned_addr learned my addr 172.21.15.121:0/238032292 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e8a17640 1 -- 172.21.15.121:0/238032292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e41237c0 con 0x7fe9e4135b50 2024-09-15T23:56:59.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e8a17640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c4a0 tx=0x7fe9d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8017070 con 0x7fe9e4135b50 2024-09-15T23:56:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8005c10 con 0x7fe9e4135b50 2024-09-15T23:56:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8007070 con 0x7fe9e4135b50 2024-09-15T23:56:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e41242b0 con 0x7fe9e4135b50 2024-09-15T23:56:59.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.695+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41230e0 con 0x7fe9e4135b50 2024-09-15T23:56:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.696+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 45681+0+0 (secure 0 0 0) 0x7fe9d801a070 con 0x7fe9e4135b50 2024-09-15T23:56:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.696+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e409aae0 con 0x7fe9e4135b50 2024-09-15T23:56:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.696+0000 7fe9e17fa640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 0x7fe9c803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.696+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7fe9d804a670 con 0x7fe9e4135b50 2024-09-15T23:56:59.702 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.696+0000 7fe9e3fff640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 0x7fe9c803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.697+0000 7fe9e3fff640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 0x7fe9c803a6d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0034000 tx=0x7fe9d002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.701+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9d801b3b0 con 0x7fe9e4135b50 2024-09-15T23:56:59.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.769+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fe9d8010c00 con 0x7fe9e4135b50 2024-09-15T23:56:59.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.872+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e40a1f10 con 0x7fe9e4135b50 2024-09-15T23:56:59.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.873+0000 7fe9e17fa640 1 -- 172.21.15.121:0/238032292 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+11701 (secure 0 0 0) 0x7fe9d8037fe0 con 0x7fe9e4135b50 2024-09-15T23:56:59.875 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:56:59.875 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":47,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:56:58.318739+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_b_metadata","create_time":"2024-09-15T23:56:31.313898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_b_data","create_time":"2024-09-15T23:56:32.075280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs_b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/782013179":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/301835395":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/104251253":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6829/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6827/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6828/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:6825/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/391038332":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3129412638":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3001925135":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 msgr2=0x7fe9c803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 0x7fe9c803a6d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0034000 tx=0x7fe9d002e000 comp rx=0 tx=0).stop 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 msgr2=0x7fe9e411fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c4a0 tx=0x7fe9d800c960 comp rx=0 tx=0).stop 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 shutdown_connections 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fe9c8038210 0x7fe9c803a6d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 --2- 172.21.15.121:0/238032292 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e4135b50 0x7fe9e411fce0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 >> 172.21.15.121:0/238032292 conn(0x7fe9e40a85e0 msgr2=0x7fe9e409f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 shutdown_connections 2024-09-15T23:56:59.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.875+0000 7fe9eac7b640 1 -- 172.21.15.121:0/238032292 wait complete. 2024-09-15T23:56:59.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs_b 2024-09-15T23:56:59.987 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f7478bc4640 1 Processor -- start 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f7478bc4640 1 -- start start 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f7478bc4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f747409ee30 0x7f747413ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f7478bc4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74740a2280 con 0x7f74740a39c0 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f7478bc4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f747409e6e0 con 0x7f747409ee30 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.985+0000 7f746bfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f747409ee30 0x7f747413ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.986+0000 7f747259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f74740a39c0 0x7f74740a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57536/0 (socket says 172.21.15.121:57536) 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.986+0000 7f747259c640 1 -- 172.21.15.121:0/2911517922 learned_addr learned my addr 172.21.15.121:0/2911517922 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.986+0000 7f746bfff640 1 -- 172.21.15.121:0/2911517922 >> v1:172.21.15.121:6789/0 conn(0x7f74740a39c0 legacy=0x7f74740a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.986+0000 7f746bfff640 1 -- 172.21.15.121:0/2911517922 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747409e3d0 con 0x7f747409ee30 2024-09-15T23:56:59.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.986+0000 7f746bfff640 1 --2- 172.21.15.121:0/2911517922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f747413ced0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f745c009720 tx=0x7f745c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2de5b0f7cfae59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7471d9b640 1 -- 172.21.15.121:0/2911517922 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c037070 con 0x7f747409ee30 2024-09-15T23:56:59.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7471d9b640 1 -- 172.21.15.121:0/2911517922 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c02ad90 con 0x7f747409ee30 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7471d9b640 1 -- 172.21.15.121:0/2911517922 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745c032590 con 0x7f747409ee30 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 -- 172.21.15.121:0/2911517922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 msgr2=0x7f747413ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 --2- 172.21.15.121:0/2911517922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f747413ced0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f745c009720 tx=0x7f745c02a110 comp rx=0 tx=0).stop 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 -- 172.21.15.121:0/2911517922 shutdown_connections 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 --2- 172.21.15.121:0/2911517922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f747413ced0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 -- 172.21.15.121:0/2911517922 >> 172.21.15.121:0/2911517922 conn(0x7f74740a85e0 msgr2=0x7f74740a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 -- 172.21.15.121:0/2911517922 shutdown_connections 2024-09-15T23:56:59.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.987+0000 7f7478bc4640 1 -- 172.21.15.121:0/2911517922 wait complete. 2024-09-15T23:56:59.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.988+0000 7f7478bc4640 1 Processor -- start 2024-09-15T23:56:59.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.988+0000 7f7478bc4640 1 -- start start 2024-09-15T23:56:59.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f7478bc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f7478bc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74740a1ed0 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f747259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f747259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38250/0 (socket says 172.21.15.121:38250) 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f747259c640 1 -- 172.21.15.121:0/4189631321 learned_addr learned my addr 172.21.15.121:0/4189631321 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f747259c640 1 -- 172.21.15.121:0/4189631321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7474073310 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f747259c640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f746400c4a0 tx=0x7f746400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464017070 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7464005c10 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74740717b0 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7464007070 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.989+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7474072090 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.990+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f746401a070 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.990+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74740008d0 con 0x7f747409ee30 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.990+0000 7f746affd640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 0x7f745403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:56:59.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.991+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4135+0+0 (secure 0 0 0) 0x7f746404a7e0 con 0x7f747409ee30 2024-09-15T23:56:59.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.991+0000 7f746bfff640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 0x7f745403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:56:59.994 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.991+0000 7f746bfff640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 0x7f745403a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c02e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:56:59.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:56:59.995+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74640117a0 con 0x7f747409ee30 2024-09-15T23:57:00.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.193+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs_b"} v 0) -- 0x7f74740714d0 con 0x7f747409ee30 2024-09-15T23:57:00.195 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:57:00.193+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:57:00.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.194+0000 7f746affd640 1 -- 172.21.15.121:0/4189631321 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs_b"}]=0 cephfs_b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 165+0+0 (secure 0 0 0) 0x7f7464012400 con 0x7f747409ee30 2024-09-15T23:57:00.196 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs_b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:57:00.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 msgr2=0x7f745403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 0x7f745403a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f745c034000 tx=0x7f745c02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 msgr2=0x7f74741cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f746400c4a0 tx=0x7f746400c960 comp rx=0 tx=0).stop 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 shutdown_connections 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f74540382a0 0x7f745403a760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 --2- 172.21.15.121:0/4189631321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f747409ee30 0x7f74741cc590 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 >> 172.21.15.121:0/4189631321 conn(0x7f74740a85e0 msgr2=0x7f74740a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 shutdown_connections 2024-09-15T23:57:00.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.196+0000 7f7478bc4640 1 -- 172.21.15.121:0/4189631321 wait complete. 2024-09-15T23:57:00.200 INFO:tasks.ceph.mds.b.smithi121.stderr: -1132> 2024-09-15T23:56:38.179+0000 7fc9d1bfd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:00.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs_b --yes-i-really-mean-it 2024-09-15T23:57:00.226 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84ea9d6640 1 Processor -- start 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84ea9d6640 1 -- start start 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84ea9d6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84e40a04b0 0x7f84e413b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84ea9d6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e409abc0 con 0x7f84e4133020 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84ea9d6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40a2310 con 0x7f84e40a04b0 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84e3fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84e4133020 0x7f84e4133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57558/0 (socket says 172.21.15.121:57558) 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.310+0000 7f84e3fff640 1 -- 172.21.15.121:0/463721544 learned_addr learned my addr 172.21.15.121:0/463721544 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e37fe640 1 --2- 172.21.15.121:0/463721544 >> v2:172.21.15.121:3300/0 conn(0x7f84e40a04b0 0x7f84e413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e2ffd640 1 -- 172.21.15.121:0/463721544 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224409395 0 0) 0x7f84e409abc0 con 0x7f84e4133020 2024-09-15T23:57:00.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e2ffd640 1 -- 172.21.15.121:0/463721544 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d0004630 con 0x7f84e4133020 2024-09-15T23:57:00.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e37fe640 1 -- 172.21.15.121:0/463721544 >> v1:172.21.15.121:6789/0 conn(0x7f84e4133020 legacy=0x7f84e4133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e37fe640 1 -- 172.21.15.121:0/463721544 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e4132bf0 con 0x7f84e40a04b0 2024-09-15T23:57:00.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.311+0000 7f84e37fe640 1 --2- 172.21.15.121:0/463721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e413b330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009720 tx=0x7f84d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2f0e7f1005dd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84e2ffd640 1 -- 172.21.15.121:0/463721544 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84e40a04b0 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84e2ffd640 1 -- 172.21.15.121:0/463721544 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d402ad90 con 0x7f84e40a04b0 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84e2ffd640 1 -- 172.21.15.121:0/463721544 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4032570 con 0x7f84e40a04b0 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 -- 172.21.15.121:0/463721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 msgr2=0x7f84e413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/463721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e413b330 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009720 tx=0x7f84d402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 -- 172.21.15.121:0/463721544 shutdown_connections 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/463721544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e413b330 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 -- 172.21.15.121:0/463721544 >> 172.21.15.121:0/463721544 conn(0x7f84e40a8430 msgr2=0x7f84e40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 -- 172.21.15.121:0/463721544 shutdown_connections 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.312+0000 7f84ea9d6640 1 -- 172.21.15.121:0/463721544 wait complete. 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.313+0000 7f84ea9d6640 1 Processor -- start 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.313+0000 7f84ea9d6640 1 -- start start 2024-09-15T23:57:00.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84ea9d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84ea9d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40a1410 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38294/0 (socket says 172.21.15.121:38294) 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e3fff640 1 -- 172.21.15.121:0/4095880434 learned_addr learned my addr 172.21.15.121:0/4095880434 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e3fff640 1 -- 172.21.15.121:0/4095880434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e409ec90 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e3fff640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c3b0 tx=0x7f84cc00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc017070 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc005c10 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e409d360 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc0070d0 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.314+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e406fba0 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.315+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f84cc01a070 con 0x7f84e40a04b0 2024-09-15T23:57:00.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.315+0000 7f84e0ff9640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 0x7f84c403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:00.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.315+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4221+0+0 (secure 0 0 0) 0x7f84cc04a940 con 0x7f84e40a04b0 2024-09-15T23:57:00.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.315+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e40a3a20 con 0x7f84e40a04b0 2024-09-15T23:57:00.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.315+0000 7f84e37fe640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 0x7f84c403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:00.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.316+0000 7f84e37fe640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 0x7f84c403a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:00.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.320+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84cc019e10 con 0x7f84e40a04b0 2024-09-15T23:57:00.521 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:00.519+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs_b", "yes_i_really_mean_it": true} v 0) -- 0x7f84e40a1920 con 0x7f84e40a04b0 2024-09-15T23:57:01.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.195+0000 7f84e0ff9640 1 -- 172.21.15.121:0/4095880434 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs_b", "yes_i_really_mean_it": true}]=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7f84cc010b90 con 0x7f84e40a04b0 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 msgr2=0x7f84c403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 0x7f84c403a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 msgr2=0x7f84e4070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c3b0 tx=0x7f84cc00c870 comp rx=0 tx=0).stop 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 shutdown_connections 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f84c40382a0 0x7f84c403a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 --2- 172.21.15.121:0/4095880434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84e40a04b0 0x7f84e4070900 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 >> 172.21.15.121:0/4095880434 conn(0x7f84e40a8430 msgr2=0x7f84e409f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:01.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 shutdown_connections 2024-09-15T23:57:01.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.197+0000 7f84ea9d6640 1 -- 172.21.15.121:0/4095880434 wait complete. 2024-09-15T23:57:01.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_b_metadata cephfs_b_metadata --yes-i-really-really-mean-it 2024-09-15T23:57:01.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3ce6ba640 1 Processor -- start 2024-09-15T23:57:01.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3ce6ba640 1 -- start start 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3ce6ba640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3c80a04b0 0x7fa3c813b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3ce6ba640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c809abc0 con 0x7fa3c8133020 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3ce6ba640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c80a2310 con 0x7fa3c80a04b0 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3c77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa3c80a04b0 0x7fa3c813b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3c7fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa3c8133020 0x7fa3c8133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:57564/0 (socket says 172.21.15.121:57564) 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.353+0000 7fa3c7fff640 1 -- 172.21.15.121:0/2827414784 learned_addr learned my addr 172.21.15.121:0/2827414784 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c77fe640 1 -- 172.21.15.121:0/2827414784 >> v1:172.21.15.121:6789/0 conn(0x7fa3c8133020 legacy=0x7fa3c8133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:01.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c77fe640 1 -- 172.21.15.121:0/2827414784 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c8132bf0 con 0x7fa3c80a04b0 2024-09-15T23:57:01.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c77fe640 1 --2- 172.21.15.121:0/2827414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c813b330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009720 tx=0x7fa3bc02b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38348ed6a44a0c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:01.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c6ffd640 1 -- 172.21.15.121:0/2827414784 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc038070 con 0x7fa3c80a04b0 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c6ffd640 1 -- 172.21.15.121:0/2827414784 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc033440 con 0x7fa3c80a04b0 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.354+0000 7fa3c6ffd640 1 -- 172.21.15.121:0/2827414784 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3bc033740 con 0x7fa3c80a04b0 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/2827414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 msgr2=0x7fa3c813b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/2827414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c813b330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009720 tx=0x7fa3bc02b220 comp rx=0 tx=0).stop 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/2827414784 shutdown_connections 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/2827414784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c813b330 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/2827414784 >> 172.21.15.121:0/2827414784 conn(0x7fa3c80a8430 msgr2=0x7fa3c80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/2827414784 shutdown_connections 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.355+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/2827414784 wait complete. 2024-09-15T23:57:01.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.356+0000 7fa3ce6ba640 1 Processor -- start 2024-09-15T23:57:01.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.356+0000 7fa3ce6ba640 1 -- start start 2024-09-15T23:57:01.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3ce6ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:01.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3ce6ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c80a1410 con 0x7fa3c80a04b0 2024-09-15T23:57:01.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:38308/0 (socket says 172.21.15.121:38308) 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c7fff640 1 -- 172.21.15.121:0/3289218537 learned_addr learned my addr 172.21.15.121:0/3289218537 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c7fff640 1 -- 172.21.15.121:0/3289218537 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c81bfbc0 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c7fff640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c4a0 tx=0x7fa3b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b8017070 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b8005c10 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c8134b00 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b8007070 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.357+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c8134dc0 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.358+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fa3b801a070 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.358+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c80a3a20 con 0x7fa3c80a04b0 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.359+0000 7fa3c4ff9640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 0x7fa3b403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:01.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.359+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4221+0+0 (secure 0 0 0) 0x7fa3b804a740 con 0x7fa3c80a04b0 2024-09-15T23:57:01.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.359+0000 7fa3c77fe640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 0x7fa3b403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:01.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.359+0000 7fa3c77fe640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 0x7fa3b403a760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc035000 tx=0x7fa3bc02f000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:01.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.364+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3b8012400 con 0x7fa3c80a04b0 2024-09-15T23:57:01.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:01.528+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_b_metadata", "pool2": "cephfs_b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa3c80a1920 con 0x7fa3c80a04b0 2024-09-15T23:57:02.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.198+0000 7fa3c4ff9640 1 -- 172.21.15.121:0/3289218537 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_b_metadata", "pool2": "cephfs_b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_b_metadata' removed v49) ==== 187+0+0 (secure 0 0 0) 0x7fa3b801ac10 con 0x7fa3c80a04b0 2024-09-15T23:57:02.200 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_b_metadata' removed 2024-09-15T23:57:02.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 msgr2=0x7fa3b403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:02.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 0x7fa3b403a760 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc035000 tx=0x7fa3bc02f000 comp rx=0 tx=0).stop 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 msgr2=0x7fa3c81cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c4a0 tx=0x7fa3b800c960 comp rx=0 tx=0).stop 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 shutdown_connections 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa3b40382a0 0x7fa3b403a760 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 --2- 172.21.15.121:0/3289218537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3c80a04b0 0x7fa3c81cead0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.200+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 >> 172.21.15.121:0/3289218537 conn(0x7fa3c80a8430 msgr2=0x7fa3c80a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.201+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 shutdown_connections 2024-09-15T23:57:02.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.201+0000 7fa3ce6ba640 1 -- 172.21.15.121:0/3289218537 wait complete. 2024-09-15T23:57:02.218 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_b_data cephfs_b_data --yes-i-really-really-mean-it 2024-09-15T23:57:02.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c33423640 1 Processor -- start 2024-09-15T23:57:02.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c33423640 1 -- start start 2024-09-15T23:57:02.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c33423640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c2c0a7140 0x7f2c2c0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:02.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c33423640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2c0a6d10 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c33423640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2c2c06e230 con 0x7f2c2c0a7140 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c311bf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c2c0a7140 0x7f2c2c0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c309be640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2c2c0a4ab0 0x7f2c2c139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51230/0 (socket says 172.21.15.121:51230) 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c309be640 1 -- 172.21.15.121:0/3453086626 learned_addr learned my addr 172.21.15.121:0/3453086626 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c311bf640 1 -- 172.21.15.121:0/3453086626 >> v1:172.21.15.121:6789/0 conn(0x7f2c2c0a4ab0 legacy=0x7f2c2c139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c311bf640 1 -- 172.21.15.121:0/3453086626 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c0a3ae0 con 0x7f2c2c0a7140 2024-09-15T23:57:02.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.329+0000 7f2c23fff640 1 -- 172.21.15.121:0/3453086626 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494677655 0 0) 0x7f2c2c0a6d10 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.330+0000 7f2c311bf640 1 --2- 172.21.15.121:0/3453086626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a7140 0x7f2c2c0a7520 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d99ec821298e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.330+0000 7f2c23fff640 1 -- 172.21.15.121:0/3453086626 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28037070 con 0x7f2c2c0a7140 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.330+0000 7f2c23fff640 1 -- 172.21.15.121:0/3453086626 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2802ad90 con 0x7f2c2c0a7140 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.330+0000 7f2c23fff640 1 -- 172.21.15.121:0/3453086626 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28032590 con 0x7f2c2c0a7140 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 -- 172.21.15.121:0/3453086626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a7140 msgr2=0x7f2c2c0a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 --2- 172.21.15.121:0/3453086626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a7140 0x7f2c2c0a7520 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009720 tx=0x7f2c2802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:02.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 -- 172.21.15.121:0/3453086626 shutdown_connections 2024-09-15T23:57:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 --2- 172.21.15.121:0/3453086626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a7140 0x7f2c2c0a7520 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 -- 172.21.15.121:0/3453086626 >> 172.21.15.121:0/3453086626 conn(0x7f2c2c0ac370 msgr2=0x7f2c2c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 -- 172.21.15.121:0/3453086626 shutdown_connections 2024-09-15T23:57:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.331+0000 7f2c33423640 1 -- 172.21.15.121:0/3453086626 wait complete. 2024-09-15T23:57:02.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c33423640 1 Processor -- start 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c33423640 1 -- start start 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c33423640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c33423640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c0a7fc0 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c311bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c311bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44772/0 (socket says 172.21.15.121:44772) 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c311bf640 1 -- 172.21.15.121:0/584137825 learned_addr learned my addr 172.21.15.121:0/584137825 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:02.337 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.332+0000 7f2c311bf640 1 -- 172.21.15.121:0/584137825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c09e530 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c311bf640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009840 tx=0x7f2c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28041020 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2803d550 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c09e7a0 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c28037040 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.333+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c0a1200 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.334+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f2c28044020 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.334+0000 7f2c21ffb640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 0x7f2c1003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.334+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c0008d0 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.334+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 3779+0+0 (secure 0 0 0) 0x7f2c2806ba10 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.334+0000 7f2c309be640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 0x7f2c1003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:02.339 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.335+0000 7f2c309be640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 0x7f2c1003a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c000c00 tx=0x7f2c1c007910 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:02.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.339+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c2804b030 con 0x7f2c2c0a4ab0 2024-09-15T23:57:02.507 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:02.505+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_b_data", "pool2": "cephfs_b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2c2c09f080 con 0x7f2c2c0a4ab0 2024-09-15T23:57:03.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.200+0000 7f2c21ffb640 1 -- 172.21.15.121:0/584137825 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_b_data", "pool2": "cephfs_b_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_b_data' removed v50) ==== 175+0+0 (secure 0 0 0) 0x7f2c2803d870 con 0x7f2c2c0a4ab0 2024-09-15T23:57:03.201 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_b_data' removed 2024-09-15T23:57:03.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 msgr2=0x7f2c1003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 0x7f2c1003a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c000c00 tx=0x7f2c1c007910 comp rx=0 tx=0).stop 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 msgr2=0x7f2c2c135c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009840 tx=0x7f2c280046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 shutdown_connections 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f2c100382a0 0x7f2c1003a760 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c000c00 tx=0x7f2c1c007910 comp rx=0 tx=0).stop 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 --2- 172.21.15.121:0/584137825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c2c0a4ab0 0x7f2c2c135c60 secure :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009840 tx=0x7f2c280046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.204+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 >> 172.21.15.121:0/584137825 conn(0x7f2c2c0ac370 msgr2=0x7f2c2c137110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.205+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 shutdown_connections 2024-09-15T23:57:03.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.205+0000 7f2c33423640 1 -- 172.21.15.121:0/584137825 wait complete. 2024-09-15T23:57:03.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:57:03.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.322+0000 7efeb3db9640 1 Processor -- start 2024-09-15T23:57:03.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.322+0000 7efeb3db9640 1 -- start start 2024-09-15T23:57:03.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.322+0000 7efeb3db9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efeac0a04b0 0x7efeac13b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.322+0000 7efeb3db9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeac09abc0 con 0x7efeac133020 2024-09-15T23:57:03.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.322+0000 7efeb3db9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7efeac0a2310 con 0x7efeac0a04b0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1354640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7efeac0a04b0 0x7efeac13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1b55640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7efeac133020 0x7efeac133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51232/0 (socket says 172.21.15.121:51232) 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1b55640 1 -- 172.21.15.121:0/130854958 learned_addr learned my addr 172.21.15.121:0/130854958 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1354640 1 -- 172.21.15.121:0/130854958 >> v1:172.21.15.121:6789/0 conn(0x7efeac133020 legacy=0x7efeac133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1354640 1 -- 172.21.15.121:0/130854958 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac132bf0 con 0x7efeac0a04b0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.323+0000 7efeb1354640 1 --2- 172.21.15.121:0/130854958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac13b330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b9c0 tx=0x7efe9c02c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc96799ca3bd9f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb0b53640 1 -- 172.21.15.121:0/130854958 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe9c031640 con 0x7efeac0a04b0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb0b53640 1 -- 172.21.15.121:0/130854958 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9c0317e0 con 0x7efeac0a04b0 2024-09-15T23:57:03.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb0b53640 1 -- 172.21.15.121:0/130854958 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe9c031ae0 con 0x7efeac0a04b0 2024-09-15T23:57:03.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 -- 172.21.15.121:0/130854958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 msgr2=0x7efeac13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 --2- 172.21.15.121:0/130854958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac13b330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b9c0 tx=0x7efe9c02c7e0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 -- 172.21.15.121:0/130854958 shutdown_connections 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 --2- 172.21.15.121:0/130854958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac13b330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 -- 172.21.15.121:0/130854958 >> 172.21.15.121:0/130854958 conn(0x7efeac0a8430 msgr2=0x7efeac0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 -- 172.21.15.121:0/130854958 shutdown_connections 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.324+0000 7efeb3db9640 1 -- 172.21.15.121:0/130854958 wait complete. 2024-09-15T23:57:03.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.325+0000 7efeb3db9640 1 Processor -- start 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.325+0000 7efeb3db9640 1 -- start start 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb3db9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb3db9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efeac0a1410 con 0x7efeac0a04b0 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb1b55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb1b55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44798/0 (socket says 172.21.15.121:44798) 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb1b55640 1 -- 172.21.15.121:0/2183140705 learned_addr learned my addr 172.21.15.121:0/2183140705 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:03.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb1b55640 1 -- 172.21.15.121:0/2183140705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac1cb510 con 0x7efeac0a04b0 2024-09-15T23:57:03.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb1b55640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efea800c4a0 tx=0x7efea800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8017070 con 0x7efeac0a04b0 2024-09-15T23:57:03.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8005c10 con 0x7efeac0a04b0 2024-09-15T23:57:03.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeac11e3f0 con 0x7efeac0a04b0 2024-09-15T23:57:03.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efea8007070 con 0x7efeac0a04b0 2024-09-15T23:57:03.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.326+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeac11ea10 con 0x7efeac0a04b0 2024-09-15T23:57:03.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.327+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7efea801a070 con 0x7efeac0a04b0 2024-09-15T23:57:03.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.327+0000 7efea27fc640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 0x7efe9003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.327+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7efea804a3f0 con 0x7efeac0a04b0 2024-09-15T23:57:03.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.327+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeac1cb320 con 0x7efeac0a04b0 2024-09-15T23:57:03.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.327+0000 7efeb1354640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 0x7efe9003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.328+0000 7efeb1354640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 0x7efe9003a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe9c036000 tx=0x7efe9c031000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.332+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efea8012400 con 0x7efeac0a04b0 2024-09-15T23:57:03.506 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.505+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7efeac0a3a20 con 0x7efeac0a04b0 2024-09-15T23:57:03.508 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.507+0000 7efea27fc640 1 -- 172.21.15.121:0/2183140705 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7efea801ac10 con 0x7efeac0a04b0 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 msgr2=0x7efe9003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 0x7efe9003a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe9c036000 tx=0x7efe9c031000 comp rx=0 tx=0).stop 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 msgr2=0x7efeac072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efea800c4a0 tx=0x7efea800c960 comp rx=0 tx=0).stop 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 shutdown_connections 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7efe900382a0 0x7efe9003a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 --2- 172.21.15.121:0/2183140705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efeac0a04b0 0x7efeac072b40 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 >> 172.21.15.121:0/2183140705 conn(0x7efeac0a8430 msgr2=0x7efeac09f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 shutdown_connections 2024-09-15T23:57:03.511 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.510+0000 7efeb3db9640 1 -- 172.21.15.121:0/2183140705 wait complete. 2024-09-15T23:57:03.521 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs' 2024-09-15T23:57:03.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.618+0000 7ff648511640 1 Processor -- start 2024-09-15T23:57:03.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.618+0000 7ff648511640 1 -- start start 2024-09-15T23:57:03.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.618+0000 7ff648511640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff640133640 0x7ff64013b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.618+0000 7ff648511640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6400a16c0 con 0x7ff6400a39c0 2024-09-15T23:57:03.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.618+0000 7ff648511640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff6400a1490 con 0x7ff640133640 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff645aac640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff640133640 0x7ff64013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff6462ad640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff6400a39c0 0x7ff640132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51248/0 (socket says 172.21.15.121:51248) 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff6462ad640 1 -- 172.21.15.121:0/2146883330 learned_addr learned my addr 172.21.15.121:0/2146883330 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff6452ab640 1 -- 172.21.15.121:0/2146883330 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007290864 0 0) 0x7ff6400a16c0 con 0x7ff6400a39c0 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff6452ab640 1 -- 172.21.15.121:0/2146883330 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff62c003520 con 0x7ff6400a39c0 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff645aac640 1 -- 172.21.15.121:0/2146883330 >> v1:172.21.15.121:6789/0 conn(0x7ff6400a39c0 legacy=0x7ff640132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.619+0000 7ff645aac640 1 -- 172.21.15.121:0/2146883330 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6400a4010 con 0x7ff640133640 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff645aac640 1 --2- 172.21.15.121:0/2146883330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff640133640 0x7ff64013b270 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff630009720 tx=0x7ff63002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f595aee695e0ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff6452ab640 1 -- 172.21.15.121:0/2146883330 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff630037070 con 0x7ff640133640 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff6452ab640 1 -- 172.21.15.121:0/2146883330 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63002ad90 con 0x7ff640133640 2024-09-15T23:57:03.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff6452ab640 1 -- 172.21.15.121:0/2146883330 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff630032570 con 0x7ff640133640 2024-09-15T23:57:03.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 -- 172.21.15.121:0/2146883330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff640133640 msgr2=0x7ff64013b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 --2- 172.21.15.121:0/2146883330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff640133640 0x7ff64013b270 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff630009720 tx=0x7ff63002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 -- 172.21.15.121:0/2146883330 shutdown_connections 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 --2- 172.21.15.121:0/2146883330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff640133640 0x7ff64013b270 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 -- 172.21.15.121:0/2146883330 >> 172.21.15.121:0/2146883330 conn(0x7ff6400a85e0 msgr2=0x7ff6400a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 -- 172.21.15.121:0/2146883330 shutdown_connections 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.620+0000 7ff648511640 1 -- 172.21.15.121:0/2146883330 wait complete. 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.621+0000 7ff648511640 1 Processor -- start 2024-09-15T23:57:03.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.621+0000 7ff648511640 1 -- start start 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff648511640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff648511640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401329c0 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff6462ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff6462ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44806/0 (socket says 172.21.15.121:44806) 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff6462ad640 1 -- 172.21.15.121:0/3379570210 learned_addr learned my addr 172.21.15.121:0/3379570210 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff6462ad640 1 -- 172.21.15.121:0/3379570210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64013b420 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff6462ad640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c310 tx=0x7ff63c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c017070 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c005c10 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64013ae40 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63c0070d0 con 0x7ff6400a39c0 2024-09-15T23:57:03.625 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.622+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64013b110 con 0x7ff6400a39c0 2024-09-15T23:57:03.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.623+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7ff63c01a070 con 0x7ff6400a39c0 2024-09-15T23:57:03.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.623+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6400a2340 con 0x7ff6400a39c0 2024-09-15T23:57:03.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.623+0000 7ff636ffd640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 0x7ff62403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:03.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.624+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7ff63c04a4f0 con 0x7ff6400a39c0 2024-09-15T23:57:03.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.624+0000 7ff645aac640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 0x7ff62403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:03.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.624+0000 7ff645aac640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 0x7ff62403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff630034000 tx=0x7ff63002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:03.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.628+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff63c010950 con 0x7ff6400a39c0 2024-09-15T23:57:03.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:03.855+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]} v 0) -- 0x7ff64006bde0 con 0x7ff6400a39c0 2024-09-15T23:57:04.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.203+0000 7ff636ffd640 1 -- 172.21.15.121:0/3379570210 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_dumpfs"]}]=0 v122) ==== 124+0+0 (secure 0 0 0) 0x7ff63c010bb0 con 0x7ff6400a39c0 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 msgr2=0x7ff62403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 0x7ff62403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff630034000 tx=0x7ff63002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 msgr2=0x7ff64013c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00c310 tx=0x7ff63c00c7d0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 shutdown_connections 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7ff6240382a0 0x7ff62403a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 --2- 172.21.15.121:0/3379570210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6400a39c0 0x7ff64013c7c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 >> 172.21.15.121:0/3379570210 conn(0x7ff6400a85e0 msgr2=0x7ff6400a6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 shutdown_connections 2024-09-15T23:57:04.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.205+0000 7ff648511640 1 -- 172.21.15.121:0/3379570210 wait complete. 2024-09-15T23:57:04.217 INFO:tasks.cephfs_test_runner:Tests 'cephfs-top --dumpfs' output is valid ... ok 2024-09-15T23:57:04.217 INFO:tasks.cephfs_test_runner:Starting test: test_fstop (tasks.cephfs.test_fstop.TestFSTop) 2024-09-15T23:57:04.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:04.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.314+0000 7fec2dc8d640 1 Processor -- start 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.314+0000 7fec2dc8d640 1 -- start start 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.314+0000 7fec2dc8d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec28135b50 0x7fec2809aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.314+0000 7fec2dc8d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2809b020 con 0x7fec28135f30 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec2dc8d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fec2809b310 con 0x7fec28135b50 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec277fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fec28135b50 0x7fec2809aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec26ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fec28135f30 0x7fec280a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51258/0 (socket says 172.21.15.121:51258) 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec26ffd640 1 -- 172.21.15.121:0/3110595327 learned_addr learned my addr 172.21.15.121:0/3110595327 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec277fe640 1 -- 172.21.15.121:0/3110595327 >> v1:172.21.15.121:6789/0 conn(0x7fec28135f30 legacy=0x7fec280a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.315+0000 7fec277fe640 1 -- 172.21.15.121:0/3110595327 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec280a08c0 con 0x7fec28135b50 2024-09-15T23:57:04.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec277fe640 1 --2- 172.21.15.121:0/3110595327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809aae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fec18009720 tx=0x7fec1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b25b473243ea7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec267fc640 1 -- 172.21.15.121:0/3110595327 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec18037070 con 0x7fec28135b50 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec267fc640 1 -- 172.21.15.121:0/3110595327 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1802ae20 con 0x7fec28135b50 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec267fc640 1 -- 172.21.15.121:0/3110595327 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec18032590 con 0x7fec28135b50 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 -- 172.21.15.121:0/3110595327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 msgr2=0x7fec2809aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/3110595327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809aae0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fec18009720 tx=0x7fec1802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 -- 172.21.15.121:0/3110595327 shutdown_connections 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/3110595327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809aae0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 -- 172.21.15.121:0/3110595327 >> 172.21.15.121:0/3110595327 conn(0x7fec280a85e0 msgr2=0x7fec280a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 -- 172.21.15.121:0/3110595327 shutdown_connections 2024-09-15T23:57:04.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.316+0000 7fec2dc8d640 1 -- 172.21.15.121:0/3110595327 wait complete. 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.317+0000 7fec2dc8d640 1 Processor -- start 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.317+0000 7fec2dc8d640 1 -- start start 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec2dc8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec2dc8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec280a5430 con 0x7fec28135b50 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec277fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec277fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44820/0 (socket says 172.21.15.121:44820) 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec277fe640 1 -- 172.21.15.121:0/1642801577 learned_addr learned my addr 172.21.15.121:0/1642801577 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec277fe640 1 -- 172.21.15.121:0/1642801577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec28126670 con 0x7fec28135b50 2024-09-15T23:57:04.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec277fe640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fec1802adf0 tx=0x7fec180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec18041070 con 0x7fec28135b50 2024-09-15T23:57:04.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1803c590 con 0x7fec28135b50 2024-09-15T23:57:04.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec28125a70 con 0x7fec28135b50 2024-09-15T23:57:04.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.318+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec18037040 con 0x7fec28135b50 2024-09-15T23:57:04.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.319+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec280a4100 con 0x7fec28135b50 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.319+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fec18044070 con 0x7fec28135b50 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.320+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec28136350 con 0x7fec28135b50 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.320+0000 7fec0ffff640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 0x7fec1403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.320+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7fec1806b990 con 0x7fec28135b50 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.320+0000 7fec26ffd640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 0x7fec1403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.320+0000 7fec26ffd640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 0x7fec1403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec1c007fd0 tx=0x7fec1c007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.324+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec1803c960 con 0x7fec28135b50 2024-09-15T23:57:04.491 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.491+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec280a1f10 con 0x7fec28135b50 2024-09-15T23:57:04.492 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.491+0000 7fec0ffff640 1 -- 172.21.15.121:0/1642801577 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+7941 (secure 0 0 0) 0x7fec1802ae20 con 0x7fec28135b50 2024-09-15T23:57:04.492 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:04.493 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":50,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:03.200133+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6826/537106624":"2024-09-16T23:57:00.195193+0000","172.21.15.121:6824/537106624":"2024-09-16T23:57:00.195193+0000","172.21.15.121:0/782013179":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/301835395":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/104251253":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6829/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6827/3398364693":"2024-09-16T23:56:55.307755+0000","172.21.15.121:6828/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:6825/469179342":"2024-09-16T23:56:55.183429+0000","172.21.15.121:0/110451684":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/391038332":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3129412638":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3001925135":"2024-09-16T23:56:55.307755+0000","172.21.15.121:0/3314538443":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6829/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:6827/1410518606":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1594878766":"2024-09-16T23:56:32.172781+0000","172.21.15.121:0/1255371049":"2024-09-16T23:56:32.172781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 msgr2=0x7fec1403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 0x7fec1403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec1c007fd0 tx=0x7fec1c007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 msgr2=0x7fec2809b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fec1802adf0 tx=0x7fec180046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 shutdown_connections 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fec140382a0 0x7fec1403a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 --2- 172.21.15.121:0/1642801577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec28135b50 0x7fec2809b570 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 >> 172.21.15.121:0/1642801577 conn(0x7fec280a85e0 msgr2=0x7fec280a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 shutdown_connections 2024-09-15T23:57:04.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.494+0000 7fec2dc8d640 1 -- 172.21.15.121:0/1642801577 wait complete. 2024-09-15T23:57:04.505 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:55:04.051077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:57:04.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:57:04.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.609+0000 7fd883d98640 1 Processor -- start 2024-09-15T23:57:04.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd883d98640 1 -- start start 2024-09-15T23:57:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd883d98640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd87c0a7140 0x7fd87c0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd883d98640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87c0a6d10 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd883d98640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c06e230 con 0x7fd87c0a7140 2024-09-15T23:57:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd881b34640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd87c0a7140 0x7fd87c0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd881333640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd87c0a4ab0 0x7fd87c139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51262/0 (socket says 172.21.15.121:51262) 2024-09-15T23:57:04.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd881333640 1 -- 172.21.15.121:0/1596419646 learned_addr learned my addr 172.21.15.121:0/1596419646 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:04.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.610+0000 7fd881b34640 1 -- 172.21.15.121:0/1596419646 >> v1:172.21.15.121:6789/0 conn(0x7fd87c0a4ab0 legacy=0x7fd87c139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd881b34640 1 -- 172.21.15.121:0/1596419646 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c0a3ae0 con 0x7fd87c0a7140 2024-09-15T23:57:04.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd880b32640 1 -- 172.21.15.121:0/1596419646 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623555921 0 0) 0x7fd87c0a6d10 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd881b34640 1 --2- 172.21.15.121:0/1596419646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a7140 0x7fd87c0a7520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd878009720 tx=0x7fd87802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4989f2b5d9145afe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd880b32640 1 -- 172.21.15.121:0/1596419646 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd878037070 con 0x7fd87c0a7140 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd880b32640 1 -- 172.21.15.121:0/1596419646 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87802ad90 con 0x7fd87c0a7140 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.611+0000 7fd880b32640 1 -- 172.21.15.121:0/1596419646 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd878032590 con 0x7fd87c0a7140 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 -- 172.21.15.121:0/1596419646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a7140 msgr2=0x7fd87c0a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 --2- 172.21.15.121:0/1596419646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a7140 0x7fd87c0a7520 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd878009720 tx=0x7fd87802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 -- 172.21.15.121:0/1596419646 shutdown_connections 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 --2- 172.21.15.121:0/1596419646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a7140 0x7fd87c0a7520 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 -- 172.21.15.121:0/1596419646 >> 172.21.15.121:0/1596419646 conn(0x7fd87c0ac370 msgr2=0x7fd87c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 -- 172.21.15.121:0/1596419646 shutdown_connections 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.612+0000 7fd883d98640 1 -- 172.21.15.121:0/1596419646 wait complete. 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd883d98640 1 Processor -- start 2024-09-15T23:57:04.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd883d98640 1 -- start start 2024-09-15T23:57:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd883d98640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd883d98640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0a7fc0 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd881b34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd881b34640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44828/0 (socket says 172.21.15.121:44828) 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.613+0000 7fd881b34640 1 -- 172.21.15.121:0/2343316599 learned_addr learned my addr 172.21.15.121:0/2343316599 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd881b34640 1 -- 172.21.15.121:0/2343316599 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c1ce480 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd881b34640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd878009840 tx=0x7fd8780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd878041020 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87803d550 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c0a2930 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd878037040 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.614+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c0a16b0 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fd878044020 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd87c0a2620 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.617 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd8727fc640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 0x7fd86003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7fd87806b8c0 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd881333640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 0x7fd86003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.615+0000 7fd881333640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 0x7fd86003a710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0011e0 tx=0x7fd86c007930 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.620+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd87804b030 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.696 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:04.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.788+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd87c0a0af0 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.789+0000 7fd8727fc640 1 -- 172.21.15.121:0/2343316599 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fd87803d920 con 0x7fd87c0a4ab0 2024-09-15T23:57:04.790 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 msgr2=0x7fd86003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 0x7fd86003a710 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0011e0 tx=0x7fd86c007930 comp rx=0 tx=0).stop 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 msgr2=0x7fd87c1ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd878009840 tx=0x7fd8780046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 shutdown_connections 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd860038250 0x7fd86003a710 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 --2- 172.21.15.121:0/2343316599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd87c0a4ab0 0x7fd87c1ceb70 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 >> 172.21.15.121:0/2343316599 conn(0x7fd87c0ac370 msgr2=0x7fd87c136190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 shutdown_connections 2024-09-15T23:57:04.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.791+0000 7fd883d98640 1 -- 172.21.15.121:0/2343316599 wait complete. 2024-09-15T23:57:04.803 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop' 2024-09-15T23:57:04.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.940+0000 7fbe0f959640 1 Processor -- start 2024-09-15T23:57:04.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.940+0000 7fbe0f959640 1 -- start start 2024-09-15T23:57:04.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0f959640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe08135f30 0x7fbe0813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0f959640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe080a08c0 con 0x7fbe08135b50 2024-09-15T23:57:04.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0f959640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0809b310 con 0x7fbe08135f30 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0cef4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe08135f30 0x7fbe0813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0d6f5640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe08135b50 0x7fbe0809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51274/0 (socket says 172.21.15.121:51274) 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0d6f5640 1 -- 172.21.15.121:0/1427375978 learned_addr learned my addr 172.21.15.121:0/1427375978 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0cef4640 1 -- 172.21.15.121:0/1427375978 >> v1:172.21.15.121:6789/0 conn(0x7fbe08135b50 legacy=0x7fbe0809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbe0cef4640 1 -- 172.21.15.121:0/1427375978 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080a2270 con 0x7fbe08135f30 2024-09-15T23:57:04.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.941+0000 7fbdfffff640 1 -- 172.21.15.121:0/1427375978 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526145352 0 0) 0x7fbe080a08c0 con 0x7fbe08135b50 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.942+0000 7fbe0cef4640 1 --2- 172.21.15.121:0/1427375978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135f30 0x7fbe0813bb80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009720 tx=0x7fbdf802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf1b37282dabbe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.942+0000 7fbdfffff640 1 -- 172.21.15.121:0/1427375978 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf8037070 con 0x7fbe08135f30 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.942+0000 7fbdfffff640 1 -- 172.21.15.121:0/1427375978 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf802ae20 con 0x7fbe08135f30 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.942+0000 7fbdfffff640 1 -- 172.21.15.121:0/1427375978 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdf8032590 con 0x7fbe08135f30 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 -- 172.21.15.121:0/1427375978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135f30 msgr2=0x7fbe0813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:04.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1427375978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135f30 0x7fbe0813bb80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009720 tx=0x7fbdf802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 -- 172.21.15.121:0/1427375978 shutdown_connections 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1427375978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135f30 0x7fbe0813bb80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 -- 172.21.15.121:0/1427375978 >> 172.21.15.121:0/1427375978 conn(0x7fbe080a85e0 msgr2=0x7fbe080a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 -- 172.21.15.121:0/1427375978 shutdown_connections 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.943+0000 7fbe0f959640 1 -- 172.21.15.121:0/1427375978 wait complete. 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0f959640 1 Processor -- start 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0f959640 1 -- start start 2024-09-15T23:57:04.947 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0f959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0f959640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08136350 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0d6f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0d6f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44846/0 (socket says 172.21.15.121:44846) 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0d6f5640 1 -- 172.21.15.121:0/1991300322 learned_addr learned my addr 172.21.15.121:0/1991300322 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0d6f5640 1 -- 172.21.15.121:0/1991300322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe08072310 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.944+0000 7fbe0d6f5640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400c420 tx=0x7fbe0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.945+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe04018070 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.945+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe040074d0 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.945+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0809d460 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.945+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe04004950 con 0x7fbe08135b50 2024-09-15T23:57:04.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.945+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0809d180 con 0x7fbe08135b50 2024-09-15T23:57:04.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fbe0401b070 con 0x7fbe08135b50 2024-09-15T23:57:04.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0809aae0 con 0x7fbe08135b50 2024-09-15T23:57:04.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbdfdffb640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 0x7fbdec03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:04.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7fbe0404a520 con 0x7fbe08135b50 2024-09-15T23:57:04.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbe0cef4640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 0x7fbdec03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:04.950 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.946+0000 7fbe0cef4640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 0x7fbdec03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8034000 tx=0x7fbdf802e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:04.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:04.950+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe04011980 con 0x7fbe08135b50 2024-09-15T23:57:05.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.180+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]} v 0) -- 0x7fbe080a1f10 con 0x7fbe08135b50 2024-09-15T23:57:05.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.203+0000 7fbdfdffb640 1 -- 172.21.15.121:0/1991300322 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]}]=0 v123) ==== 126+0+0 (secure 0 0 0) 0x7fbe04011be0 con 0x7fbe08135b50 2024-09-15T23:57:05.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 msgr2=0x7fbdec03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 0x7fbdec03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8034000 tx=0x7fbdf802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 msgr2=0x7fbe08072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400c420 tx=0x7fbe0400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 shutdown_connections 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fbdec0382a0 0x7fbdec03a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 --2- 172.21.15.121:0/1991300322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe08135b50 0x7fbe08072e40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 >> 172.21.15.121:0/1991300322 conn(0x7fbe080a85e0 msgr2=0x7fbe0809f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 shutdown_connections 2024-09-15T23:57:05.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.205+0000 7fbe0f959640 1 -- 172.21.15.121:0/1991300322 wait complete. 2024-09-15T23:57:05.217 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:57:05.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6dc627640 1 Processor -- start 2024-09-15T23:57:05.319 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6dc627640 1 -- start start 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6dc627640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6d40a04b0 0x7fa6d413b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6dc627640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d409abc0 con 0x7fa6d4133020 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6dc627640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d40a2310 con 0x7fa6d40a04b0 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6d9bc2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa6d40a04b0 0x7fa6d413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.318+0000 7fa6da3c3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa6d4133020 0x7fa6d4133400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51280/0 (socket says 172.21.15.121:51280) 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.319+0000 7fa6da3c3640 1 -- 172.21.15.121:0/2111215886 learned_addr learned my addr 172.21.15.121:0/2111215886 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.319+0000 7fa6d9bc2640 1 -- 172.21.15.121:0/2111215886 >> v1:172.21.15.121:6789/0 conn(0x7fa6d4133020 legacy=0x7fa6d4133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.319+0000 7fa6d9bc2640 1 -- 172.21.15.121:0/2111215886 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d4132bf0 con 0x7fa6d40a04b0 2024-09-15T23:57:05.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.319+0000 7fa6d93c1640 1 -- 172.21.15.121:0/2111215886 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626538863 0 0) 0x7fa6d409abc0 con 0x7fa6d4133020 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.319+0000 7fa6d9bc2640 1 --2- 172.21.15.121:0/2111215886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d413b330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009720 tx=0x7fa6c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630c76f4827b2e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6d93c1640 1 -- 172.21.15.121:0/2111215886 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c4037070 con 0x7fa6d40a04b0 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6d93c1640 1 -- 172.21.15.121:0/2111215886 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c402ad90 con 0x7fa6d40a04b0 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6d93c1640 1 -- 172.21.15.121:0/2111215886 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c4032590 con 0x7fa6d40a04b0 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 -- 172.21.15.121:0/2111215886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 msgr2=0x7fa6d413b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2111215886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d413b330 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4009720 tx=0x7fa6c402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 -- 172.21.15.121:0/2111215886 shutdown_connections 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2111215886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d413b330 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 -- 172.21.15.121:0/2111215886 >> 172.21.15.121:0/2111215886 conn(0x7fa6d40a8430 msgr2=0x7fa6d40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 -- 172.21.15.121:0/2111215886 shutdown_connections 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.320+0000 7fa6dc627640 1 -- 172.21.15.121:0/2111215886 wait complete. 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.321+0000 7fa6dc627640 1 Processor -- start 2024-09-15T23:57:05.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.321+0000 7fa6dc627640 1 -- start start 2024-09-15T23:57:05.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.321+0000 7fa6dc627640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6dc627640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40a1410 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6da3c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6da3c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44876/0 (socket says 172.21.15.121:44876) 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6da3c3640 1 -- 172.21.15.121:0/2594695665 learned_addr learned my addr 172.21.15.121:0/2594695665 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6da3c3640 1 -- 172.21.15.121:0/2594695665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d409cfa0 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6da3c3640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c420 tx=0x7fa6d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0018070 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d00074d0 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6d0004950 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d4073310 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.322+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d406f8d0 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.323+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fa6d001b070 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.323+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d40a3a20 con 0x7fa6d40a04b0 2024-09-15T23:57:05.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.323+0000 7fa6caffd640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 0x7fa6b803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.323+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7fa6d004a570 con 0x7fa6d40a04b0 2024-09-15T23:57:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.323+0000 7fa6d9bc2640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 0x7fa6b803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.324+0000 7fa6d9bc2640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 0x7fa6b803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034000 tx=0x7fa6c402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.328+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6d0011960 con 0x7fa6d40a04b0 2024-09-15T23:57:05.493 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.492+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa6d40a1920 con 0x7fa6d40a04b0 2024-09-15T23:57:05.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.495+0000 7fa6caffd640 1 -- 172.21.15.121:0/2594695665 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v9)=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fa6d0011bc0 con 0x7fa6d40a04b0 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 msgr2=0x7fa6b803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 0x7fa6b803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4034000 tx=0x7fa6c402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 msgr2=0x7fa6d409d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c420 tx=0x7fa6d000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 shutdown_connections 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fa6b80382a0 0x7fa6b803a760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 --2- 172.21.15.121:0/2594695665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6d40a04b0 0x7fa6d409d230 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 >> 172.21.15.121:0/2594695665 conn(0x7fa6d40a8430 msgr2=0x7fa6d409f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 shutdown_connections 2024-09-15T23:57:05.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.497+0000 7fa6dc627640 1 -- 172.21.15.121:0/2594695665 wait complete. 2024-09-15T23:57:05.508 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:05.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:05.546 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:05.546 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:05.546 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:05.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:05.603 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:05.603 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:05.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:05.658 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-15T23:57:05.659 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.796+0000 7f9f0d5c0640 1 Processor -- start 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.796+0000 7f9f0d5c0640 1 -- start start 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.796+0000 7f9f0d5c0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f08135f30 0x7f9f0813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.796+0000 7f9f0d5c0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f080a08c0 con 0x7f9f08135b50 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.796+0000 7f9f0d5c0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9f0809b310 con 0x7f9f08135f30 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9f06ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9f08135b50 0x7f9f0809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51294/0 (socket says 172.21.15.121:51294) 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9f06ffd640 1 -- 172.21.15.121:0/2227383319 learned_addr learned my addr 172.21.15.121:0/2227383319 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:05.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9efffff640 1 --2- 172.21.15.121:0/2227383319 >> v2:172.21.15.121:3300/0 conn(0x7f9f08135f30 0x7f9f0813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9f067fc640 1 -- 172.21.15.121:0/2227383319 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1366537222 0 0) 0x7f9f080a08c0 con 0x7f9f08135b50 2024-09-15T23:57:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9f067fc640 1 -- 172.21.15.121:0/2227383319 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef4003520 con 0x7f9f08135b50 2024-09-15T23:57:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9efffff640 1 -- 172.21.15.121:0/2227383319 >> v1:172.21.15.121:6789/0 conn(0x7f9f08135b50 legacy=0x7f9f0809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.797+0000 7f9efffff640 1 -- 172.21.15.121:0/2227383319 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f080a2270 con 0x7f9f08135f30 2024-09-15T23:57:05.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9efffff640 1 --2- 172.21.15.121:0/2227383319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135f30 0x7f9f0813bb80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009720 tx=0x7f9ef002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809f977ad8a7c863 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f067fc640 1 -- 172.21.15.121:0/2227383319 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0037070 con 0x7f9f08135f30 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f067fc640 1 -- 172.21.15.121:0/2227383319 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef002ae20 con 0x7f9f08135f30 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f067fc640 1 -- 172.21.15.121:0/2227383319 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0032570 con 0x7f9f08135f30 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2227383319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135f30 msgr2=0x7f9f0813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2227383319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135f30 0x7f9f0813bb80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009720 tx=0x7f9ef002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2227383319 shutdown_connections 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2227383319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135f30 0x7f9f0813bb80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2227383319 >> 172.21.15.121:0/2227383319 conn(0x7f9f080a85e0 msgr2=0x7f9f080a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2227383319 shutdown_connections 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.798+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2227383319 wait complete. 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.799+0000 7f9f0d5c0640 1 Processor -- start 2024-09-15T23:57:05.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.799+0000 7f9f0d5c0640 1 -- start start 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f0d5c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f0d5c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08136350 con 0x7f9f08135b50 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f06ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f06ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44900/0 (socket says 172.21.15.121:44900) 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f06ffd640 1 -- 172.21.15.121:0/2395733243 learned_addr learned my addr 172.21.15.121:0/2395733243 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:05.802 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f06ffd640 1 -- 172.21.15.121:0/2395733243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f08123cc0 con 0x7f9f08135b50 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f06ffd640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c3b0 tx=0x7f9ef800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef8017070 con 0x7f9f08135b50 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef8005c10 con 0x7f9f08135b50 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ef80070d0 con 0x7f9f08135b50 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f081232d0 con 0x7f9f08135b50 2024-09-15T23:57:05.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.800+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f080a2d20 con 0x7f9f08135b50 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.801+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f9ef801a070 con 0x7f9f08135b50 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.801+0000 7f9eff7fe640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 0x7f9ee803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.801+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7f9ef804a5f0 con 0x7f9f08135b50 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.801+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0809aae0 con 0x7f9f08135b50 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.801+0000 7f9efffff640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 0x7f9ee803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:05.805 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.802+0000 7f9efffff640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 0x7f9ee803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0034000 tx=0x7f9ef002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:05.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:05.806+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f08123cc0 con 0x7f9f08135b50 2024-09-15T23:57:06.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.005+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f080a1f10 con 0x7f9f08135b50 2024-09-15T23:57:06.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.005+0000 7f9eff7fe640 1 -- 172.21.15.121:0/2395733243 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+2264 (secure 0 0 0) 0x7f9ef8019e10 con 0x7f9f08135b50 2024-09-15T23:57:06.006 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:06.006 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":26,"btime":"2024-09-15T23:57:01:196039+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4746,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/3663683812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":3663683812},{"type":"v1","addr":"172.21.15.121:6827","nonce":3663683812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":4787,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6826/672436586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":672436586},{"type":"v1","addr":"172.21.15.121:6826","nonce":672436586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-09-15T23:57:06.006 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 26 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 msgr2=0x7f9ee803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 0x7f9ee803a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0034000 tx=0x7f9ef002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 msgr2=0x7f9f08120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c3b0 tx=0x7f9ef800c870 comp rx=0 tx=0).stop 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 shutdown_connections 2024-09-15T23:57:06.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f9ee80382a0 0x7f9ee803a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:06.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 --2- 172.21.15.121:0/2395733243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f08135b50 0x7f9f08120c00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:06.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 >> 172.21.15.121:0/2395733243 conn(0x7f9f080a85e0 msgr2=0x7f9f080a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:06.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 shutdown_connections 2024-09-15T23:57:06.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.007+0000 7f9f0d5c0640 1 -- 172.21.15.121:0/2395733243 wait complete. 2024-09-15T23:57:06.019 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:57:06.019 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:57:06.019 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:57:06.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:06.019 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:57:06.019 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:57:06.020 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:57:06.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:06.028 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:57:06.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:57:06.029 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:57:06.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:57:06.072 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:57:06.072 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:06.073 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:57:06.073 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:06.074 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:57:06.147 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:57:06.148 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:57:06.148 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-15T23:57:06.147+0000 7fa165311640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2024-09-15T23:57:06.148 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-09-15T23:57:06.147+0000 7f7d3f4d7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2024-09-15T23:57:06.149 INFO:tasks.ceph.mds.a.smithi121.stderr:2024-09-15T23:57:06.147+0000 7fa165311640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6825/0: (98) Address already in use 2024-09-15T23:57:06.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.175+0000 7fdda3bbd640 1 Processor -- start 2024-09-15T23:57:06.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.175+0000 7fdda3bbd640 1 -- start start 2024-09-15T23:57:06.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.175+0000 7fdda3bbd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd9c06d7b0 0x7fdd9c09d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:06.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.175+0000 7fdda3bbd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9c06eac0 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.177 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.175+0000 7fdda3bbd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9c09ced0 con 0x7fdd9c06d7b0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda1158640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fdd9c06d7b0 0x7fdd9c09d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda1959640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fdd9c06ccc0 0x7fdd9c06d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51328/0 (socket says 172.21.15.121:51328) 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda1959640 1 -- 172.21.15.121:0/3135512110 learned_addr learned my addr 172.21.15.121:0/3135512110 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda1158640 1 -- 172.21.15.121:0/3135512110 >> v1:172.21.15.121:6789/0 conn(0x7fdd9c06ccc0 legacy=0x7fdd9c06d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda1158640 1 -- 172.21.15.121:0/3135512110 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c06e270 con 0x7fdd9c06d7b0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.176+0000 7fdda0957640 1 -- 172.21.15.121:0/3135512110 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511845455 0 0) 0x7fdd9c06eac0 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda1158640 1 --2- 172.21.15.121:0/3135512110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06d7b0 0x7fdd9c09d6c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009720 tx=0x7fdd9002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effc3b9e716f1f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda0957640 1 -- 172.21.15.121:0/3135512110 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90037070 con 0x7fdd9c06d7b0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda0957640 1 -- 172.21.15.121:0/3135512110 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9002ad90 con 0x7fdd9c06d7b0 2024-09-15T23:57:06.178 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda0957640 1 -- 172.21.15.121:0/3135512110 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd90032590 con 0x7fdd9c06d7b0 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3135512110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06d7b0 msgr2=0x7fdd9c09d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3135512110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06d7b0 0x7fdd9c09d6c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009720 tx=0x7fdd9002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3135512110 shutdown_connections 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3135512110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06d7b0 0x7fdd9c09d6c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3135512110 >> 172.21.15.121:0/3135512110 conn(0x7fdd9c071aa0 msgr2=0x7fdd9c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:06.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3135512110 shutdown_connections 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.177+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3135512110 wait complete. 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.178+0000 7fdda3bbd640 1 Processor -- start 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda3bbd640 1 -- start start 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda3bbd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda3bbd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c09cc10 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda1959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda1959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44968/0 (socket says 172.21.15.121:44968) 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda1959640 1 -- 172.21.15.121:0/3889779914 learned_addr learned my addr 172.21.15.121:0/3889779914 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.179+0000 7fdda1959640 1 -- 172.21.15.121:0/3889779914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c09fb20 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdda1959640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c420 tx=0x7fdd9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd98018070 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd980074d0 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9c120b70 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd98004950 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.180+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9c0a9370 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.185 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.181+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fdd9801b070 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.181+0000 7fdd8e7fc640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 0x7fdd8003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.181+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 3361+0+0 (secure 0 0 0) 0x7fdd9804a540 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.181+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd9c09d6c0 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.181+0000 7fdda1158640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 0x7fdd8003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:06.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.182+0000 7fdda1158640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 0x7fdd8003a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd90034000 tx=0x7fdd9002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:06.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.186+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd9801c9b0 con 0x7fdd9c06ccc0 2024-09-15T23:57:06.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:06.367+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fdd9c06bde0 con 0x7fdd9c06ccc0 2024-09-15T23:57:07.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.210+0000 7fdd8e7fc640 1 -- 172.21.15.121:0/3889779914 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7fdd9801cc10 con 0x7fdd9c06ccc0 2024-09-15T23:57:07.211 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 msgr2=0x7fdd8003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 0x7fdd8003a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd90034000 tx=0x7fdd9002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 msgr2=0x7fdd9c121c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c420 tx=0x7fdd9800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 shutdown_connections 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fdd800382a0 0x7fdd8003a760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 --2- 172.21.15.121:0/3889779914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd9c06ccc0 0x7fdd9c121c40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 >> 172.21.15.121:0/3889779914 conn(0x7fdd9c071aa0 msgr2=0x7fdd9c13a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 shutdown_connections 2024-09-15T23:57:07.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.213+0000 7fdda3bbd640 1 -- 172.21.15.121:0/3889779914 wait complete. 2024-09-15T23:57:07.227 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:57:07.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.327+0000 7f0664ffd640 1 Processor -- start 2024-09-15T23:57:07.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.327+0000 7f0664ffd640 1 -- start start 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f0664ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0660135f30 0x7f066013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f0664ffd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06600a08c0 con 0x7f0660135b50 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f0664ffd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f066009b310 con 0x7f0660135f30 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f065e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0660135b50 0x7f066009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51340/0 (socket says 172.21.15.121:51340) 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f065e59c640 1 -- 172.21.15.121:0/2050643635 learned_addr learned my addr 172.21.15.121:0/2050643635 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:07.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f065dd9b640 1 --2- 172.21.15.121:0/2050643635 >> v2:172.21.15.121:3300/0 conn(0x7f0660135f30 0x7f066013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f065d59a640 1 -- 172.21.15.121:0/2050643635 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584521643 0 0) 0x7f06600a08c0 con 0x7f0660135b50 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.328+0000 7f065d59a640 1 -- 172.21.15.121:0/2050643635 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f064c003520 con 0x7f0660135b50 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065dd9b640 1 -- 172.21.15.121:0/2050643635 >> v1:172.21.15.121:6789/0 conn(0x7f0660135b50 legacy=0x7f066009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065dd9b640 1 -- 172.21.15.121:0/2050643635 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06600a2270 con 0x7f0660135f30 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065dd9b640 1 --2- 172.21.15.121:0/2050643635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135f30 0x7f066013bb80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0648009720 tx=0x7f064802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb61094451ce8f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065d59a640 1 -- 172.21.15.121:0/2050643635 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648037070 con 0x7f0660135f30 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065d59a640 1 -- 172.21.15.121:0/2050643635 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064802ae20 con 0x7f0660135f30 2024-09-15T23:57:07.331 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.329+0000 7f065d59a640 1 -- 172.21.15.121:0/2050643635 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0648032570 con 0x7f0660135f30 2024-09-15T23:57:07.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 -- 172.21.15.121:0/2050643635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135f30 msgr2=0x7f066013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 --2- 172.21.15.121:0/2050643635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135f30 0x7f066013bb80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0648009720 tx=0x7f064802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.333 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 -- 172.21.15.121:0/2050643635 shutdown_connections 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 --2- 172.21.15.121:0/2050643635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135f30 0x7f066013bb80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 -- 172.21.15.121:0/2050643635 >> 172.21.15.121:0/2050643635 conn(0x7f06600a85e0 msgr2=0x7f06600a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 -- 172.21.15.121:0/2050643635 shutdown_connections 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.330+0000 7f0664ffd640 1 -- 172.21.15.121:0/2050643635 wait complete. 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.331+0000 7f0664ffd640 1 Processor -- start 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.331+0000 7f0664ffd640 1 -- start start 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0664ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0664ffd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0660136350 con 0x7f0660135b50 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f065e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f065e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44978/0 (socket says 172.21.15.121:44978) 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f065e59c640 1 -- 172.21.15.121:0/568123575 learned_addr learned my addr 172.21.15.121:0/568123575 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f065e59c640 1 -- 172.21.15.121:0/568123575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06601266e0 con 0x7f0660135b50 2024-09-15T23:57:07.334 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f065e59c640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f065000c3b0 tx=0x7f065000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0650017070 con 0x7f0660135b50 2024-09-15T23:57:07.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0650005c10 con 0x7f0660135b50 2024-09-15T23:57:07.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06500070d0 con 0x7f0660135b50 2024-09-15T23:57:07.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0660125a60 con 0x7f0660135b50 2024-09-15T23:57:07.335 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.332+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06600a2d20 con 0x7f0660135b50 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.333+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f065001a070 con 0x7f0660135b50 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.333+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066011fc70 con 0x7f0660135b50 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.333+0000 7f0656ffd640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 0x7f064003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.333+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 2587+0+0 (secure 0 0 0) 0x7f065004a2e0 con 0x7f0660135b50 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.333+0000 7f065dd9b640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 0x7f064003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.336 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.334+0000 7f065dd9b640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 0x7f064003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0648034000 tx=0x7f064802e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.338+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0650019e10 con 0x7f0660135b50 2024-09-15T23:57:07.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.564+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f066009aae0 con 0x7f0660135b50 2024-09-15T23:57:07.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.565+0000 7f0656ffd640 1 -- 172.21.15.121:0/568123575 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+2534 (secure 0 0 0) 0x7f0650010b90 con 0x7f0660135b50 2024-09-15T23:57:07.566 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmrl0yDhAAmges61AkNVATl3fkDcJtCA==", 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.567 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.568 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dm1c5EFRAAQjii6dloQtB9r6b+oDUlfA==", 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:07.569 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:07.570 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.570 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.570 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.570 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC+c+dmWS98OBAABYXXLJEiQ32Ch8sOdjmGMQ==", 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:07.571 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.572 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.572 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.572 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.572 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-15T23:57:07.572 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDCc+dmae/mKxAAb1MVakHG7AWyXTfjXcC5Ww==", 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.574 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.574 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-15T23:57:07.574 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDGc+dm0fWaLRAAVx8jT36dFL/hVkUBD+L4uA==", 2024-09-15T23:57:07.574 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.574 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:07.575 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:07.575 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg==", 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-15T23:57:07.576 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmOA9CIRAA3IDTN3uPbSBxbM2AFlMv4w==", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC7c+dm1qMxNRAAha+qdHw6Albq/4FeBkKFmw==", 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmGfgJCxAAO99Xwfzdn6pwAplxw70kOQ==", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.579 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:57:07.579 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:07.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 msgr2=0x7f064003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 0x7f064003a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0648034000 tx=0x7f064802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:07.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 msgr2=0x7f06601ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f065000c3b0 tx=0x7f065000c870 comp rx=0 tx=0).stop 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 shutdown_connections 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f06400382a0 0x7f064003a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 --2- 172.21.15.121:0/568123575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0660135b50 0x7f06601ce990 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 >> 172.21.15.121:0/568123575 conn(0x7f06600a85e0 msgr2=0x7f06600a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 shutdown_connections 2024-09-15T23:57:07.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.567+0000 7f0664ffd640 1 -- 172.21.15.121:0/568123575 wait complete. 2024-09-15T23:57:07.581 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.686+0000 7fee4cdbd640 1 Processor -- start 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.686+0000 7fee4cdbd640 1 -- start start 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.686+0000 7fee4cdbd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee48133640 0x7fee4813b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.686+0000 7fee4cdbd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee480a16c0 con 0x7fee480a39c0 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.686+0000 7fee4cdbd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fee480a1490 con 0x7fee48133640 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee3ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fee48133640 0x7fee4813b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee4659c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fee480a39c0 0x7fee48132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51344/0 (socket says 172.21.15.121:51344) 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee4659c640 1 -- 172.21.15.121:0/543802395 learned_addr learned my addr 172.21.15.121:0/543802395 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee3ffff640 1 -- 172.21.15.121:0/543802395 >> v1:172.21.15.121:6789/0 conn(0x7fee480a39c0 legacy=0x7fee48132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.688 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee3ffff640 1 -- 172.21.15.121:0/543802395 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480a4010 con 0x7fee48133640 2024-09-15T23:57:07.689 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.687+0000 7fee45d9b640 1 -- 172.21.15.121:0/543802395 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464050133 0 0) 0x7fee480a16c0 con 0x7fee480a39c0 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee3ffff640 1 --2- 172.21.15.121:0/543802395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee48133640 0x7fee4813b270 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fee30009720 tx=0x7fee3002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9baf21f49f029b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee45d9b640 1 -- 172.21.15.121:0/543802395 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee30037070 con 0x7fee48133640 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee45d9b640 1 -- 172.21.15.121:0/543802395 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee3002ad90 con 0x7fee48133640 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee45d9b640 1 -- 172.21.15.121:0/543802395 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee30032590 con 0x7fee48133640 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 -- 172.21.15.121:0/543802395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee48133640 msgr2=0x7fee4813b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/543802395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee48133640 0x7fee4813b270 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fee30009720 tx=0x7fee3002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 -- 172.21.15.121:0/543802395 shutdown_connections 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/543802395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee48133640 0x7fee4813b270 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 -- 172.21.15.121:0/543802395 >> 172.21.15.121:0/543802395 conn(0x7fee480a85e0 msgr2=0x7fee480a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.690 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 -- 172.21.15.121:0/543802395 shutdown_connections 2024-09-15T23:57:07.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.688+0000 7fee4cdbd640 1 -- 172.21.15.121:0/543802395 wait complete. 2024-09-15T23:57:07.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.689+0000 7fee4cdbd640 1 Processor -- start 2024-09-15T23:57:07.691 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.689+0000 7fee4cdbd640 1 -- start start 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4cdbd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4cdbd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee481329c0 con 0x7fee480a39c0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44988/0 (socket says 172.21.15.121:44988) 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4659c640 1 -- 172.21.15.121:0/753280989 learned_addr learned my addr 172.21.15.121:0/753280989 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4659c640 1 -- 172.21.15.121:0/753280989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4809e4d0 con 0x7fee480a39c0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4659c640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c370 tx=0x7fee3800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee38007410 con 0x7fee480a39c0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee380075d0 con 0x7fee480a39c0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee48073720 con 0x7fee480a39c0 2024-09-15T23:57:07.693 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee38004950 con 0x7fee480a39c0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.690+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee48072fd0 con 0x7fee480a39c0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.691+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fee38011070 con 0x7fee480a39c0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.691+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee480a2340 con 0x7fee480a39c0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.692+0000 7fee3effd640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 0x7fee2803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.692+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 2587+0+0 (secure 0 0 0) 0x7fee3804aa60 con 0x7fee480a39c0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.692+0000 7fee3ffff640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 0x7fee2803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.694 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.692+0000 7fee3ffff640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 0x7fee2803a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fee30034000 tx=0x7fee3002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.697 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.696+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee3801cbd0 con 0x7fee480a39c0 2024-09-15T23:57:07.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.863+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fee4809ca10 con 0x7fee480a39c0 2024-09-15T23:57:07.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.863+0000 7fee3effd640 1 -- 172.21.15.121:0/753280989 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7fee38004d80 con 0x7fee480a39c0 2024-09-15T23:57:07.864 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:07.865 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:57:07.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 msgr2=0x7fee2803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 0x7fee2803a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fee30034000 tx=0x7fee3002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 msgr2=0x7fee4809c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fee3800c370 tx=0x7fee3800c830 comp rx=0 tx=0).stop 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 shutdown_connections 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fee280382a0 0x7fee2803a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 --2- 172.21.15.121:0/753280989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee480a39c0 0x7fee4809c370 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 >> 172.21.15.121:0/753280989 conn(0x7fee480a85e0 msgr2=0x7fee480a6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 shutdown_connections 2024-09-15T23:57:07.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.865+0000 7fee4cdbd640 1 -- 172.21.15.121:0/753280989 wait complete. 2024-09-15T23:57:07.876 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:57:07.877 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.981+0000 7fb756db0640 1 Processor -- start 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.981+0000 7fb756db0640 1 -- start start 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb756db0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7500a7140 0x7fb7500a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb756db0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7500a6d10 con 0x7fb7500a4ab0 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb756db0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb75006e230 con 0x7fb7500a7140 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb754b4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7500a7140 0x7fb7500a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.983 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb74ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb7500a4ab0 0x7fb750139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51360/0 (socket says 172.21.15.121:51360) 2024-09-15T23:57:07.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb754b4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7500a7140 0x7fb7500a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44990/0 (socket says 172.21.15.121:44990) 2024-09-15T23:57:07.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb74ffff640 1 -- 172.21.15.121:0/1534522047 learned_addr learned my addr 172.21.15.121:0/1534522047 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:07.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb754b4c640 1 -- 172.21.15.121:0/1534522047 >> v1:172.21.15.121:6789/0 conn(0x7fb7500a4ab0 legacy=0x7fb750139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.982+0000 7fb754b4c640 1 -- 172.21.15.121:0/1534522047 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7500a3ae0 con 0x7fb7500a7140 2024-09-15T23:57:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.983+0000 7fb754b4c640 1 --2- 172.21.15.121:0/1534522047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a7140 0x7fb7500a7520 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb740009720 tx=0x7fb74002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be28a6a145079f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.983+0000 7fb74f7fe640 1 -- 172.21.15.121:0/1534522047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740037070 con 0x7fb7500a7140 2024-09-15T23:57:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.983+0000 7fb74f7fe640 1 -- 172.21.15.121:0/1534522047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74002ad90 con 0x7fb7500a7140 2024-09-15T23:57:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.983+0000 7fb74f7fe640 1 -- 172.21.15.121:0/1534522047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740032590 con 0x7fb7500a7140 2024-09-15T23:57:07.985 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 -- 172.21.15.121:0/1534522047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a7140 msgr2=0x7fb7500a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 --2- 172.21.15.121:0/1534522047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a7140 0x7fb7500a7520 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb740009720 tx=0x7fb74002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 -- 172.21.15.121:0/1534522047 shutdown_connections 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 --2- 172.21.15.121:0/1534522047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a7140 0x7fb7500a7520 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 -- 172.21.15.121:0/1534522047 >> 172.21.15.121:0/1534522047 conn(0x7fb7500ac370 msgr2=0x7fb7500ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 -- 172.21.15.121:0/1534522047 shutdown_connections 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.984+0000 7fb756db0640 1 -- 172.21.15.121:0/1534522047 wait complete. 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb756db0640 1 Processor -- start 2024-09-15T23:57:07.986 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb756db0640 1 -- start start 2024-09-15T23:57:07.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb756db0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb756db0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7500a7fc0 con 0x7fb7500a4ab0 2024-09-15T23:57:07.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb754b4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb754b4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45002/0 (socket says 172.21.15.121:45002) 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.985+0000 7fb754b4c640 1 -- 172.21.15.121:0/488780772 learned_addr learned my addr 172.21.15.121:0/488780772 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb754b4c640 1 -- 172.21.15.121:0/488780772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb750124fa0 con 0x7fb7500a4ab0 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb754b4c640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb740009720 tx=0x7fb7400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740041070 con 0x7fb7500a4ab0 2024-09-15T23:57:07.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74003c460 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb750122b50 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740037040 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.986+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb750123430 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.987+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fb740044070 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.987+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7500008d0 con 0x7fb7500a4ab0 2024-09-15T23:57:07.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.987+0000 7fb74d7fa640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 0x7fb73c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.987+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 2587+0+0 (secure 0 0 0) 0x7fb74006b950 con 0x7fb7500a4ab0 2024-09-15T23:57:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.987+0000 7fb74ffff640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 0x7fb73c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.988+0000 7fb74ffff640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 0x7fb73c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb744007fd0 tx=0x7fb744007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:07.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:07.992+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb74003bdd0 con 0x7fb7500a4ab0 2024-09-15T23:57:08.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.159+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb750122870 con 0x7fb7500a4ab0 2024-09-15T23:57:08.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.224+0000 7fb74d7fa640 1 -- 172.21.15.121:0/488780772 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fb74003a520 con 0x7fb7500a4ab0 2024-09-15T23:57:08.225 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-15T23:57:08.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 msgr2=0x7fb73c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 0x7fb73c03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb744007fd0 tx=0x7fb744007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 msgr2=0x7fb7500a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb740009720 tx=0x7fb7400046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 shutdown_connections 2024-09-15T23:57:08.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb73c0382a0 0x7fb73c03a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 --2- 172.21.15.121:0/488780772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7500a4ab0 0x7fb7500a0f80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.226+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 >> 172.21.15.121:0/488780772 conn(0x7fb7500ac370 msgr2=0x7fb7501395a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:08.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.227+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 shutdown_connections 2024-09-15T23:57:08.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.227+0000 7fb756db0640 1 -- 172.21.15.121:0/488780772 wait complete. 2024-09-15T23:57:08.242 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:57:08.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f6887a42640 1 Processor -- start 2024-09-15T23:57:08.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f6887a42640 1 -- start start 2024-09-15T23:57:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f6887a42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68800a37b0 0x7f688009acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.348 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f6887a42640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688009b200 con 0x7f68800a3b90 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f6887a42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f688009b4f0 con 0x7f68800a37b0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.346+0000 7f68857de640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68800a37b0 0x7f688009acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f6884fdd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f68800a3b90 0x7f68800a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51366/0 (socket says 172.21.15.121:51366) 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f6884fdd640 1 -- 172.21.15.121:0/3043848077 learned_addr learned my addr 172.21.15.121:0/3043848077 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f68857de640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68800a37b0 0x7f688009acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45014/0 (socket says 172.21.15.121:45014) 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f68857de640 1 -- 172.21.15.121:0/3043848077 >> v1:172.21.15.121:6789/0 conn(0x7f68800a3b90 legacy=0x7f68800a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f68857de640 1 -- 172.21.15.121:0/3043848077 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800a1c90 con 0x7f68800a37b0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.347+0000 7f68857de640 1 --2- 172.21.15.121:0/3043848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f688009acc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f687c009720 tx=0x7f687c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37feb514064a5084 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6877fff640 1 -- 172.21.15.121:0/3043848077 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c037070 con 0x7f68800a37b0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6877fff640 1 -- 172.21.15.121:0/3043848077 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c02ad90 con 0x7f68800a37b0 2024-09-15T23:57:08.349 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6877fff640 1 -- 172.21.15.121:0/3043848077 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c032590 con 0x7f68800a37b0 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 -- 172.21.15.121:0/3043848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 msgr2=0x7f688009acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 --2- 172.21.15.121:0/3043848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f688009acc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f687c009720 tx=0x7f687c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 -- 172.21.15.121:0/3043848077 shutdown_connections 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 --2- 172.21.15.121:0/3043848077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f688009acc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 -- 172.21.15.121:0/3043848077 >> 172.21.15.121:0/3043848077 conn(0x7f68800a8430 msgr2=0x7f68800a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 -- 172.21.15.121:0/3043848077 shutdown_connections 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.348+0000 7f6887a42640 1 -- 172.21.15.121:0/3043848077 wait complete. 2024-09-15T23:57:08.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.349+0000 7f6887a42640 1 Processor -- start 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.349+0000 7f6887a42640 1 -- start start 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6887a42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6887a42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68800a5220 con 0x7f68800a37b0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f68857de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f68857de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45026/0 (socket says 172.21.15.121:45026) 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f68857de640 1 -- 172.21.15.121:0/4105765443 learned_addr learned my addr 172.21.15.121:0/4105765443 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f68857de640 1 -- 172.21.15.121:0/4105765443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688013dac0 con 0x7f68800a37b0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f68857de640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f687c02ad60 tx=0x7f687c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c041070 con 0x7f68800a37b0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c03c460 con 0x7f68800a37b0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688013c200 con 0x7f68800a37b0 2024-09-15T23:57:08.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.350+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f687c037040 con 0x7f68800a37b0 2024-09-15T23:57:08.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.351+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688013b120 con 0x7f68800a37b0 2024-09-15T23:57:08.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f687c044070 con 0x7f68800a37b0 2024-09-15T23:57:08.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688009acc0 con 0x7f68800a37b0 2024-09-15T23:57:08.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6875ffb640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 0x7f686403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:08.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 2957+0+0 (secure 0 0 0) 0x7f687c06ba40 con 0x7f68800a37b0 2024-09-15T23:57:08.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6884fdd640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 0x7f686403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:08.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.352+0000 7f6884fdd640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 0x7f686403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6870005880 tx=0x7f6870007a80 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:08.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.357+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f687c03cca0 con 0x7f68800a37b0 2024-09-15T23:57:08.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:08.524+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6880136a80 con 0x7f68800a37b0 2024-09-15T23:57:09.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.225+0000 7f6875ffb640 1 -- 172.21.15.121:0/4105765443 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f687c03c780 con 0x7f68800a37b0 2024-09-15T23:57:09.227 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-15T23:57:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 msgr2=0x7f686403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 0x7f686403a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6870005880 tx=0x7f6870007a80 comp rx=0 tx=0).stop 2024-09-15T23:57:09.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 msgr2=0x7f6880072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f687c02ad60 tx=0x7f687c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 shutdown_connections 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f68640382a0 0x7f686403a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 --2- 172.21.15.121:0/4105765443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68800a37b0 0x7f6880072b10 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 >> 172.21.15.121:0/4105765443 conn(0x7f68800a8430 msgr2=0x7f68800a64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:09.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 shutdown_connections 2024-09-15T23:57:09.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.229+0000 7f6887a42640 1 -- 172.21.15.121:0/4105765443 wait complete. 2024-09-15T23:57:09.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:57:09.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.360+0000 7f4693e82640 1 Processor -- start 2024-09-15T23:57:09.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.360+0000 7f4693e82640 1 -- start start 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.360+0000 7f4693e82640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f468c0a37b0 0x7f468c09acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.360+0000 7f4693e82640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468c09b200 con 0x7f468c0a3b90 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.360+0000 7f4693e82640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f468c09b4f0 con 0x7f468c0a37b0 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.361+0000 7f4691c1e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f468c0a37b0 0x7f468c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.361+0000 7f469141d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f468c0a3b90 0x7f468c0a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51374/0 (socket says 172.21.15.121:51374) 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.361+0000 7f469141d640 1 -- 172.21.15.121:0/3108656569 learned_addr learned my addr 172.21.15.121:0/3108656569 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.361+0000 7f4691c1e640 1 -- 172.21.15.121:0/3108656569 >> v1:172.21.15.121:6789/0 conn(0x7f468c0a3b90 legacy=0x7f468c0a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:09.362 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.361+0000 7f4691c1e640 1 -- 172.21.15.121:0/3108656569 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c0a1c90 con 0x7f468c0a37b0 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4691c1e640 1 --2- 172.21.15.121:0/3108656569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c09acc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4688009720 tx=0x7f468802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0abbf7b94dc04c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4690c1c640 1 -- 172.21.15.121:0/3108656569 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4688037070 con 0x7f468c0a37b0 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4690c1c640 1 -- 172.21.15.121:0/3108656569 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468802ad90 con 0x7f468c0a37b0 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4690c1c640 1 -- 172.21.15.121:0/3108656569 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4688032590 con 0x7f468c0a37b0 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 -- 172.21.15.121:0/3108656569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 msgr2=0x7f468c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:09.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 --2- 172.21.15.121:0/3108656569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c09acc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4688009720 tx=0x7f468802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 -- 172.21.15.121:0/3108656569 shutdown_connections 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 --2- 172.21.15.121:0/3108656569 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c09acc0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 -- 172.21.15.121:0/3108656569 >> 172.21.15.121:0/3108656569 conn(0x7f468c0a8430 msgr2=0x7f468c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 -- 172.21.15.121:0/3108656569 shutdown_connections 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.362+0000 7f4693e82640 1 -- 172.21.15.121:0/3108656569 wait complete. 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.363+0000 7f4693e82640 1 Processor -- start 2024-09-15T23:57:09.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.363+0000 7f4693e82640 1 -- start start 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4693e82640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4693e82640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0a5220 con 0x7f468c0a37b0 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4691c1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4691c1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45040/0 (socket says 172.21.15.121:45040) 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4691c1e640 1 -- 172.21.15.121:0/2365008703 learned_addr learned my addr 172.21.15.121:0/2365008703 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4691c1e640 1 -- 172.21.15.121:0/2365008703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c071b70 con 0x7f468c0a37b0 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4691c1e640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4688009840 tx=0x7f46880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4688041070 con 0x7f468c0a37b0 2024-09-15T23:57:09.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468803c460 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c070eb0 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4688037040 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.364+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c1363a0 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.365+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f4688044070 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.365+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c135c60 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.366+0000 7f46827fc640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 0x7f467003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.366+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 3339+0+0 (secure 0 0 0) 0x7f468806ba30 con 0x7f468c0a37b0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.366+0000 7f469141d640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 0x7f467003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:09.368 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.366+0000 7f469141d640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 0x7f467003a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f467c005880 tx=0x7f467c007a80 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:09.371 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.370+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f468803a360 con 0x7f468c0a37b0 2024-09-15T23:57:09.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:09.569+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f468c09acc0 con 0x7f468c0a37b0 2024-09-15T23:57:10.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.235+0000 7f46827fc640 1 -- 172.21.15.121:0/2365008703 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v28) ==== 174+0+0 (secure 0 0 0) 0x7f468803c760 con 0x7f468c0a37b0 2024-09-15T23:57:10.236 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 10 and data pool 11 2024-09-15T23:57:10.246 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.243+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 msgr2=0x7f467003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.243+0000 7f4693e82640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 0x7f467003a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f467c005880 tx=0x7f467c007a80 comp rx=0 tx=0).stop 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.243+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 msgr2=0x7f468c072060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.243+0000 7f4693e82640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4688009840 tx=0x7f46880046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.245+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 shutdown_connections 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.245+0000 7f4693e82640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f46700382d0 0x7f467003a790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.245+0000 7f4693e82640 1 --2- 172.21.15.121:0/2365008703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c0a37b0 0x7f468c072060 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.245+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 >> 172.21.15.121:0/2365008703 conn(0x7f468c0a8430 msgr2=0x7f468c0a7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.247+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 shutdown_connections 2024-09-15T23:57:10.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.248+0000 7f4693e82640 1 -- 172.21.15.121:0/2365008703 wait complete. 2024-09-15T23:57:10.273 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:10.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.372+0000 7f54759e4640 1 Processor -- start 2024-09-15T23:57:10.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.372+0000 7f54759e4640 1 -- start start 2024-09-15T23:57:10.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.372+0000 7f54759e4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f547013a280 0x7f547013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.372+0000 7f54759e4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547013a080 con 0x7f54700a4c20 2024-09-15T23:57:10.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.372+0000 7f54759e4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f54700a3d50 con 0x7f547013a280 2024-09-15T23:57:10.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f547013a280 0x7f547013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546e7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f54700a4c20 0x7f54700a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51376/0 (socket says 172.21.15.121:51376) 2024-09-15T23:57:10.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546e7fc640 1 -- 172.21.15.121:0/2558071621 learned_addr learned my addr 172.21.15.121:0/2558071621 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:10.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546effd640 1 -- 172.21.15.121:0/2558071621 >> v1:172.21.15.121:6789/0 conn(0x7f54700a4c20 legacy=0x7f54700a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546effd640 1 -- 172.21.15.121:0/2558071621 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54700a3f80 con 0x7f547013a280 2024-09-15T23:57:10.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.373+0000 7f546effd640 1 --2- 172.21.15.121:0/2558071621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f547013a280 0x7f547013a660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5468009d90 tx=0x7f546802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb878d669290f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f546dffb640 1 -- 172.21.15.121:0/2558071621 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468007670 con 0x7f547013a280 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f546dffb640 1 -- 172.21.15.121:0/2558071621 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5468007810 con 0x7f547013a280 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f546dffb640 1 -- 172.21.15.121:0/2558071621 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468007b10 con 0x7f547013a280 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 -- 172.21.15.121:0/2558071621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f547013a280 msgr2=0x7f547013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 --2- 172.21.15.121:0/2558071621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f547013a280 0x7f547013a660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5468009d90 tx=0x7f546802a660 comp rx=0 tx=0).stop 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 -- 172.21.15.121:0/2558071621 shutdown_connections 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 --2- 172.21.15.121:0/2558071621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f547013a280 0x7f547013a660 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 -- 172.21.15.121:0/2558071621 >> 172.21.15.121:0/2558071621 conn(0x7f54700ac3e0 msgr2=0x7f54700ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 -- 172.21.15.121:0/2558071621 shutdown_connections 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.374+0000 7f54759e4640 1 -- 172.21.15.121:0/2558071621 wait complete. 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.375+0000 7f54759e4640 1 Processor -- start 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.375+0000 7f54759e4640 1 -- start start 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f54759e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f54759e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5470139d40 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f546effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f546effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45058/0 (socket says 172.21.15.121:45058) 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f546effd640 1 -- 172.21.15.121:0/2350289149 learned_addr learned my addr 172.21.15.121:0/2350289149 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f546effd640 1 -- 172.21.15.121:0/2350289149 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5470125a30 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f546effd640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5468009d90 tx=0x7f5468004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468040070 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5468031a90 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5470123a80 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5468031d70 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.376+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54700a21c0 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.377+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f5468039040 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.377+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547006dab0 con 0x7f54700a4c20 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.377+0000 7f5467fff640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 0x7f545003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.380 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.377+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 3439+0+0 (secure 0 0 0) 0x7f546802ae00 con 0x7f54700a4c20 2024-09-15T23:57:10.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.377+0000 7f546e7fc640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 0x7f545003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.378+0000 7f546e7fc640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 0x7f545003a790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.383 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.382+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f546803a3b0 con 0x7f54700a4c20 2024-09-15T23:57:10.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.547+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54700a2f50 con 0x7f54700a4c20 2024-09-15T23:57:10.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.548+0000 7f5467fff640 1 -- 172.21.15.121:0/2350289149 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+10691 (secure 0 0 0) 0x7f546803bb00 con 0x7f54700a4c20 2024-09-15T23:57:10.549 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:10.550 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":56,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:09.570555+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:08.177705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:08.542745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:10.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 msgr2=0x7f545003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 0x7f545003a790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5458007fd0 tx=0x7f5458007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 msgr2=0x7f5470125450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5468009d90 tx=0x7f5468004a40 comp rx=0 tx=0).stop 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 shutdown_connections 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f54500382d0 0x7f545003a790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 --2- 172.21.15.121:0/2350289149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54700a4c20 0x7f5470125450 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 >> 172.21.15.121:0/2350289149 conn(0x7f54700ac3e0 msgr2=0x7f54700ab010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 shutdown_connections 2024-09-15T23:57:10.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.550+0000 7f54759e4640 1 -- 172.21.15.121:0/2350289149 wait complete. 2024-09-15T23:57:10.563 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.660+0000 7f7764f8d640 1 Processor -- start 2024-09-15T23:57:10.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.660+0000 7f7764f8d640 1 -- start start 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f7764f8d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77600a1c80 0x7f776013a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f7764f8d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776009f2f0 con 0x7f776013a220 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f7764f8d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f77600a07d0 con 0x7f77600a1c80 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775dd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f77600a1c80 0x7f776013a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775e59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f776013a220 0x7f7760136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51390/0 (socket says 172.21.15.121:51390) 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775e59c640 1 -- 172.21.15.121:0/192649636 learned_addr learned my addr 172.21.15.121:0/192649636 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775dd9b640 1 -- 172.21.15.121:0/192649636 >> v1:172.21.15.121:6789/0 conn(0x7f776013a220 legacy=0x7f7760136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775d59a640 1 -- 172.21.15.121:0/192649636 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168237533 0 0) 0x7f7750001110 con 0x7f776013a220 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.661+0000 7f775dd9b640 1 -- 172.21.15.121:0/192649636 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7760139dd0 con 0x7f77600a1c80 2024-09-15T23:57:10.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.662+0000 7f775dd9b640 1 --2- 172.21.15.121:0/192649636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f776013a600 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7754009720 tx=0x7f775402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bcb309fa2c40f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.662+0000 7f775d59a640 1 -- 172.21.15.121:0/192649636 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754037070 con 0x7f77600a1c80 2024-09-15T23:57:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.662+0000 7f775d59a640 1 -- 172.21.15.121:0/192649636 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775402ad90 con 0x7f77600a1c80 2024-09-15T23:57:10.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.662+0000 7f775d59a640 1 -- 172.21.15.121:0/192649636 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7754032590 con 0x7f77600a1c80 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 -- 172.21.15.121:0/192649636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 msgr2=0x7f776013a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 --2- 172.21.15.121:0/192649636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f776013a600 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7754009720 tx=0x7f775402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 -- 172.21.15.121:0/192649636 shutdown_connections 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 --2- 172.21.15.121:0/192649636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f776013a600 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 -- 172.21.15.121:0/192649636 >> 172.21.15.121:0/192649636 conn(0x7f776006d820 msgr2=0x7f776006dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 -- 172.21.15.121:0/192649636 shutdown_connections 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.663+0000 7f7764f8d640 1 -- 172.21.15.121:0/192649636 wait complete. 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f7764f8d640 1 Processor -- start 2024-09-15T23:57:10.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f7764f8d640 1 -- start start 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f7764f8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f7764f8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7760139a20 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f775e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f775e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45090/0 (socket says 172.21.15.121:45090) 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.664+0000 7f775e59c640 1 -- 172.21.15.121:0/3703298297 learned_addr learned my addr 172.21.15.121:0/3703298297 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f775e59c640 1 -- 172.21.15.121:0/3703298297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77600a98e0 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f775e59c640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f775000c700 tx=0x7f775000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750018070 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77500070d0 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77600aa240 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77500073f0 con 0x7f77600a1c80 2024-09-15T23:57:10.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.665+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77600a85f0 con 0x7f77600a1c80 2024-09-15T23:57:10.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f775001b070 con 0x7f77600a1c80 2024-09-15T23:57:10.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f774effd640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 0x7f774003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.668 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 3439+0+0 (secure 0 0 0) 0x7f775004a590 con 0x7f77600a1c80 2024-09-15T23:57:10.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f775dd9b640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 0x7f774003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77600a0100 con 0x7f77600a1c80 2024-09-15T23:57:10.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.666+0000 7f775dd9b640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 0x7f774003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77600a20c0 tx=0x7f775402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.671 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.671+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f776009f2f0 con 0x7f77600a1c80 2024-09-15T23:57:10.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.837+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77600a1200 con 0x7f77600a1c80 2024-09-15T23:57:10.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.838+0000 7f774effd640 1 -- 172.21.15.121:0/3703298297 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+10691 (secure 0 0 0) 0x7f77500047e0 con 0x7f77600a1c80 2024-09-15T23:57:10.839 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:10.839 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":56,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:09.570555+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:08.177705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:08.542745+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:10.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 msgr2=0x7f774003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 0x7f774003a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f77600a20c0 tx=0x7f775402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 msgr2=0x7f77600a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f775000c700 tx=0x7f775000cbc0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 shutdown_connections 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f77400382a0 0x7f774003a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 --2- 172.21.15.121:0/3703298297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77600a1c80 0x7f77600a5f50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 >> 172.21.15.121:0/3703298297 conn(0x7f776006d820 msgr2=0x7f7760136260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 shutdown_connections 2024-09-15T23:57:10.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.840+0000 7f7764f8d640 1 -- 172.21.15.121:0/3703298297 wait complete. 2024-09-15T23:57:10.852 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.953+0000 7fc2a92e6640 1 Processor -- start 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.953+0000 7fc2a92e6640 1 -- start start 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a92e6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc2a40a7310 0x7fc2a413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a92e6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a406e410 con 0x7fc2a406dab0 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a92e6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a406de90 con 0x7fc2a40a7310 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc2a40a7310 0x7fc2a413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a2ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc2a406dab0 0x7fc2a40a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51402/0 (socket says 172.21.15.121:51402) 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a2ffd640 1 -- 172.21.15.121:0/1308312758 learned_addr learned my addr 172.21.15.121:0/1308312758 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a27fc640 1 -- 172.21.15.121:0/1308312758 >> v1:172.21.15.121:6789/0 conn(0x7fc2a406dab0 legacy=0x7fc2a40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a27fc640 1 -- 172.21.15.121:0/1308312758 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a40a8140 con 0x7fc2a40a7310 2024-09-15T23:57:10.955 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.954+0000 7fc2a1ffb640 1 -- 172.21.15.121:0/1308312758 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951739703 0 0) 0x7fc2a406e410 con 0x7fc2a406dab0 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a27fc640 1 --2- 172.21.15.121:0/1308312758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a40a7310 0x7fc2a413f2e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc298009720 tx=0x7fc29802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23c1a3ce6cf1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a1ffb640 1 -- 172.21.15.121:0/1308312758 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc298037070 con 0x7fc2a40a7310 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a1ffb640 1 -- 172.21.15.121:0/1308312758 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29802ad90 con 0x7fc2a40a7310 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a1ffb640 1 -- 172.21.15.121:0/1308312758 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc298032590 con 0x7fc2a40a7310 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 -- 172.21.15.121:0/1308312758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a40a7310 msgr2=0x7fc2a413f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/1308312758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a40a7310 0x7fc2a413f2e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc298009720 tx=0x7fc29802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:10.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 -- 172.21.15.121:0/1308312758 shutdown_connections 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/1308312758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a40a7310 0x7fc2a413f2e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 -- 172.21.15.121:0/1308312758 >> 172.21.15.121:0/1308312758 conn(0x7fc2a40ac620 msgr2=0x7fc2a40aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 -- 172.21.15.121:0/1308312758 shutdown_connections 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.955+0000 7fc2a92e6640 1 -- 172.21.15.121:0/1308312758 wait complete. 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.956+0000 7fc2a92e6640 1 Processor -- start 2024-09-15T23:57:10.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.956+0000 7fc2a92e6640 1 -- start start 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a92e6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a92e6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40a3c70 con 0x7fc2a406dab0 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45100/0 (socket says 172.21.15.121:45100) 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a2ffd640 1 -- 172.21.15.121:0/2614761804 learned_addr learned my addr 172.21.15.121:0/2614761804 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a2ffd640 1 -- 172.21.15.121:0/2614761804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a409fcc0 con 0x7fc2a406dab0 2024-09-15T23:57:10.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc2a2ffd640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c370 tx=0x7fc29400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.957+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc294007410 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2940075d0 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a409fa50 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc294004950 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a40a2a40 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fc294011070 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.958+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a40a77b0 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.959+0000 7fc28b7fe640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 0x7fc29003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.959+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 3439+0+0 (secure 0 0 0) 0x7fc29404adb0 con 0x7fc2a406dab0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.959+0000 7fc2a27fc640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 0x7fc29003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:10.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.959+0000 7fc2a27fc640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 0x7fc29003a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc298034000 tx=0x7fc29802e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:10.964 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:10.963+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc29401cbd0 con 0x7fc2a406dab0 2024-09-15T23:57:11.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.163+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc2a40a3ee0 con 0x7fc2a406dab0 2024-09-15T23:57:11.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.233+0000 7fc28b7fe640 1 -- 172.21.15.121:0/2614761804 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7fc2940138e0 con 0x7fc2a406dab0 2024-09-15T23:57:11.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 msgr2=0x7fc29003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:11.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 0x7fc29003a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc298034000 tx=0x7fc29802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:11.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 msgr2=0x7fc2a40a2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:11.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc29400c370 tx=0x7fc29400c830 comp rx=0 tx=0).stop 2024-09-15T23:57:11.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 shutdown_connections 2024-09-15T23:57:11.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fc2900382a0 0x7fc29003a760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:11.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 --2- 172.21.15.121:0/2614761804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a406dab0 0x7fc2a40a2250 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:11.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 >> 172.21.15.121:0/2614761804 conn(0x7fc2a40ac620 msgr2=0x7fc2a40aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:11.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 shutdown_connections 2024-09-15T23:57:11.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.236+0000 7fc2a92e6640 1 -- 172.21.15.121:0/2614761804 wait complete. 2024-09-15T23:57:11.249 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:57:11.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.350+0000 7f75eac27640 1 Processor -- start 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.350+0000 7f75eac27640 1 -- start start 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75eac27640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f75e40a4ab0 0x7f75e413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75eac27640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e40a6d10 con 0x7f75e40a7140 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75eac27640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f75e406e230 con 0x7f75e40a4ab0 2024-09-15T23:57:11.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75e3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f75e40a4ab0 0x7f75e413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:11.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75e89c3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f75e40a7140 0x7f75e40a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:51414/0 (socket says 172.21.15.121:51414) 2024-09-15T23:57:11.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75e89c3640 1 -- 172.21.15.121:0/1689959251 learned_addr learned my addr 172.21.15.121:0/1689959251 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:11.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75e3fff640 1 -- 172.21.15.121:0/1689959251 >> v1:172.21.15.121:6789/0 conn(0x7f75e40a7140 legacy=0x7f75e40a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:11.353 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.351+0000 7f75e3fff640 1 -- 172.21.15.121:0/1689959251 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e40a3ae0 con 0x7f75e40a4ab0 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.352+0000 7f75e3fff640 1 --2- 172.21.15.121:0/1689959251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e413eef0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009720 tx=0x7f75d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9060063ddef5e78f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.352+0000 7f75e37fe640 1 -- 172.21.15.121:0/1689959251 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d8037070 con 0x7f75e40a4ab0 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.352+0000 7f75e37fe640 1 -- 172.21.15.121:0/1689959251 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d802ad90 con 0x7f75e40a4ab0 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.352+0000 7f75e37fe640 1 -- 172.21.15.121:0/1689959251 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d8032590 con 0x7f75e40a4ab0 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 -- 172.21.15.121:0/1689959251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 msgr2=0x7f75e413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 --2- 172.21.15.121:0/1689959251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e413eef0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009720 tx=0x7f75d802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 -- 172.21.15.121:0/1689959251 shutdown_connections 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 --2- 172.21.15.121:0/1689959251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e413eef0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:11.354 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 -- 172.21.15.121:0/1689959251 >> 172.21.15.121:0/1689959251 conn(0x7f75e40ac370 msgr2=0x7f75e40ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:11.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 -- 172.21.15.121:0/1689959251 shutdown_connections 2024-09-15T23:57:11.355 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.353+0000 7f75eac27640 1 -- 172.21.15.121:0/1689959251 wait complete. 2024-09-15T23:57:11.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75eac27640 1 Processor -- start 2024-09-15T23:57:11.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75eac27640 1 -- start start 2024-09-15T23:57:11.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75eac27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75eac27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f75e40a7fc0 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75e89c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75e89c3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:45118/0 (socket says 172.21.15.121:45118) 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.354+0000 7f75e89c3640 1 -- 172.21.15.121:0/3945188137 learned_addr learned my addr 172.21.15.121:0/3945188137 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75e89c3640 1 -- 172.21.15.121:0/3945188137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e4124f20 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75e89c3640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c4a0 tx=0x7f75d400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4017070 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4005c10 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4007070 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e41247d0 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.355+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e4139fa0 con 0x7f75e40a4ab0 2024-09-15T23:57:11.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.356+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f75d401a070 con 0x7f75e40a4ab0 2024-09-15T23:57:11.358 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.356+0000 7f75e17fa640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 0x7f75d003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:11.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.356+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f75d404a510 con 0x7f75e40a4ab0 2024-09-15T23:57:11.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.356+0000 7f75e3fff640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 0x7f75d003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:11.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.356+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e4123550 con 0x7f75e40a4ab0 2024-09-15T23:57:11.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.357+0000 7f75e3fff640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 0x7f75d003a710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d8034000 tx=0x7f75d802e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:11.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.361+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75e4124f20 con 0x7f75e40a4ab0 2024-09-15T23:57:11.500 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-09-15T23:57:11.499+0000 7f7d394cb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:11.564 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:11.563+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f75e41249f0 con 0x7f75e40a4ab0 2024-09-15T23:57:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.238+0000 7f75e17fa640 1 -- 172.21.15.121:0/3945188137 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f75d401b400 con 0x7f75e40a4ab0 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 msgr2=0x7f75d003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 0x7f75d003a710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d8034000 tx=0x7f75d802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 msgr2=0x7f75e40a1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c4a0 tx=0x7f75d400c960 comp rx=0 tx=0).stop 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 shutdown_connections 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f75d0038250 0x7f75d003a710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 --2- 172.21.15.121:0/3945188137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f75e40a4ab0 0x7f75e40a1100 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 >> 172.21.15.121:0/3945188137 conn(0x7f75e40ac370 msgr2=0x7f75e40a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 shutdown_connections 2024-09-15T23:57:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.242+0000 7f75eac27640 1 -- 172.21.15.121:0/3945188137 wait complete. 2024-09-15T23:57:12.255 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:57:12.256 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:12.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb98750a640 1 Processor -- start 2024-09-15T23:57:12.357 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb98750a640 1 -- start start 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb98750a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb980135f30 0x7fb98013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb98750a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9800a08c0 con 0x7fb980135b50 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb98750a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb98009b310 con 0x7fb980135f30 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.356+0000 7fb9852a6640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb980135b50 0x7fb98009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55170/0 (socket says 172.21.15.121:55170) 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb9852a6640 1 -- 172.21.15.121:0/60682494 learned_addr learned my addr 172.21.15.121:0/60682494 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb984aa5640 1 --2- 172.21.15.121:0/60682494 >> v2:172.21.15.121:3300/0 conn(0x7fb980135f30 0x7fb98013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb977fff640 1 -- 172.21.15.121:0/60682494 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029368469 0 0) 0x7fb9800a08c0 con 0x7fb980135b50 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb977fff640 1 -- 172.21.15.121:0/60682494 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb96c003520 con 0x7fb980135b50 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb984aa5640 1 -- 172.21.15.121:0/60682494 >> v1:172.21.15.121:6789/0 conn(0x7fb980135b50 legacy=0x7fb98009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb984aa5640 1 -- 172.21.15.121:0/60682494 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9800a2270 con 0x7fb980135f30 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.357+0000 7fb984aa5640 1 --2- 172.21.15.121:0/60682494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135f30 0x7fb98013bb80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb970009720 tx=0x7fb97002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edb8696415552e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb977fff640 1 -- 172.21.15.121:0/60682494 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb970037070 con 0x7fb980135f30 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb977fff640 1 -- 172.21.15.121:0/60682494 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97002ae20 con 0x7fb980135f30 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb977fff640 1 -- 172.21.15.121:0/60682494 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb970032570 con 0x7fb980135f30 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 -- 172.21.15.121:0/60682494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135f30 msgr2=0x7fb98013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 --2- 172.21.15.121:0/60682494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135f30 0x7fb98013bb80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb970009720 tx=0x7fb97002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 -- 172.21.15.121:0/60682494 shutdown_connections 2024-09-15T23:57:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 --2- 172.21.15.121:0/60682494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135f30 0x7fb98013bb80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 -- 172.21.15.121:0/60682494 >> 172.21.15.121:0/60682494 conn(0x7fb9800a85e0 msgr2=0x7fb9800a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 -- 172.21.15.121:0/60682494 shutdown_connections 2024-09-15T23:57:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.358+0000 7fb98750a640 1 -- 172.21.15.121:0/60682494 wait complete. 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.359+0000 7fb98750a640 1 Processor -- start 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.359+0000 7fb98750a640 1 -- start start 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb98750a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb98750a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb980136350 con 0x7fb980135b50 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb9852a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb9852a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52248/0 (socket says 172.21.15.121:52248) 2024-09-15T23:57:12.363 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb9852a6640 1 -- 172.21.15.121:0/4025275462 learned_addr learned my addr 172.21.15.121:0/4025275462 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb9852a6640 1 -- 172.21.15.121:0/4025275462 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb980124330 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb9852a6640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00c3b0 tx=0x7fb97c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb97c017070 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c005c10 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb980123770 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.360+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb97c0070d0 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.361+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98009dc80 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.361+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fb97c01a070 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.362+0000 7fb975ffb640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 0x7fb96403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.362+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7fb97c04a630 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.362+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98009e7e0 con 0x7fb980135b50 2024-09-15T23:57:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.362+0000 7fb984aa5640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 0x7fb96403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.362+0000 7fb984aa5640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 0x7fb96403a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb970034000 tx=0x7fb97002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.367 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.366+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb98009e7e0 con 0x7fb980135b50 2024-09-15T23:57:12.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.565+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb98009aae0 con 0x7fb980135b50 2024-09-15T23:57:12.566 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.565+0000 7fb975ffb640 1 -- 172.21.15.121:0/4025275462 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7fb97c019e10 con 0x7fb980135b50 2024-09-15T23:57:12.566 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:12.567 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:12.567 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:12.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 msgr2=0x7fb96403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 0x7fb96403a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb970034000 tx=0x7fb97002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 msgr2=0x7fb98011fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00c3b0 tx=0x7fb97c00c870 comp rx=0 tx=0).stop 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 shutdown_connections 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb9640382a0 0x7fb96403a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 --2- 172.21.15.121:0/4025275462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb980135b50 0x7fb98011fc90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 >> 172.21.15.121:0/4025275462 conn(0x7fb9800a85e0 msgr2=0x7fb9800a3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 shutdown_connections 2024-09-15T23:57:12.569 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.567+0000 7fb98750a640 1 -- 172.21.15.121:0/4025275462 wait complete. 2024-09-15T23:57:12.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.676+0000 7f1b5827b640 1 Processor -- start 2024-09-15T23:57:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.676+0000 7f1b5827b640 1 -- start start 2024-09-15T23:57:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b5827b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1b50135f30 0x7f1b5013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b5827b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b500a08c0 con 0x7f1b50135b50 2024-09-15T23:57:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b5827b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5009b310 con 0x7f1b50135f30 2024-09-15T23:57:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b55816640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1b50135f30 0x7f1b5013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b56017640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1b50135b50 0x7f1b5009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55178/0 (socket says 172.21.15.121:55178) 2024-09-15T23:57:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b56017640 1 -- 172.21.15.121:0/1409848136 learned_addr learned my addr 172.21.15.121:0/1409848136 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b55816640 1 -- 172.21.15.121:0/1409848136 >> v1:172.21.15.121:6789/0 conn(0x7f1b50135b50 legacy=0x7f1b5009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b55816640 1 -- 172.21.15.121:0/1409848136 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b500a2270 con 0x7f1b50135f30 2024-09-15T23:57:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.677+0000 7f1b55015640 1 -- 172.21.15.121:0/1409848136 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289713429 0 0) 0x7f1b500a08c0 con 0x7f1b50135b50 2024-09-15T23:57:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.678+0000 7f1b55816640 1 --2- 172.21.15.121:0/1409848136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135f30 0x7f1b5013bb80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009d90 tx=0x7f1b4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af58fbdf3bc676 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.678+0000 7f1b55015640 1 -- 172.21.15.121:0/1409848136 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44007670 con 0x7f1b50135f30 2024-09-15T23:57:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.678+0000 7f1b55015640 1 -- 172.21.15.121:0/1409848136 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44007810 con 0x7f1b50135f30 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.678+0000 7f1b55015640 1 -- 172.21.15.121:0/1409848136 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b44007b10 con 0x7f1b50135f30 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 -- 172.21.15.121:0/1409848136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135f30 msgr2=0x7f1b5013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 --2- 172.21.15.121:0/1409848136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135f30 0x7f1b5013bb80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009d90 tx=0x7f1b4402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 -- 172.21.15.121:0/1409848136 shutdown_connections 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 --2- 172.21.15.121:0/1409848136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135f30 0x7f1b5013bb80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 -- 172.21.15.121:0/1409848136 >> 172.21.15.121:0/1409848136 conn(0x7f1b500a85e0 msgr2=0x7f1b500a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 -- 172.21.15.121:0/1409848136 shutdown_connections 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.679+0000 7f1b5827b640 1 -- 172.21.15.121:0/1409848136 wait complete. 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b5827b640 1 Processor -- start 2024-09-15T23:57:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b5827b640 1 -- start start 2024-09-15T23:57:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b5827b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b5827b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50136350 con 0x7f1b50135b50 2024-09-15T23:57:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b56017640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b56017640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52270/0 (socket says 172.21.15.121:52270) 2024-09-15T23:57:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b56017640 1 -- 172.21.15.121:0/2679842972 learned_addr learned my addr 172.21.15.121:0/2679842972 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.680+0000 7f1b56017640 1 -- 172.21.15.121:0/2679842972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5013c600 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b56017640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c420 tx=0x7f1b4800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b48018070 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b480074d0 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b48004950 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5013aaa0 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.681+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5006f210 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f1b4801b070 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b500a2f60 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b4effd640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 0x7f1b3c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f1b4804a560 con 0x7f1b50135b50 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b55816640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 0x7f1b3c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.682+0000 7f1b55816640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 0x7f1b3c03a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b44034000 tx=0x7f1b4402f000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.687 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.686+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b500a2f60 con 0x7f1b50135b50 2024-09-15T23:57:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.852+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b5009aae0 con 0x7f1b50135b50 2024-09-15T23:57:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.852+0000 7f1b4effd640 1 -- 172.21.15.121:0/2679842972 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+10678 (secure 0 0 0) 0x7f1b48011980 con 0x7f1b50135b50 2024-09-15T23:57:12.853 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:12.854 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":57,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:11.234357+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:08.177705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:08.542745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.854+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 msgr2=0x7f1b3c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.854+0000 7f1b5827b640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 0x7f1b3c03a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b44034000 tx=0x7f1b4402f000 comp rx=0 tx=0).stop 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.854+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 msgr2=0x7f1b5013b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.854+0000 7f1b5827b640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c420 tx=0x7f1b4800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 shutdown_connections 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f1b3c0382a0 0x7f1b3c03a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 --2- 172.21.15.121:0/2679842972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b50135b50 0x7f1b5013b380 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 >> 172.21.15.121:0/2679842972 conn(0x7f1b500a85e0 msgr2=0x7f1b500a7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 shutdown_connections 2024-09-15T23:57:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.855+0000 7f1b5827b640 1 -- 172.21.15.121:0/2679842972 wait complete. 2024-09-15T23:57:12.867 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:57:12.867 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.964+0000 7f3a062a6640 1 Processor -- start 2024-09-15T23:57:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.964+0000 7f3a062a6640 1 -- start start 2024-09-15T23:57:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f3a062a6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3a0009ee30 0x7f3a0013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f3a062a6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a000a2280 con 0x7f3a000a39c0 2024-09-15T23:57:12.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f3a062a6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3a0009e6e0 con 0x7f3a0009ee30 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39ff7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3a0009ee30 0x7f3a0013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39fffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3a000a39c0 0x7f3a000a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55184/0 (socket says 172.21.15.121:55184) 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39fffff640 1 -- 172.21.15.121:0/3769182033 learned_addr learned my addr 172.21.15.121:0/3769182033 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39feffd640 1 -- 172.21.15.121:0/3769182033 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038550015 0 0) 0x7f3a000a2280 con 0x7f3a000a39c0 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39feffd640 1 -- 172.21.15.121:0/3769182033 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39e8003520 con 0x7f3a000a39c0 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39ff7fe640 1 -- 172.21.15.121:0/3769182033 >> v1:172.21.15.121:6789/0 conn(0x7f3a000a39c0 legacy=0x7f3a000a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.965+0000 7f39ff7fe640 1 -- 172.21.15.121:0/3769182033 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0009e3d0 con 0x7f3a0009ee30 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f39ff7fe640 1 --2- 172.21.15.121:0/3769182033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0013ced0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009720 tx=0x7f39f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9351c144eb8a8f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f39feffd640 1 -- 172.21.15.121:0/3769182033 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f4037070 con 0x7f3a0009ee30 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f39feffd640 1 -- 172.21.15.121:0/3769182033 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f402ad90 con 0x7f3a0009ee30 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f39feffd640 1 -- 172.21.15.121:0/3769182033 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f4032570 con 0x7f3a0009ee30 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f3a062a6640 1 -- 172.21.15.121:0/3769182033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 msgr2=0x7f3a0013ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.966+0000 7f3a062a6640 1 --2- 172.21.15.121:0/3769182033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0013ced0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009720 tx=0x7f39f402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 -- 172.21.15.121:0/3769182033 shutdown_connections 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 --2- 172.21.15.121:0/3769182033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0013ced0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 -- 172.21.15.121:0/3769182033 >> 172.21.15.121:0/3769182033 conn(0x7f3a000a85e0 msgr2=0x7f3a000a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 -- 172.21.15.121:0/3769182033 shutdown_connections 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 -- 172.21.15.121:0/3769182033 wait complete. 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.967+0000 7f3a062a6640 1 Processor -- start 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f3a062a6640 1 -- start start 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f3a062a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f3a062a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3a000a1ed0 con 0x7f3a0009ee30 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f39fffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f39fffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52288/0 (socket says 172.21.15.121:52288) 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f39fffff640 1 -- 172.21.15.121:0/2983781425 learned_addr learned my addr 172.21.15.121:0/2983781425 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f39fffff640 1 -- 172.21.15.121:0/2983781425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a00071690 con 0x7f3a0009ee30 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.968+0000 7f39fffff640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c3b0 tx=0x7f39f000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.969+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f0017070 con 0x7f3a0009ee30 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.969+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0005c10 con 0x7f3a0009ee30 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.969+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0006fca0 con 0x7f3a0009ee30 2024-09-15T23:57:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.969+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f00070d0 con 0x7f3a0009ee30 2024-09-15T23:57:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.969+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a001346d0 con 0x7f3a0009ee30 2024-09-15T23:57:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f39f001a070 con 0x7f3a0009ee30 2024-09-15T23:57:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a00071f50 con 0x7f3a0009ee30 2024-09-15T23:57:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f39fcff9640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 0x7f39ec03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f39f004a6b0 con 0x7f3a0009ee30 2024-09-15T23:57:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f39ff7fe640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 0x7f39ec03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.970+0000 7f39ff7fe640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 0x7f39ec03a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39f4034000 tx=0x7f39f402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:12.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:12.974+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a00071690 con 0x7f3a0009ee30 2024-09-15T23:57:13.139 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.138+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 --> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a0006bde0 con 0x7f39ec0382a0 2024-09-15T23:57:13.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.144+0000 7f39fcff9640 1 -- 172.21.15.121:0/2983781425 <== mgr.4716 v2:172.21.15.121:6828/3810060514 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246083 (secure 0 0 0) 0x7f3a0006bde0 con 0x7f39ec0382a0 2024-09-15T23:57:13.148 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:13.152 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 msgr2=0x7f39ec03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 0x7f39ec03a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39f4034000 tx=0x7f39f402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 msgr2=0x7f3a0011e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c3b0 tx=0x7f39f000c870 comp rx=0 tx=0).stop 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 shutdown_connections 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f39ec0382a0 0x7f39ec03a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 --2- 172.21.15.121:0/2983781425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a0009ee30 0x7f3a0011e600 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.147+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 >> 172.21.15.121:0/2983781425 conn(0x7f3a000a85e0 msgr2=0x7f3a00134d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.148+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 shutdown_connections 2024-09-15T23:57:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.148+0000 7f3a062a6640 1 -- 172.21.15.121:0/2983781425 wait complete. 2024-09-15T23:57:13.159 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T23:57:11.319949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":262,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":96344,"kb_used_data":2772,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019176,"statfs":{"total":289910292480,"available":289811636224,"internally_reserved":0,"allocated":2838528,"data_stored":1797910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000585"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251427+0000","last_change":"2024-09-15T23:57:10.253021+0000","last_active":"2024-09-15T23:57:11.251427+0000","last_peered":"2024-09-15T23:57:11.251427+0000","last_clean":"2024-09-15T23:57:11.251427+0000","last_became_active":"2024-09-15T23:57:10.250940+0000","last_became_peered":"2024-09-15T23:57:10.250940+0000","last_unstale":"2024-09-15T23:57:11.251427+0000","last_undegraded":"2024-09-15T23:57:11.251427+0000","last_fullsized":"2024-09-15T23:57:11.251427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:04.614721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254072+0000","last_change":"2024-09-15T23:57:10.268371+0000","last_active":"2024-09-15T23:57:11.254072+0000","last_peered":"2024-09-15T23:57:11.254072+0000","last_clean":"2024-09-15T23:57:11.254072+0000","last_became_active":"2024-09-15T23:57:10.267939+0000","last_became_peered":"2024-09-15T23:57:10.267939+0000","last_unstale":"2024-09-15T23:57:11.254072+0000","last_undegraded":"2024-09-15T23:57:11.254072+0000","last_fullsized":"2024-09-15T23:57:11.254072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:19.097276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241134+0000","last_change":"2024-09-15T23:57:10.252759+0000","last_active":"2024-09-15T23:57:11.241134+0000","last_peered":"2024-09-15T23:57:11.241134+0000","last_clean":"2024-09-15T23:57:11.241134+0000","last_became_active":"2024-09-15T23:57:10.252511+0000","last_became_peered":"2024-09-15T23:57:10.252511+0000","last_unstale":"2024-09-15T23:57:11.241134+0000","last_undegraded":"2024-09-15T23:57:11.241134+0000","last_fullsized":"2024-09-15T23:57:11.241134+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:27.982986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250913+0000","last_change":"2024-09-15T23:57:10.262516+0000","last_active":"2024-09-15T23:57:11.250913+0000","last_peered":"2024-09-15T23:57:11.250913+0000","last_clean":"2024-09-15T23:57:11.250913+0000","last_became_active":"2024-09-15T23:57:10.261919+0000","last_became_peered":"2024-09-15T23:57:10.261919+0000","last_unstale":"2024-09-15T23:57:11.250913+0000","last_undegraded":"2024-09-15T23:57:11.250913+0000","last_fullsized":"2024-09-15T23:57:11.250913+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:15.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240424+0000","last_change":"2024-09-15T23:57:10.251619+0000","last_active":"2024-09-15T23:57:11.240424+0000","last_peered":"2024-09-15T23:57:11.240424+0000","last_clean":"2024-09-15T23:57:11.240424+0000","last_became_active":"2024-09-15T23:57:10.251343+0000","last_became_peered":"2024-09-15T23:57:10.251343+0000","last_unstale":"2024-09-15T23:57:11.240424+0000","last_undegraded":"2024-09-15T23:57:11.240424+0000","last_fullsized":"2024-09-15T23:57:11.240424+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:38.889221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239795+0000","last_change":"2024-09-15T23:57:10.255372+0000","last_active":"2024-09-15T23:57:11.239795+0000","last_peered":"2024-09-15T23:57:11.239795+0000","last_clean":"2024-09-15T23:57:11.239795+0000","last_became_active":"2024-09-15T23:57:10.253090+0000","last_became_peered":"2024-09-15T23:57:10.253090+0000","last_unstale":"2024-09-15T23:57:11.239795+0000","last_undegraded":"2024-09-15T23:57:11.239795+0000","last_fullsized":"2024-09-15T23:57:11.239795+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:28.878800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250649+0000","last_change":"2024-09-15T23:57:10.250332+0000","last_active":"2024-09-15T23:57:11.250649+0000","last_peered":"2024-09-15T23:57:11.250649+0000","last_clean":"2024-09-15T23:57:11.250649+0000","last_became_active":"2024-09-15T23:57:10.250112+0000","last_became_peered":"2024-09-15T23:57:10.250112+0000","last_unstale":"2024-09-15T23:57:11.250649+0000","last_undegraded":"2024-09-15T23:57:11.250649+0000","last_fullsized":"2024-09-15T23:57:11.250649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:16.253044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253419+0000","last_change":"2024-09-15T23:57:10.268663+0000","last_active":"2024-09-15T23:57:11.253419+0000","last_peered":"2024-09-15T23:57:11.253419+0000","last_clean":"2024-09-15T23:57:11.253419+0000","last_became_active":"2024-09-15T23:57:10.268404+0000","last_became_peered":"2024-09-15T23:57:10.268404+0000","last_unstale":"2024-09-15T23:57:11.253419+0000","last_undegraded":"2024-09-15T23:57:11.253419+0000","last_fullsized":"2024-09-15T23:57:11.253419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:52.744139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240097+0000","last_change":"2024-09-15T23:57:10.250818+0000","last_active":"2024-09-15T23:57:11.240097+0000","last_peered":"2024-09-15T23:57:11.240097+0000","last_clean":"2024-09-15T23:57:11.240097+0000","last_became_active":"2024-09-15T23:57:10.250408+0000","last_became_peered":"2024-09-15T23:57:10.250408+0000","last_unstale":"2024-09-15T23:57:11.240097+0000","last_undegraded":"2024-09-15T23:57:11.240097+0000","last_fullsized":"2024-09-15T23:57:11.240097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:42.836566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251459+0000","last_change":"2024-09-15T23:57:10.262404+0000","last_active":"2024-09-15T23:57:11.251459+0000","last_peered":"2024-09-15T23:57:11.251459+0000","last_clean":"2024-09-15T23:57:11.251459+0000","last_became_active":"2024-09-15T23:57:10.261697+0000","last_became_peered":"2024-09-15T23:57:10.261697+0000","last_unstale":"2024-09-15T23:57:11.251459+0000","last_undegraded":"2024-09-15T23:57:11.251459+0000","last_fullsized":"2024-09-15T23:57:11.251459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:55.169859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253898+0000","last_change":"2024-09-15T23:57:10.265246+0000","last_active":"2024-09-15T23:57:11.253898+0000","last_peered":"2024-09-15T23:57:11.253898+0000","last_clean":"2024-09-15T23:57:11.253898+0000","last_became_active":"2024-09-15T23:57:10.264997+0000","last_became_peered":"2024-09-15T23:57:10.264997+0000","last_unstale":"2024-09-15T23:57:11.253898+0000","last_undegraded":"2024-09-15T23:57:11.253898+0000","last_fullsized":"2024-09-15T23:57:11.253898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:36.847406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251029+0000","last_change":"2024-09-15T23:57:10.262308+0000","last_active":"2024-09-15T23:57:11.251029+0000","last_peered":"2024-09-15T23:57:11.251029+0000","last_clean":"2024-09-15T23:57:11.251029+0000","last_became_active":"2024-09-15T23:57:10.261588+0000","last_became_peered":"2024-09-15T23:57:10.261588+0000","last_unstale":"2024-09-15T23:57:11.251029+0000","last_undegraded":"2024-09-15T23:57:11.251029+0000","last_fullsized":"2024-09-15T23:57:11.251029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:20.084517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254076+0000","last_change":"2024-09-15T23:57:10.268397+0000","last_active":"2024-09-15T23:57:11.254076+0000","last_peered":"2024-09-15T23:57:11.254076+0000","last_clean":"2024-09-15T23:57:11.254076+0000","last_became_active":"2024-09-15T23:57:10.268167+0000","last_became_peered":"2024-09-15T23:57:10.268167+0000","last_unstale":"2024-09-15T23:57:11.254076+0000","last_undegraded":"2024-09-15T23:57:11.254076+0000","last_fullsized":"2024-09-15T23:57:11.254076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:27.161661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239607+0000","last_change":"2024-09-15T23:57:10.267301+0000","last_active":"2024-09-15T23:57:11.239607+0000","last_peered":"2024-09-15T23:57:11.239607+0000","last_clean":"2024-09-15T23:57:11.239607+0000","last_became_active":"2024-09-15T23:57:10.267014+0000","last_became_peered":"2024-09-15T23:57:10.267014+0000","last_unstale":"2024-09-15T23:57:11.239607+0000","last_undegraded":"2024-09-15T23:57:11.239607+0000","last_fullsized":"2024-09-15T23:57:11.239607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:43.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254423+0000","last_change":"2024-09-15T23:57:10.265214+0000","last_active":"2024-09-15T23:57:11.254423+0000","last_peered":"2024-09-15T23:57:11.254423+0000","last_clean":"2024-09-15T23:57:11.254423+0000","last_became_active":"2024-09-15T23:57:10.264946+0000","last_became_peered":"2024-09-15T23:57:10.264946+0000","last_unstale":"2024-09-15T23:57:11.254423+0000","last_undegraded":"2024-09-15T23:57:11.254423+0000","last_fullsized":"2024-09-15T23:57:11.254423+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:24.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239405+0000","last_change":"2024-09-15T23:57:10.255737+0000","last_active":"2024-09-15T23:57:11.239405+0000","last_peered":"2024-09-15T23:57:11.239405+0000","last_clean":"2024-09-15T23:57:11.239405+0000","last_became_active":"2024-09-15T23:57:10.255466+0000","last_became_peered":"2024-09-15T23:57:10.255466+0000","last_unstale":"2024-09-15T23:57:11.239405+0000","last_undegraded":"2024-09-15T23:57:11.239405+0000","last_fullsized":"2024-09-15T23:57:11.239405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:06.911915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240244+0000","last_change":"2024-09-15T23:57:10.266584+0000","last_active":"2024-09-15T23:57:11.240244+0000","last_peered":"2024-09-15T23:57:11.240244+0000","last_clean":"2024-09-15T23:57:11.240244+0000","last_became_active":"2024-09-15T23:57:10.266276+0000","last_became_peered":"2024-09-15T23:57:10.266276+0000","last_unstale":"2024-09-15T23:57:11.240244+0000","last_undegraded":"2024-09-15T23:57:11.240244+0000","last_fullsized":"2024-09-15T23:57:11.240244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:18.710870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251540+0000","last_change":"2024-09-15T23:57:10.262189+0000","last_active":"2024-09-15T23:57:11.251540+0000","last_peered":"2024-09-15T23:57:11.251540+0000","last_clean":"2024-09-15T23:57:11.251540+0000","last_became_active":"2024-09-15T23:57:10.261371+0000","last_became_peered":"2024-09-15T23:57:10.261371+0000","last_unstale":"2024-09-15T23:57:11.251540+0000","last_undegraded":"2024-09-15T23:57:11.251540+0000","last_fullsized":"2024-09-15T23:57:11.251540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:34.658773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240685+0000","last_change":"2024-09-15T23:57:10.274407+0000","last_active":"2024-09-15T23:57:11.240685+0000","last_peered":"2024-09-15T23:57:11.240685+0000","last_clean":"2024-09-15T23:57:11.240685+0000","last_became_active":"2024-09-15T23:57:10.273884+0000","last_became_peered":"2024-09-15T23:57:10.273884+0000","last_unstale":"2024-09-15T23:57:11.240685+0000","last_undegraded":"2024-09-15T23:57:11.240685+0000","last_fullsized":"2024-09-15T23:57:11.240685+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:32.511264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254347+0000","last_change":"2024-09-15T23:57:10.264483+0000","last_active":"2024-09-15T23:57:11.254347+0000","last_peered":"2024-09-15T23:57:11.254347+0000","last_clean":"2024-09-15T23:57:11.254347+0000","last_became_active":"2024-09-15T23:57:10.264208+0000","last_became_peered":"2024-09-15T23:57:10.264208+0000","last_unstale":"2024-09-15T23:57:11.254347+0000","last_undegraded":"2024-09-15T23:57:11.254347+0000","last_fullsized":"2024-09-15T23:57:11.254347+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:35.765556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254250+0000","last_change":"2024-09-15T23:57:10.258729+0000","last_active":"2024-09-15T23:57:11.254250+0000","last_peered":"2024-09-15T23:57:11.254250+0000","last_clean":"2024-09-15T23:57:11.254250+0000","last_became_active":"2024-09-15T23:57:10.257255+0000","last_became_peered":"2024-09-15T23:57:10.257255+0000","last_unstale":"2024-09-15T23:57:11.254250+0000","last_undegraded":"2024-09-15T23:57:11.254250+0000","last_fullsized":"2024-09-15T23:57:11.254250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:08.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239753+0000","last_change":"2024-09-15T23:57:10.249811+0000","last_active":"2024-09-15T23:57:11.239753+0000","last_peered":"2024-09-15T23:57:11.239753+0000","last_clean":"2024-09-15T23:57:11.239753+0000","last_became_active":"2024-09-15T23:57:10.249513+0000","last_became_peered":"2024-09-15T23:57:10.249513+0000","last_unstale":"2024-09-15T23:57:11.239753+0000","last_undegraded":"2024-09-15T23:57:11.239753+0000","last_fullsized":"2024-09-15T23:57:11.239753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:38.523276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250655+0000","last_change":"2024-09-15T23:57:10.264976+0000","last_active":"2024-09-15T23:57:11.250655+0000","last_peered":"2024-09-15T23:57:11.250655+0000","last_clean":"2024-09-15T23:57:11.250655+0000","last_became_active":"2024-09-15T23:57:10.264726+0000","last_became_peered":"2024-09-15T23:57:10.264726+0000","last_unstale":"2024-09-15T23:57:11.250655+0000","last_undegraded":"2024-09-15T23:57:11.250655+0000","last_fullsized":"2024-09-15T23:57:11.250655+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:57.984243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253488+0000","last_change":"2024-09-15T23:57:10.265643+0000","last_active":"2024-09-15T23:57:11.253488+0000","last_peered":"2024-09-15T23:57:11.253488+0000","last_clean":"2024-09-15T23:57:11.253488+0000","last_became_active":"2024-09-15T23:57:10.265330+0000","last_became_peered":"2024-09-15T23:57:10.265330+0000","last_unstale":"2024-09-15T23:57:11.253488+0000","last_undegraded":"2024-09-15T23:57:11.253488+0000","last_fullsized":"2024-09-15T23:57:11.253488+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:24.127300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251540+0000","last_change":"2024-09-15T23:57:10.265808+0000","last_active":"2024-09-15T23:57:11.251540+0000","last_peered":"2024-09-15T23:57:11.251540+0000","last_clean":"2024-09-15T23:57:11.251540+0000","last_became_active":"2024-09-15T23:57:10.265102+0000","last_became_peered":"2024-09-15T23:57:10.265102+0000","last_unstale":"2024-09-15T23:57:11.251540+0000","last_undegraded":"2024-09-15T23:57:11.251540+0000","last_fullsized":"2024-09-15T23:57:11.251540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:26.554384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251570+0000","last_change":"2024-09-15T23:57:10.261975+0000","last_active":"2024-09-15T23:57:11.251570+0000","last_peered":"2024-09-15T23:57:11.251570+0000","last_clean":"2024-09-15T23:57:11.251570+0000","last_became_active":"2024-09-15T23:57:10.261041+0000","last_became_peered":"2024-09-15T23:57:10.261041+0000","last_unstale":"2024-09-15T23:57:11.251570+0000","last_undegraded":"2024-09-15T23:57:11.251570+0000","last_fullsized":"2024-09-15T23:57:11.251570+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:16.063265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254035+0000","last_change":"2024-09-15T23:57:10.269367+0000","last_active":"2024-09-15T23:57:11.254035+0000","last_peered":"2024-09-15T23:57:11.254035+0000","last_clean":"2024-09-15T23:57:11.254035+0000","last_became_active":"2024-09-15T23:57:10.268669+0000","last_became_peered":"2024-09-15T23:57:10.268669+0000","last_unstale":"2024-09-15T23:57:11.254035+0000","last_undegraded":"2024-09-15T23:57:11.254035+0000","last_fullsized":"2024-09-15T23:57:11.254035+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:31.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254329+0000","last_change":"2024-09-15T23:57:10.269427+0000","last_active":"2024-09-15T23:57:11.254329+0000","last_peered":"2024-09-15T23:57:11.254329+0000","last_clean":"2024-09-15T23:57:11.254329+0000","last_became_active":"2024-09-15T23:57:10.265561+0000","last_became_peered":"2024-09-15T23:57:10.265561+0000","last_unstale":"2024-09-15T23:57:11.254329+0000","last_undegraded":"2024-09-15T23:57:11.254329+0000","last_fullsized":"2024-09-15T23:57:11.254329+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:17.620084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251043+0000","last_change":"2024-09-15T23:57:10.263183+0000","last_active":"2024-09-15T23:57:11.251043+0000","last_peered":"2024-09-15T23:57:11.251043+0000","last_clean":"2024-09-15T23:57:11.251043+0000","last_became_active":"2024-09-15T23:57:10.262428+0000","last_became_peered":"2024-09-15T23:57:10.262428+0000","last_unstale":"2024-09-15T23:57:11.251043+0000","last_undegraded":"2024-09-15T23:57:11.251043+0000","last_fullsized":"2024-09-15T23:57:11.251043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:20.906195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250713+0000","last_change":"2024-09-15T23:57:10.263032+0000","last_active":"2024-09-15T23:57:11.250713+0000","last_peered":"2024-09-15T23:57:11.250713+0000","last_clean":"2024-09-15T23:57:11.250713+0000","last_became_active":"2024-09-15T23:57:10.262764+0000","last_became_peered":"2024-09-15T23:57:10.262764+0000","last_unstale":"2024-09-15T23:57:11.250713+0000","last_undegraded":"2024-09-15T23:57:11.250713+0000","last_fullsized":"2024-09-15T23:57:11.250713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:02.413822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253643+0000","last_change":"2024-09-15T23:57:10.255422+0000","last_active":"2024-09-15T23:57:11.253643+0000","last_peered":"2024-09-15T23:57:11.253643+0000","last_clean":"2024-09-15T23:57:11.253643+0000","last_became_active":"2024-09-15T23:57:10.253167+0000","last_became_peered":"2024-09-15T23:57:10.253167+0000","last_unstale":"2024-09-15T23:57:11.253643+0000","last_undegraded":"2024-09-15T23:57:11.253643+0000","last_fullsized":"2024-09-15T23:57:11.253643+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:40.542405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253560+0000","last_change":"2024-09-15T23:57:10.265557+0000","last_active":"2024-09-15T23:57:11.253560+0000","last_peered":"2024-09-15T23:57:11.253560+0000","last_clean":"2024-09-15T23:57:11.253560+0000","last_became_active":"2024-09-15T23:57:10.264986+0000","last_became_peered":"2024-09-15T23:57:10.264986+0000","last_unstale":"2024-09-15T23:57:11.253560+0000","last_undegraded":"2024-09-15T23:57:11.253560+0000","last_fullsized":"2024-09-15T23:57:11.253560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:45.090116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240294+0000","last_change":"2024-09-15T23:57:10.251218+0000","last_active":"2024-09-15T23:57:11.240294+0000","last_peered":"2024-09-15T23:57:11.240294+0000","last_clean":"2024-09-15T23:57:11.240294+0000","last_became_active":"2024-09-15T23:57:10.250839+0000","last_became_peered":"2024-09-15T23:57:10.250839+0000","last_unstale":"2024-09-15T23:57:11.240294+0000","last_undegraded":"2024-09-15T23:57:11.240294+0000","last_fullsized":"2024-09-15T23:57:11.240294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.275859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240403+0000","last_change":"2024-09-15T23:57:09.245124+0000","last_active":"2024-09-15T23:57:11.240403+0000","last_peered":"2024-09-15T23:57:11.240403+0000","last_clean":"2024-09-15T23:57:11.240403+0000","last_became_active":"2024-09-15T23:57:09.244022+0000","last_became_peered":"2024-09-15T23:57:09.244022+0000","last_unstale":"2024-09-15T23:57:11.240403+0000","last_undegraded":"2024-09-15T23:57:11.240403+0000","last_fullsized":"2024-09-15T23:57:11.240403+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:05.001211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240374+0000","last_change":"2024-09-15T23:57:10.266440+0000","last_active":"2024-09-15T23:57:11.240374+0000","last_peered":"2024-09-15T23:57:11.240374+0000","last_clean":"2024-09-15T23:57:11.240374+0000","last_became_active":"2024-09-15T23:57:10.266162+0000","last_became_peered":"2024-09-15T23:57:10.266162+0000","last_unstale":"2024-09-15T23:57:11.240374+0000","last_undegraded":"2024-09-15T23:57:11.240374+0000","last_fullsized":"2024-09-15T23:57:11.240374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:31.983353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254401+0000","last_change":"2024-09-15T23:57:09.244612+0000","last_active":"2024-09-15T23:57:11.254401+0000","last_peered":"2024-09-15T23:57:11.254401+0000","last_clean":"2024-09-15T23:57:11.254401+0000","last_became_active":"2024-09-15T23:57:09.244359+0000","last_became_peered":"2024-09-15T23:57:09.244359+0000","last_unstale":"2024-09-15T23:57:11.254401+0000","last_undegraded":"2024-09-15T23:57:11.254401+0000","last_fullsized":"2024-09-15T23:57:11.254401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:45.157834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240156+0000","last_change":"2024-09-15T23:57:10.255423+0000","last_active":"2024-09-15T23:57:11.240156+0000","last_peered":"2024-09-15T23:57:11.240156+0000","last_clean":"2024-09-15T23:57:11.240156+0000","last_became_active":"2024-09-15T23:57:10.253503+0000","last_became_peered":"2024-09-15T23:57:10.253503+0000","last_unstale":"2024-09-15T23:57:11.240156+0000","last_undegraded":"2024-09-15T23:57:11.240156+0000","last_fullsized":"2024-09-15T23:57:11.240156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:45.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241044+0000","last_change":"2024-09-15T23:57:09.245650+0000","last_active":"2024-09-15T23:57:11.241044+0000","last_peered":"2024-09-15T23:57:11.241044+0000","last_clean":"2024-09-15T23:57:11.241044+0000","last_became_active":"2024-09-15T23:57:09.245403+0000","last_became_peered":"2024-09-15T23:57:09.245403+0000","last_unstale":"2024-09-15T23:57:11.241044+0000","last_undegraded":"2024-09-15T23:57:11.241044+0000","last_fullsized":"2024-09-15T23:57:11.241044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:11.555250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251289+0000","last_change":"2024-09-15T23:57:10.268543+0000","last_active":"2024-09-15T23:57:11.251289+0000","last_peered":"2024-09-15T23:57:11.251289+0000","last_clean":"2024-09-15T23:57:11.251289+0000","last_became_active":"2024-09-15T23:57:10.268294+0000","last_became_peered":"2024-09-15T23:57:10.268294+0000","last_unstale":"2024-09-15T23:57:11.251289+0000","last_undegraded":"2024-09-15T23:57:11.251289+0000","last_fullsized":"2024-09-15T23:57:11.251289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:17.731744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240030+0000","last_change":"2024-09-15T23:57:09.242724+0000","last_active":"2024-09-15T23:57:11.240030+0000","last_peered":"2024-09-15T23:57:11.240030+0000","last_clean":"2024-09-15T23:57:11.240030+0000","last_became_active":"2024-09-15T23:57:09.242475+0000","last_became_peered":"2024-09-15T23:57:09.242475+0000","last_unstale":"2024-09-15T23:57:11.240030+0000","last_undegraded":"2024-09-15T23:57:11.240030+0000","last_fullsized":"2024-09-15T23:57:11.240030+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:33.905515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239920+0000","last_change":"2024-09-15T23:57:10.255581+0000","last_active":"2024-09-15T23:57:11.239920+0000","last_peered":"2024-09-15T23:57:11.239920+0000","last_clean":"2024-09-15T23:57:11.239920+0000","last_became_active":"2024-09-15T23:57:10.253442+0000","last_became_peered":"2024-09-15T23:57:10.253442+0000","last_unstale":"2024-09-15T23:57:11.239920+0000","last_undegraded":"2024-09-15T23:57:11.239920+0000","last_fullsized":"2024-09-15T23:57:11.239920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.460744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240673+0000","last_change":"2024-09-15T23:57:09.241567+0000","last_active":"2024-09-15T23:57:11.240673+0000","last_peered":"2024-09-15T23:57:11.240673+0000","last_clean":"2024-09-15T23:57:11.240673+0000","last_became_active":"2024-09-15T23:57:09.241269+0000","last_became_peered":"2024-09-15T23:57:09.241269+0000","last_unstale":"2024-09-15T23:57:11.240673+0000","last_undegraded":"2024-09-15T23:57:11.240673+0000","last_fullsized":"2024-09-15T23:57:11.240673+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:47.093140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240580+0000","last_change":"2024-09-15T23:57:10.269051+0000","last_active":"2024-09-15T23:57:11.240580+0000","last_peered":"2024-09-15T23:57:11.240580+0000","last_clean":"2024-09-15T23:57:11.240580+0000","last_became_active":"2024-09-15T23:57:10.268560+0000","last_became_peered":"2024-09-15T23:57:10.268560+0000","last_unstale":"2024-09-15T23:57:11.240580+0000","last_undegraded":"2024-09-15T23:57:11.240580+0000","last_fullsized":"2024-09-15T23:57:11.240580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:51.850597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250818+0000","last_change":"2024-09-15T23:57:09.251183+0000","last_active":"2024-09-15T23:57:11.250818+0000","last_peered":"2024-09-15T23:57:11.250818+0000","last_clean":"2024-09-15T23:57:11.250818+0000","last_became_active":"2024-09-15T23:57:09.250102+0000","last_became_peered":"2024-09-15T23:57:09.250102+0000","last_unstale":"2024-09-15T23:57:11.250818+0000","last_undegraded":"2024-09-15T23:57:11.250818+0000","last_fullsized":"2024-09-15T23:57:11.250818+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:44:55.236356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239495+0000","last_change":"2024-09-15T23:57:10.250962+0000","last_active":"2024-09-15T23:57:11.239495+0000","last_peered":"2024-09-15T23:57:11.239495+0000","last_clean":"2024-09-15T23:57:11.239495+0000","last_became_active":"2024-09-15T23:57:10.250218+0000","last_became_peered":"2024-09-15T23:57:10.250218+0000","last_unstale":"2024-09-15T23:57:11.239495+0000","last_undegraded":"2024-09-15T23:57:11.239495+0000","last_fullsized":"2024-09-15T23:57:11.239495+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:21.677278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250826+0000","last_change":"2024-09-15T23:57:09.251527+0000","last_active":"2024-09-15T23:57:11.250826+0000","last_peered":"2024-09-15T23:57:11.250826+0000","last_clean":"2024-09-15T23:57:11.250826+0000","last_became_active":"2024-09-15T23:57:09.250230+0000","last_became_peered":"2024-09-15T23:57:09.250230+0000","last_unstale":"2024-09-15T23:57:11.250826+0000","last_undegraded":"2024-09-15T23:57:11.250826+0000","last_fullsized":"2024-09-15T23:57:11.250826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:53.370937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253813+0000","last_change":"2024-09-15T23:57:10.269107+0000","last_active":"2024-09-15T23:57:11.253813+0000","last_peered":"2024-09-15T23:57:11.253813+0000","last_clean":"2024-09-15T23:57:11.253813+0000","last_became_active":"2024-09-15T23:57:10.268730+0000","last_became_peered":"2024-09-15T23:57:10.268730+0000","last_unstale":"2024-09-15T23:57:11.253813+0000","last_undegraded":"2024-09-15T23:57:11.253813+0000","last_fullsized":"2024-09-15T23:57:11.253813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:10.585170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239588+0000","last_change":"2024-09-15T23:57:09.243572+0000","last_active":"2024-09-15T23:57:11.239588+0000","last_peered":"2024-09-15T23:57:11.239588+0000","last_clean":"2024-09-15T23:57:11.239588+0000","last_became_active":"2024-09-15T23:57:09.243104+0000","last_became_peered":"2024-09-15T23:57:09.243104+0000","last_unstale":"2024-09-15T23:57:11.239588+0000","last_undegraded":"2024-09-15T23:57:11.239588+0000","last_fullsized":"2024-09-15T23:57:11.239588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:50.985376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251693+0000","last_change":"2024-09-15T23:57:10.275288+0000","last_active":"2024-09-15T23:57:11.251693+0000","last_peered":"2024-09-15T23:57:11.251693+0000","last_clean":"2024-09-15T23:57:11.251693+0000","last_became_active":"2024-09-15T23:57:10.275032+0000","last_became_peered":"2024-09-15T23:57:10.275032+0000","last_unstale":"2024-09-15T23:57:11.251693+0000","last_undegraded":"2024-09-15T23:57:11.251693+0000","last_fullsized":"2024-09-15T23:57:11.251693+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254356+0000","last_change":"2024-09-15T23:57:09.255881+0000","last_active":"2024-09-15T23:57:11.254356+0000","last_peered":"2024-09-15T23:57:11.254356+0000","last_clean":"2024-09-15T23:57:11.254356+0000","last_became_active":"2024-09-15T23:57:09.255609+0000","last_became_peered":"2024-09-15T23:57:09.255609+0000","last_unstale":"2024-09-15T23:57:11.254356+0000","last_undegraded":"2024-09-15T23:57:11.254356+0000","last_fullsized":"2024-09-15T23:57:11.254356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:37.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254189+0000","last_change":"2024-09-15T23:57:10.267880+0000","last_active":"2024-09-15T23:57:11.254189+0000","last_peered":"2024-09-15T23:57:11.254189+0000","last_clean":"2024-09-15T23:57:11.254189+0000","last_became_active":"2024-09-15T23:57:10.267297+0000","last_became_peered":"2024-09-15T23:57:10.267297+0000","last_unstale":"2024-09-15T23:57:11.254189+0000","last_undegraded":"2024-09-15T23:57:11.254189+0000","last_fullsized":"2024-09-15T23:57:11.254189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:09.684075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254428+0000","last_change":"2024-09-15T23:57:09.245627+0000","last_active":"2024-09-15T23:57:11.254428+0000","last_peered":"2024-09-15T23:57:11.254428+0000","last_clean":"2024-09-15T23:57:11.254428+0000","last_became_active":"2024-09-15T23:57:09.245373+0000","last_became_peered":"2024-09-15T23:57:09.245373+0000","last_unstale":"2024-09-15T23:57:11.254428+0000","last_undegraded":"2024-09-15T23:57:11.254428+0000","last_fullsized":"2024-09-15T23:57:11.254428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254467+0000","last_change":"2024-09-15T23:57:10.270192+0000","last_active":"2024-09-15T23:57:11.254467+0000","last_peered":"2024-09-15T23:57:11.254467+0000","last_clean":"2024-09-15T23:57:11.254467+0000","last_became_active":"2024-09-15T23:57:10.269719+0000","last_became_peered":"2024-09-15T23:57:10.269719+0000","last_unstale":"2024-09-15T23:57:11.254467+0000","last_undegraded":"2024-09-15T23:57:11.254467+0000","last_fullsized":"2024-09-15T23:57:11.254467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:40.074265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254087+0000","last_change":"2024-09-15T23:57:09.253375+0000","last_active":"2024-09-15T23:57:11.254087+0000","last_peered":"2024-09-15T23:57:11.254087+0000","last_clean":"2024-09-15T23:57:11.254087+0000","last_became_active":"2024-09-15T23:57:09.253070+0000","last_became_peered":"2024-09-15T23:57:09.253070+0000","last_unstale":"2024-09-15T23:57:11.254087+0000","last_undegraded":"2024-09-15T23:57:11.254087+0000","last_fullsized":"2024-09-15T23:57:11.254087+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.017362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240827+0000","last_change":"2024-09-15T23:57:10.269327+0000","last_active":"2024-09-15T23:57:11.240827+0000","last_peered":"2024-09-15T23:57:11.240827+0000","last_clean":"2024-09-15T23:57:11.240827+0000","last_became_active":"2024-09-15T23:57:10.267727+0000","last_became_peered":"2024-09-15T23:57:10.267727+0000","last_unstale":"2024-09-15T23:57:11.240827+0000","last_undegraded":"2024-09-15T23:57:11.240827+0000","last_fullsized":"2024-09-15T23:57:11.240827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:50.676912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251210+0000","last_change":"2024-09-15T23:57:09.249942+0000","last_active":"2024-09-15T23:57:11.251210+0000","last_peered":"2024-09-15T23:57:11.251210+0000","last_clean":"2024-09-15T23:57:11.251210+0000","last_became_active":"2024-09-15T23:57:09.249628+0000","last_became_peered":"2024-09-15T23:57:09.249628+0000","last_unstale":"2024-09-15T23:57:11.251210+0000","last_undegraded":"2024-09-15T23:57:11.251210+0000","last_fullsized":"2024-09-15T23:57:11.251210+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:39.694228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239947+0000","last_change":"2024-09-15T23:57:10.253718+0000","last_active":"2024-09-15T23:57:11.239947+0000","last_peered":"2024-09-15T23:57:11.239947+0000","last_clean":"2024-09-15T23:57:11.239947+0000","last_became_active":"2024-09-15T23:57:10.251724+0000","last_became_peered":"2024-09-15T23:57:10.251724+0000","last_unstale":"2024-09-15T23:57:11.239947+0000","last_undegraded":"2024-09-15T23:57:11.239947+0000","last_fullsized":"2024-09-15T23:57:11.239947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:37.811192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250979+0000","last_change":"2024-09-15T23:57:09.249963+0000","last_active":"2024-09-15T23:57:11.250979+0000","last_peered":"2024-09-15T23:57:11.250979+0000","last_clean":"2024-09-15T23:57:11.250979+0000","last_became_active":"2024-09-15T23:57:09.249641+0000","last_became_peered":"2024-09-15T23:57:09.249641+0000","last_unstale":"2024-09-15T23:57:11.250979+0000","last_undegraded":"2024-09-15T23:57:11.250979+0000","last_fullsized":"2024-09-15T23:57:11.250979+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:34.888866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250863+0000","last_change":"2024-09-15T23:57:10.275041+0000","last_active":"2024-09-15T23:57:11.250863+0000","last_peered":"2024-09-15T23:57:11.250863+0000","last_clean":"2024-09-15T23:57:11.250863+0000","last_became_active":"2024-09-15T23:57:10.274599+0000","last_became_peered":"2024-09-15T23:57:10.274599+0000","last_unstale":"2024-09-15T23:57:11.250863+0000","last_undegraded":"2024-09-15T23:57:11.250863+0000","last_fullsized":"2024-09-15T23:57:11.250863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:33.888934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250873+0000","last_change":"2024-09-15T23:57:09.250958+0000","last_active":"2024-09-15T23:57:11.250873+0000","last_peered":"2024-09-15T23:57:11.250873+0000","last_clean":"2024-09-15T23:57:11.250873+0000","last_became_active":"2024-09-15T23:57:09.249973+0000","last_became_peered":"2024-09-15T23:57:09.249973+0000","last_unstale":"2024-09-15T23:57:11.250873+0000","last_undegraded":"2024-09-15T23:57:11.250873+0000","last_fullsized":"2024-09-15T23:57:11.250873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:40.452548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253725+0000","last_change":"2024-09-15T23:57:10.256447+0000","last_active":"2024-09-15T23:57:11.253725+0000","last_peered":"2024-09-15T23:57:11.253725+0000","last_clean":"2024-09-15T23:57:11.253725+0000","last_became_active":"2024-09-15T23:57:10.254570+0000","last_became_peered":"2024-09-15T23:57:10.254570+0000","last_unstale":"2024-09-15T23:57:11.253725+0000","last_undegraded":"2024-09-15T23:57:11.253725+0000","last_fullsized":"2024-09-15T23:57:11.253725+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:30.236610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250827+0000","last_change":"2024-09-15T23:57:09.251721+0000","last_active":"2024-09-15T23:57:11.250827+0000","last_peered":"2024-09-15T23:57:11.250827+0000","last_clean":"2024-09-15T23:57:11.250827+0000","last_became_active":"2024-09-15T23:57:09.251481+0000","last_became_peered":"2024-09-15T23:57:09.251481+0000","last_unstale":"2024-09-15T23:57:11.250827+0000","last_undegraded":"2024-09-15T23:57:11.250827+0000","last_fullsized":"2024-09-15T23:57:11.250827+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:58.521700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239735+0000","last_change":"2024-09-15T23:57:10.253377+0000","last_active":"2024-09-15T23:57:11.239735+0000","last_peered":"2024-09-15T23:57:11.239735+0000","last_clean":"2024-09-15T23:57:11.239735+0000","last_became_active":"2024-09-15T23:57:10.251740+0000","last_became_peered":"2024-09-15T23:57:10.251740+0000","last_unstale":"2024-09-15T23:57:11.239735+0000","last_undegraded":"2024-09-15T23:57:11.239735+0000","last_fullsized":"2024-09-15T23:57:11.239735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:03.921614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251268+0000","last_change":"2024-09-15T23:57:09.244108+0000","last_active":"2024-09-15T23:57:11.251268+0000","last_peered":"2024-09-15T23:57:11.251268+0000","last_clean":"2024-09-15T23:57:11.251268+0000","last_became_active":"2024-09-15T23:57:09.243867+0000","last_became_peered":"2024-09-15T23:57:09.243867+0000","last_unstale":"2024-09-15T23:57:11.251268+0000","last_undegraded":"2024-09-15T23:57:11.251268+0000","last_fullsized":"2024-09-15T23:57:11.251268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:57.838702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254336+0000","last_change":"2024-09-15T23:57:10.268174+0000","last_active":"2024-09-15T23:57:11.254336+0000","last_peered":"2024-09-15T23:57:11.254336+0000","last_clean":"2024-09-15T23:57:11.254336+0000","last_became_active":"2024-09-15T23:57:10.267625+0000","last_became_peered":"2024-09-15T23:57:10.267625+0000","last_unstale":"2024-09-15T23:57:11.254336+0000","last_undegraded":"2024-09-15T23:57:11.254336+0000","last_fullsized":"2024-09-15T23:57:11.254336+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:39.329537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251712+0000","last_change":"2024-09-15T23:57:09.252674+0000","last_active":"2024-09-15T23:57:11.251712+0000","last_peered":"2024-09-15T23:57:11.251712+0000","last_clean":"2024-09-15T23:57:11.251712+0000","last_became_active":"2024-09-15T23:57:09.252218+0000","last_became_peered":"2024-09-15T23:57:09.252218+0000","last_unstale":"2024-09-15T23:57:11.251712+0000","last_undegraded":"2024-09-15T23:57:11.251712+0000","last_fullsized":"2024-09-15T23:57:11.251712+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:03.649619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254457+0000","last_change":"2024-09-15T23:57:10.258727+0000","last_active":"2024-09-15T23:57:11.254457+0000","last_peered":"2024-09-15T23:57:11.254457+0000","last_clean":"2024-09-15T23:57:11.254457+0000","last_became_active":"2024-09-15T23:57:10.258366+0000","last_became_peered":"2024-09-15T23:57:10.258366+0000","last_unstale":"2024-09-15T23:57:11.254457+0000","last_undegraded":"2024-09-15T23:57:11.254457+0000","last_fullsized":"2024-09-15T23:57:11.254457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.454627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254514+0000","last_change":"2024-09-15T23:57:09.254493+0000","last_active":"2024-09-15T23:57:11.254514+0000","last_peered":"2024-09-15T23:57:11.254514+0000","last_clean":"2024-09-15T23:57:11.254514+0000","last_became_active":"2024-09-15T23:57:09.254237+0000","last_became_peered":"2024-09-15T23:57:09.254237+0000","last_unstale":"2024-09-15T23:57:11.254514+0000","last_undegraded":"2024-09-15T23:57:11.254514+0000","last_fullsized":"2024-09-15T23:57:11.254514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:55.181501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251063+0000","last_change":"2024-09-15T23:57:10.262174+0000","last_active":"2024-09-15T23:57:11.251063+0000","last_peered":"2024-09-15T23:57:11.251063+0000","last_clean":"2024-09-15T23:57:11.251063+0000","last_became_active":"2024-09-15T23:57:10.261248+0000","last_became_peered":"2024-09-15T23:57:10.261248+0000","last_unstale":"2024-09-15T23:57:11.251063+0000","last_undegraded":"2024-09-15T23:57:11.251063+0000","last_fullsized":"2024-09-15T23:57:11.251063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.757637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254153+0000","last_change":"2024-09-15T23:57:09.253477+0000","last_active":"2024-09-15T23:57:11.254153+0000","last_peered":"2024-09-15T23:57:11.254153+0000","last_clean":"2024-09-15T23:57:11.254153+0000","last_became_active":"2024-09-15T23:57:09.253101+0000","last_became_peered":"2024-09-15T23:57:09.253101+0000","last_unstale":"2024-09-15T23:57:11.254153+0000","last_undegraded":"2024-09-15T23:57:11.254153+0000","last_fullsized":"2024-09-15T23:57:11.254153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:14.328426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240957+0000","last_change":"2024-09-15T23:57:10.269074+0000","last_active":"2024-09-15T23:57:11.240957+0000","last_peered":"2024-09-15T23:57:11.240957+0000","last_clean":"2024-09-15T23:57:11.240957+0000","last_became_active":"2024-09-15T23:57:10.267359+0000","last_became_peered":"2024-09-15T23:57:10.267359+0000","last_unstale":"2024-09-15T23:57:11.240957+0000","last_undegraded":"2024-09-15T23:57:11.240957+0000","last_fullsized":"2024-09-15T23:57:11.240957+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:42.304840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240233+0000","last_change":"2024-09-15T23:57:09.242376+0000","last_active":"2024-09-15T23:57:11.240233+0000","last_peered":"2024-09-15T23:57:11.240233+0000","last_clean":"2024-09-15T23:57:11.240233+0000","last_became_active":"2024-09-15T23:57:09.242102+0000","last_became_peered":"2024-09-15T23:57:09.242102+0000","last_unstale":"2024-09-15T23:57:11.240233+0000","last_undegraded":"2024-09-15T23:57:11.240233+0000","last_fullsized":"2024-09-15T23:57:11.240233+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:13.352825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240619+0000","last_change":"2024-09-15T23:57:10.269449+0000","last_active":"2024-09-15T23:57:11.240619+0000","last_peered":"2024-09-15T23:57:11.240619+0000","last_clean":"2024-09-15T23:57:11.240619+0000","last_became_active":"2024-09-15T23:57:10.268211+0000","last_became_peered":"2024-09-15T23:57:10.268211+0000","last_unstale":"2024-09-15T23:57:11.240619+0000","last_undegraded":"2024-09-15T23:57:11.240619+0000","last_fullsized":"2024-09-15T23:57:11.240619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:15.490200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240039+0000","last_change":"2024-09-15T23:57:09.252363+0000","last_active":"2024-09-15T23:57:11.240039+0000","last_peered":"2024-09-15T23:57:11.240039+0000","last_clean":"2024-09-15T23:57:11.240039+0000","last_became_active":"2024-09-15T23:57:09.252104+0000","last_became_peered":"2024-09-15T23:57:09.252104+0000","last_unstale":"2024-09-15T23:57:11.240039+0000","last_undegraded":"2024-09-15T23:57:11.240039+0000","last_fullsized":"2024-09-15T23:57:11.240039+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:14.426492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239555+0000","last_change":"2024-09-15T23:57:10.248226+0000","last_active":"2024-09-15T23:57:11.239555+0000","last_peered":"2024-09-15T23:57:11.239555+0000","last_clean":"2024-09-15T23:57:11.239555+0000","last_became_active":"2024-09-15T23:57:10.247565+0000","last_became_peered":"2024-09-15T23:57:10.247565+0000","last_unstale":"2024-09-15T23:57:11.239555+0000","last_undegraded":"2024-09-15T23:57:11.239555+0000","last_fullsized":"2024-09-15T23:57:11.239555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.047590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254162+0000","last_change":"2024-09-15T23:57:09.244979+0000","last_active":"2024-09-15T23:57:11.254162+0000","last_peered":"2024-09-15T23:57:11.254162+0000","last_clean":"2024-09-15T23:57:11.254162+0000","last_became_active":"2024-09-15T23:57:09.244709+0000","last_became_peered":"2024-09-15T23:57:09.244709+0000","last_unstale":"2024-09-15T23:57:11.254162+0000","last_undegraded":"2024-09-15T23:57:11.254162+0000","last_fullsized":"2024-09-15T23:57:11.254162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:04.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239580+0000","last_change":"2024-09-15T23:57:10.248014+0000","last_active":"2024-09-15T23:57:11.239580+0000","last_peered":"2024-09-15T23:57:11.239580+0000","last_clean":"2024-09-15T23:57:11.239580+0000","last_became_active":"2024-09-15T23:57:10.247514+0000","last_became_peered":"2024-09-15T23:57:10.247514+0000","last_unstale":"2024-09-15T23:57:11.239580+0000","last_undegraded":"2024-09-15T23:57:11.239580+0000","last_fullsized":"2024-09-15T23:57:11.239580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:10.248049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253652+0000","last_change":"2024-09-15T23:57:09.254664+0000","last_active":"2024-09-15T23:57:11.253652+0000","last_peered":"2024-09-15T23:57:11.253652+0000","last_clean":"2024-09-15T23:57:11.253652+0000","last_became_active":"2024-09-15T23:57:09.254407+0000","last_became_peered":"2024-09-15T23:57:09.254407+0000","last_unstale":"2024-09-15T23:57:11.253652+0000","last_undegraded":"2024-09-15T23:57:11.253652+0000","last_fullsized":"2024-09-15T23:57:11.253652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:29.103861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254272+0000","last_change":"2024-09-15T23:57:10.260848+0000","last_active":"2024-09-15T23:57:11.254272+0000","last_peered":"2024-09-15T23:57:11.254272+0000","last_clean":"2024-09-15T23:57:11.254272+0000","last_became_active":"2024-09-15T23:57:10.255001+0000","last_became_peered":"2024-09-15T23:57:10.255001+0000","last_unstale":"2024-09-15T23:57:11.254272+0000","last_undegraded":"2024-09-15T23:57:11.254272+0000","last_fullsized":"2024-09-15T23:57:11.254272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:50.467455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254449+0000","last_change":"2024-09-15T23:57:09.254094+0000","last_active":"2024-09-15T23:57:11.254449+0000","last_peered":"2024-09-15T23:57:11.254449+0000","last_clean":"2024-09-15T23:57:11.254449+0000","last_became_active":"2024-09-15T23:57:09.253828+0000","last_became_peered":"2024-09-15T23:57:09.253828+0000","last_unstale":"2024-09-15T23:57:11.254449+0000","last_undegraded":"2024-09-15T23:57:11.254449+0000","last_fullsized":"2024-09-15T23:57:11.254449+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:48.882325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251619+0000","last_change":"2024-09-15T23:57:10.265601+0000","last_active":"2024-09-15T23:57:11.251619+0000","last_peered":"2024-09-15T23:57:11.251619+0000","last_clean":"2024-09-15T23:57:11.251619+0000","last_became_active":"2024-09-15T23:57:10.264485+0000","last_became_peered":"2024-09-15T23:57:10.264485+0000","last_unstale":"2024-09-15T23:57:11.251619+0000","last_undegraded":"2024-09-15T23:57:11.251619+0000","last_fullsized":"2024-09-15T23:57:11.251619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:51.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.252785+0000","last_change":"2024-09-15T23:57:09.249067+0000","last_active":"2024-09-15T23:57:11.252785+0000","last_peered":"2024-09-15T23:57:11.252785+0000","last_clean":"2024-09-15T23:57:11.252785+0000","last_became_active":"2024-09-15T23:57:09.248792+0000","last_became_peered":"2024-09-15T23:57:09.248792+0000","last_unstale":"2024-09-15T23:57:11.252785+0000","last_undegraded":"2024-09-15T23:57:11.252785+0000","last_fullsized":"2024-09-15T23:57:11.252785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:25.841265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254490+0000","last_change":"2024-09-15T23:57:10.256982+0000","last_active":"2024-09-15T23:57:11.254490+0000","last_peered":"2024-09-15T23:57:11.254490+0000","last_clean":"2024-09-15T23:57:11.254490+0000","last_became_active":"2024-09-15T23:57:10.256509+0000","last_became_peered":"2024-09-15T23:57:10.256509+0000","last_unstale":"2024-09-15T23:57:11.254490+0000","last_undegraded":"2024-09-15T23:57:11.254490+0000","last_fullsized":"2024-09-15T23:57:11.254490+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:37.752760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241123+0000","last_change":"2024-09-15T23:57:09.253097+0000","last_active":"2024-09-15T23:57:11.241123+0000","last_peered":"2024-09-15T23:57:11.241123+0000","last_clean":"2024-09-15T23:57:11.241123+0000","last_became_active":"2024-09-15T23:57:09.252216+0000","last_became_peered":"2024-09-15T23:57:09.252216+0000","last_unstale":"2024-09-15T23:57:11.241123+0000","last_undegraded":"2024-09-15T23:57:11.241123+0000","last_fullsized":"2024-09-15T23:57:11.241123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:30.012605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251394+0000","last_change":"2024-09-15T23:57:10.263232+0000","last_active":"2024-09-15T23:57:11.251394+0000","last_peered":"2024-09-15T23:57:11.251394+0000","last_clean":"2024-09-15T23:57:11.251394+0000","last_became_active":"2024-09-15T23:57:10.262946+0000","last_became_peered":"2024-09-15T23:57:10.262946+0000","last_unstale":"2024-09-15T23:57:11.251394+0000","last_undegraded":"2024-09-15T23:57:11.251394+0000","last_fullsized":"2024-09-15T23:57:11.251394+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:18.861312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254516+0000","last_change":"2024-09-15T23:57:09.254087+0000","last_active":"2024-09-15T23:57:11.254516+0000","last_peered":"2024-09-15T23:57:11.254516+0000","last_clean":"2024-09-15T23:57:11.254516+0000","last_became_active":"2024-09-15T23:57:09.253842+0000","last_became_peered":"2024-09-15T23:57:09.253842+0000","last_unstale":"2024-09-15T23:57:11.254516+0000","last_undegraded":"2024-09-15T23:57:11.254516+0000","last_fullsized":"2024-09-15T23:57:11.254516+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:33.714129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240083+0000","last_change":"2024-09-15T23:57:10.251416+0000","last_active":"2024-09-15T23:57:11.240083+0000","last_peered":"2024-09-15T23:57:11.240083+0000","last_clean":"2024-09-15T23:57:11.240083+0000","last_became_active":"2024-09-15T23:57:10.251170+0000","last_became_peered":"2024-09-15T23:57:10.251170+0000","last_unstale":"2024-09-15T23:57:11.240083+0000","last_undegraded":"2024-09-15T23:57:11.240083+0000","last_fullsized":"2024-09-15T23:57:11.240083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:16.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240720+0000","last_change":"2024-09-15T23:57:09.241443+0000","last_active":"2024-09-15T23:57:11.240720+0000","last_peered":"2024-09-15T23:57:11.240720+0000","last_clean":"2024-09-15T23:57:11.240720+0000","last_became_active":"2024-09-15T23:57:09.240436+0000","last_became_peered":"2024-09-15T23:57:09.240436+0000","last_unstale":"2024-09-15T23:57:11.240720+0000","last_undegraded":"2024-09-15T23:57:11.240720+0000","last_fullsized":"2024-09-15T23:57:11.240720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:36.494323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240716+0000","last_change":"2024-09-15T23:57:10.253185+0000","last_active":"2024-09-15T23:57:11.240716+0000","last_peered":"2024-09-15T23:57:11.240716+0000","last_clean":"2024-09-15T23:57:11.240716+0000","last_became_active":"2024-09-15T23:57:10.251823+0000","last_became_peered":"2024-09-15T23:57:10.251823+0000","last_unstale":"2024-09-15T23:57:11.240716+0000","last_undegraded":"2024-09-15T23:57:11.240716+0000","last_fullsized":"2024-09-15T23:57:11.240716+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:00.619599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250925+0000","last_change":"2024-09-15T23:57:09.251225+0000","last_active":"2024-09-15T23:57:11.250925+0000","last_peered":"2024-09-15T23:57:11.250925+0000","last_clean":"2024-09-15T23:57:11.250925+0000","last_became_active":"2024-09-15T23:57:09.249652+0000","last_became_peered":"2024-09-15T23:57:09.249652+0000","last_unstale":"2024-09-15T23:57:11.250925+0000","last_undegraded":"2024-09-15T23:57:11.250925+0000","last_fullsized":"2024-09-15T23:57:11.250925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:05.866322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251356+0000","last_change":"2024-09-15T23:57:10.262169+0000","last_active":"2024-09-15T23:57:11.251356+0000","last_peered":"2024-09-15T23:57:11.251356+0000","last_clean":"2024-09-15T23:57:11.251356+0000","last_became_active":"2024-09-15T23:57:10.260480+0000","last_became_peered":"2024-09-15T23:57:10.260480+0000","last_unstale":"2024-09-15T23:57:11.251356+0000","last_undegraded":"2024-09-15T23:57:11.251356+0000","last_fullsized":"2024-09-15T23:57:11.251356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:05.872651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254249+0000","last_change":"2024-09-15T23:57:09.245006+0000","last_active":"2024-09-15T23:57:11.254249+0000","last_peered":"2024-09-15T23:57:11.254249+0000","last_clean":"2024-09-15T23:57:11.254249+0000","last_became_active":"2024-09-15T23:57:09.244744+0000","last_became_peered":"2024-09-15T23:57:09.244744+0000","last_unstale":"2024-09-15T23:57:11.254249+0000","last_undegraded":"2024-09-15T23:57:11.254249+0000","last_fullsized":"2024-09-15T23:57:11.254249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:23.964729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254060+0000","last_change":"2024-09-15T23:57:10.269146+0000","last_active":"2024-09-15T23:57:11.254060+0000","last_peered":"2024-09-15T23:57:11.254060+0000","last_clean":"2024-09-15T23:57:11.254060+0000","last_became_active":"2024-09-15T23:57:10.268874+0000","last_became_peered":"2024-09-15T23:57:10.268874+0000","last_unstale":"2024-09-15T23:57:11.254060+0000","last_undegraded":"2024-09-15T23:57:11.254060+0000","last_fullsized":"2024-09-15T23:57:11.254060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:45.982264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239650+0000","last_change":"2024-09-15T23:57:09.243369+0000","last_active":"2024-09-15T23:57:11.239650+0000","last_peered":"2024-09-15T23:57:11.239650+0000","last_clean":"2024-09-15T23:57:11.239650+0000","last_became_active":"2024-09-15T23:57:09.242790+0000","last_became_peered":"2024-09-15T23:57:09.242790+0000","last_unstale":"2024-09-15T23:57:11.239650+0000","last_undegraded":"2024-09-15T23:57:11.239650+0000","last_fullsized":"2024-09-15T23:57:11.239650+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:47.312694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250780+0000","last_change":"2024-09-15T23:57:10.261141+0000","last_active":"2024-09-15T23:57:11.250780+0000","last_peered":"2024-09-15T23:57:11.250780+0000","last_clean":"2024-09-15T23:57:11.250780+0000","last_became_active":"2024-09-15T23:57:10.260825+0000","last_became_peered":"2024-09-15T23:57:10.260825+0000","last_unstale":"2024-09-15T23:57:11.250780+0000","last_undegraded":"2024-09-15T23:57:11.250780+0000","last_fullsized":"2024-09-15T23:57:11.250780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:53.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251090+0000","last_change":"2024-09-15T23:57:09.249324+0000","last_active":"2024-09-15T23:57:11.251090+0000","last_peered":"2024-09-15T23:57:11.251090+0000","last_clean":"2024-09-15T23:57:11.251090+0000","last_became_active":"2024-09-15T23:57:09.249068+0000","last_became_peered":"2024-09-15T23:57:09.249068+0000","last_unstale":"2024-09-15T23:57:11.251090+0000","last_undegraded":"2024-09-15T23:57:11.251090+0000","last_fullsized":"2024-09-15T23:57:11.251090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:17.870650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"46'141","reported_seq":379,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251378+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:11.251378+0000","last_peered":"2024-09-15T23:57:11.251378+0000","last_clean":"2024-09-15T23:57:11.251378+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:11.251378+0000","last_undegraded":"2024-09-15T23:57:11.251378+0000","last_fullsized":"2024-09-15T23:57:11.251378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":561152,"data_stored":206528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":796736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":794646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:13.163 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:13.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.298+0000 7f87b1bc4640 1 Processor -- start 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.298+0000 7f87b1bc4640 1 -- start start 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.298+0000 7f87b1bc4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87ac135f30 0x7f87ac13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.298+0000 7f87b1bc4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87ac0a08c0 con 0x7f87ac135b50 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.298+0000 7f87b1bc4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f87ac09b310 con 0x7f87ac135f30 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87aaffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f87ac135f30 0x7f87ac13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87ab7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f87ac135b50 0x7f87ac09aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55190/0 (socket says 172.21.15.121:55190) 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87ab7fe640 1 -- 172.21.15.121:0/575656782 learned_addr learned my addr 172.21.15.121:0/575656782 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87aaffd640 1 -- 172.21.15.121:0/575656782 >> v1:172.21.15.121:6789/0 conn(0x7f87ac135b50 legacy=0x7f87ac09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87aa7fc640 1 -- 172.21.15.121:0/575656782 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660831212 0 0) 0x7f87ac0a08c0 con 0x7f87ac135b50 2024-09-15T23:57:13.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.299+0000 7f87aaffd640 1 -- 172.21.15.121:0/575656782 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac0a2270 con 0x7f87ac135f30 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87aaffd640 1 --2- 172.21.15.121:0/575656782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135f30 0x7f87ac13bb80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8794009720 tx=0x7f879402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f382bb764c0ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87aa7fc640 1 -- 172.21.15.121:0/575656782 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8794037070 con 0x7f87ac135f30 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87aa7fc640 1 -- 172.21.15.121:0/575656782 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879402ae20 con 0x7f87ac135f30 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87aa7fc640 1 -- 172.21.15.121:0/575656782 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8794032590 con 0x7f87ac135f30 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 -- 172.21.15.121:0/575656782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135f30 msgr2=0x7f87ac13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/575656782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135f30 0x7f87ac13bb80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8794009720 tx=0x7f879402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 -- 172.21.15.121:0/575656782 shutdown_connections 2024-09-15T23:57:13.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/575656782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135f30 0x7f87ac13bb80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 -- 172.21.15.121:0/575656782 >> 172.21.15.121:0/575656782 conn(0x7f87ac0a85e0 msgr2=0x7f87ac0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 -- 172.21.15.121:0/575656782 shutdown_connections 2024-09-15T23:57:13.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.300+0000 7f87b1bc4640 1 -- 172.21.15.121:0/575656782 wait complete. 2024-09-15T23:57:13.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.301+0000 7f87b1bc4640 1 Processor -- start 2024-09-15T23:57:13.303 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.301+0000 7f87b1bc4640 1 -- start start 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87b1bc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87b1bc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87ac136350 con 0x7f87ac135b50 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87ab7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52300/0 (socket says 172.21.15.121:52300) 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87ab7fe640 1 -- 172.21.15.121:0/2396692619 learned_addr learned my addr 172.21.15.121:0/2396692619 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87ab7fe640 1 -- 172.21.15.121:0/2396692619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ac11fbe0 con 0x7f87ac135b50 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87ab7fe640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c420 tx=0x7f879c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.302+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f879c018070 con 0x7f87ac135b50 2024-09-15T23:57:13.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879c0074d0 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ac126060 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f879c004950 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ac120870 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f879c01b070 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.303+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ac09aae0 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.304+0000 7f87a3fff640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 0x7f878c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.304+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f879c04a5d0 con 0x7f87ac135b50 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.304+0000 7f87aaffd640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 0x7f878c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.306 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.304+0000 7f87aaffd640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 0x7f878c03a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8794034000 tx=0x7f879402e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.308+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f879c011950 con 0x7f87ac135b50 2024-09-15T23:57:13.471 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.470+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 --> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87ac0a2c40 con 0x7f878c038250 2024-09-15T23:57:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.476+0000 7f87a3fff640 1 -- 172.21.15.121:0/2396692619 <== mgr.4716 v2:172.21.15.121:6828/3810060514 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246083 (secure 0 0 0) 0x7f87ac0a2c40 con 0x7f878c038250 2024-09-15T23:57:13.479 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 msgr2=0x7f878c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 0x7f878c03a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8794034000 tx=0x7f879402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 msgr2=0x7f87ac11ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f879c00c420 tx=0x7f879c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 shutdown_connections 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f878c038250 0x7f878c03a710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 --2- 172.21.15.121:0/2396692619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87ac135b50 0x7f87ac11ea60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 >> 172.21.15.121:0/2396692619 conn(0x7f87ac0a85e0 msgr2=0x7f87ac09d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 shutdown_connections 2024-09-15T23:57:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.479+0000 7f87b1bc4640 1 -- 172.21.15.121:0/2396692619 wait complete. 2024-09-15T23:57:13.491 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T23:57:13.320292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":262,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":180,"ondisk_log_size":180,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":96344,"kb_used_data":2772,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283019176,"statfs":{"total":289910292480,"available":289811636224,"internally_reserved":0,"allocated":2838528,"data_stored":1797910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.094961"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251427+0000","last_change":"2024-09-15T23:57:10.253021+0000","last_active":"2024-09-15T23:57:11.251427+0000","last_peered":"2024-09-15T23:57:11.251427+0000","last_clean":"2024-09-15T23:57:11.251427+0000","last_became_active":"2024-09-15T23:57:10.250940+0000","last_became_peered":"2024-09-15T23:57:10.250940+0000","last_unstale":"2024-09-15T23:57:11.251427+0000","last_undegraded":"2024-09-15T23:57:11.251427+0000","last_fullsized":"2024-09-15T23:57:11.251427+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:04.614721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254072+0000","last_change":"2024-09-15T23:57:10.268371+0000","last_active":"2024-09-15T23:57:11.254072+0000","last_peered":"2024-09-15T23:57:11.254072+0000","last_clean":"2024-09-15T23:57:11.254072+0000","last_became_active":"2024-09-15T23:57:10.267939+0000","last_became_peered":"2024-09-15T23:57:10.267939+0000","last_unstale":"2024-09-15T23:57:11.254072+0000","last_undegraded":"2024-09-15T23:57:11.254072+0000","last_fullsized":"2024-09-15T23:57:11.254072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:19.097276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241134+0000","last_change":"2024-09-15T23:57:10.252759+0000","last_active":"2024-09-15T23:57:11.241134+0000","last_peered":"2024-09-15T23:57:11.241134+0000","last_clean":"2024-09-15T23:57:11.241134+0000","last_became_active":"2024-09-15T23:57:10.252511+0000","last_became_peered":"2024-09-15T23:57:10.252511+0000","last_unstale":"2024-09-15T23:57:11.241134+0000","last_undegraded":"2024-09-15T23:57:11.241134+0000","last_fullsized":"2024-09-15T23:57:11.241134+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:27.982986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250913+0000","last_change":"2024-09-15T23:57:10.262516+0000","last_active":"2024-09-15T23:57:11.250913+0000","last_peered":"2024-09-15T23:57:11.250913+0000","last_clean":"2024-09-15T23:57:11.250913+0000","last_became_active":"2024-09-15T23:57:10.261919+0000","last_became_peered":"2024-09-15T23:57:10.261919+0000","last_unstale":"2024-09-15T23:57:11.250913+0000","last_undegraded":"2024-09-15T23:57:11.250913+0000","last_fullsized":"2024-09-15T23:57:11.250913+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:15.524185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240424+0000","last_change":"2024-09-15T23:57:10.251619+0000","last_active":"2024-09-15T23:57:11.240424+0000","last_peered":"2024-09-15T23:57:11.240424+0000","last_clean":"2024-09-15T23:57:11.240424+0000","last_became_active":"2024-09-15T23:57:10.251343+0000","last_became_peered":"2024-09-15T23:57:10.251343+0000","last_unstale":"2024-09-15T23:57:11.240424+0000","last_undegraded":"2024-09-15T23:57:11.240424+0000","last_fullsized":"2024-09-15T23:57:11.240424+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:38.889221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239795+0000","last_change":"2024-09-15T23:57:10.255372+0000","last_active":"2024-09-15T23:57:11.239795+0000","last_peered":"2024-09-15T23:57:11.239795+0000","last_clean":"2024-09-15T23:57:11.239795+0000","last_became_active":"2024-09-15T23:57:10.253090+0000","last_became_peered":"2024-09-15T23:57:10.253090+0000","last_unstale":"2024-09-15T23:57:11.239795+0000","last_undegraded":"2024-09-15T23:57:11.239795+0000","last_fullsized":"2024-09-15T23:57:11.239795+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:28.878800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250649+0000","last_change":"2024-09-15T23:57:10.250332+0000","last_active":"2024-09-15T23:57:11.250649+0000","last_peered":"2024-09-15T23:57:11.250649+0000","last_clean":"2024-09-15T23:57:11.250649+0000","last_became_active":"2024-09-15T23:57:10.250112+0000","last_became_peered":"2024-09-15T23:57:10.250112+0000","last_unstale":"2024-09-15T23:57:11.250649+0000","last_undegraded":"2024-09-15T23:57:11.250649+0000","last_fullsized":"2024-09-15T23:57:11.250649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:16.253044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253419+0000","last_change":"2024-09-15T23:57:10.268663+0000","last_active":"2024-09-15T23:57:11.253419+0000","last_peered":"2024-09-15T23:57:11.253419+0000","last_clean":"2024-09-15T23:57:11.253419+0000","last_became_active":"2024-09-15T23:57:10.268404+0000","last_became_peered":"2024-09-15T23:57:10.268404+0000","last_unstale":"2024-09-15T23:57:11.253419+0000","last_undegraded":"2024-09-15T23:57:11.253419+0000","last_fullsized":"2024-09-15T23:57:11.253419+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:52.744139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240097+0000","last_change":"2024-09-15T23:57:10.250818+0000","last_active":"2024-09-15T23:57:11.240097+0000","last_peered":"2024-09-15T23:57:11.240097+0000","last_clean":"2024-09-15T23:57:11.240097+0000","last_became_active":"2024-09-15T23:57:10.250408+0000","last_became_peered":"2024-09-15T23:57:10.250408+0000","last_unstale":"2024-09-15T23:57:11.240097+0000","last_undegraded":"2024-09-15T23:57:11.240097+0000","last_fullsized":"2024-09-15T23:57:11.240097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:42.836566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251459+0000","last_change":"2024-09-15T23:57:10.262404+0000","last_active":"2024-09-15T23:57:11.251459+0000","last_peered":"2024-09-15T23:57:11.251459+0000","last_clean":"2024-09-15T23:57:11.251459+0000","last_became_active":"2024-09-15T23:57:10.261697+0000","last_became_peered":"2024-09-15T23:57:10.261697+0000","last_unstale":"2024-09-15T23:57:11.251459+0000","last_undegraded":"2024-09-15T23:57:11.251459+0000","last_fullsized":"2024-09-15T23:57:11.251459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:55.169859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253898+0000","last_change":"2024-09-15T23:57:10.265246+0000","last_active":"2024-09-15T23:57:11.253898+0000","last_peered":"2024-09-15T23:57:11.253898+0000","last_clean":"2024-09-15T23:57:11.253898+0000","last_became_active":"2024-09-15T23:57:10.264997+0000","last_became_peered":"2024-09-15T23:57:10.264997+0000","last_unstale":"2024-09-15T23:57:11.253898+0000","last_undegraded":"2024-09-15T23:57:11.253898+0000","last_fullsized":"2024-09-15T23:57:11.253898+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:36.847406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251029+0000","last_change":"2024-09-15T23:57:10.262308+0000","last_active":"2024-09-15T23:57:11.251029+0000","last_peered":"2024-09-15T23:57:11.251029+0000","last_clean":"2024-09-15T23:57:11.251029+0000","last_became_active":"2024-09-15T23:57:10.261588+0000","last_became_peered":"2024-09-15T23:57:10.261588+0000","last_unstale":"2024-09-15T23:57:11.251029+0000","last_undegraded":"2024-09-15T23:57:11.251029+0000","last_fullsized":"2024-09-15T23:57:11.251029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:20.084517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254076+0000","last_change":"2024-09-15T23:57:10.268397+0000","last_active":"2024-09-15T23:57:11.254076+0000","last_peered":"2024-09-15T23:57:11.254076+0000","last_clean":"2024-09-15T23:57:11.254076+0000","last_became_active":"2024-09-15T23:57:10.268167+0000","last_became_peered":"2024-09-15T23:57:10.268167+0000","last_unstale":"2024-09-15T23:57:11.254076+0000","last_undegraded":"2024-09-15T23:57:11.254076+0000","last_fullsized":"2024-09-15T23:57:11.254076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:27.161661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239607+0000","last_change":"2024-09-15T23:57:10.267301+0000","last_active":"2024-09-15T23:57:11.239607+0000","last_peered":"2024-09-15T23:57:11.239607+0000","last_clean":"2024-09-15T23:57:11.239607+0000","last_became_active":"2024-09-15T23:57:10.267014+0000","last_became_peered":"2024-09-15T23:57:10.267014+0000","last_unstale":"2024-09-15T23:57:11.239607+0000","last_undegraded":"2024-09-15T23:57:11.239607+0000","last_fullsized":"2024-09-15T23:57:11.239607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:43.470787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254423+0000","last_change":"2024-09-15T23:57:10.265214+0000","last_active":"2024-09-15T23:57:11.254423+0000","last_peered":"2024-09-15T23:57:11.254423+0000","last_clean":"2024-09-15T23:57:11.254423+0000","last_became_active":"2024-09-15T23:57:10.264946+0000","last_became_peered":"2024-09-15T23:57:10.264946+0000","last_unstale":"2024-09-15T23:57:11.254423+0000","last_undegraded":"2024-09-15T23:57:11.254423+0000","last_fullsized":"2024-09-15T23:57:11.254423+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:24.626723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239405+0000","last_change":"2024-09-15T23:57:10.255737+0000","last_active":"2024-09-15T23:57:11.239405+0000","last_peered":"2024-09-15T23:57:11.239405+0000","last_clean":"2024-09-15T23:57:11.239405+0000","last_became_active":"2024-09-15T23:57:10.255466+0000","last_became_peered":"2024-09-15T23:57:10.255466+0000","last_unstale":"2024-09-15T23:57:11.239405+0000","last_undegraded":"2024-09-15T23:57:11.239405+0000","last_fullsized":"2024-09-15T23:57:11.239405+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:06.911915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240244+0000","last_change":"2024-09-15T23:57:10.266584+0000","last_active":"2024-09-15T23:57:11.240244+0000","last_peered":"2024-09-15T23:57:11.240244+0000","last_clean":"2024-09-15T23:57:11.240244+0000","last_became_active":"2024-09-15T23:57:10.266276+0000","last_became_peered":"2024-09-15T23:57:10.266276+0000","last_unstale":"2024-09-15T23:57:11.240244+0000","last_undegraded":"2024-09-15T23:57:11.240244+0000","last_fullsized":"2024-09-15T23:57:11.240244+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:18.710870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251540+0000","last_change":"2024-09-15T23:57:10.262189+0000","last_active":"2024-09-15T23:57:11.251540+0000","last_peered":"2024-09-15T23:57:11.251540+0000","last_clean":"2024-09-15T23:57:11.251540+0000","last_became_active":"2024-09-15T23:57:10.261371+0000","last_became_peered":"2024-09-15T23:57:10.261371+0000","last_unstale":"2024-09-15T23:57:11.251540+0000","last_undegraded":"2024-09-15T23:57:11.251540+0000","last_fullsized":"2024-09-15T23:57:11.251540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:34.658773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240685+0000","last_change":"2024-09-15T23:57:10.274407+0000","last_active":"2024-09-15T23:57:11.240685+0000","last_peered":"2024-09-15T23:57:11.240685+0000","last_clean":"2024-09-15T23:57:11.240685+0000","last_became_active":"2024-09-15T23:57:10.273884+0000","last_became_peered":"2024-09-15T23:57:10.273884+0000","last_unstale":"2024-09-15T23:57:11.240685+0000","last_undegraded":"2024-09-15T23:57:11.240685+0000","last_fullsized":"2024-09-15T23:57:11.240685+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:32.511264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254347+0000","last_change":"2024-09-15T23:57:10.264483+0000","last_active":"2024-09-15T23:57:11.254347+0000","last_peered":"2024-09-15T23:57:11.254347+0000","last_clean":"2024-09-15T23:57:11.254347+0000","last_became_active":"2024-09-15T23:57:10.264208+0000","last_became_peered":"2024-09-15T23:57:10.264208+0000","last_unstale":"2024-09-15T23:57:11.254347+0000","last_undegraded":"2024-09-15T23:57:11.254347+0000","last_fullsized":"2024-09-15T23:57:11.254347+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:35.765556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254250+0000","last_change":"2024-09-15T23:57:10.258729+0000","last_active":"2024-09-15T23:57:11.254250+0000","last_peered":"2024-09-15T23:57:11.254250+0000","last_clean":"2024-09-15T23:57:11.254250+0000","last_became_active":"2024-09-15T23:57:10.257255+0000","last_became_peered":"2024-09-15T23:57:10.257255+0000","last_unstale":"2024-09-15T23:57:11.254250+0000","last_undegraded":"2024-09-15T23:57:11.254250+0000","last_fullsized":"2024-09-15T23:57:11.254250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:08.185422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239753+0000","last_change":"2024-09-15T23:57:10.249811+0000","last_active":"2024-09-15T23:57:11.239753+0000","last_peered":"2024-09-15T23:57:11.239753+0000","last_clean":"2024-09-15T23:57:11.239753+0000","last_became_active":"2024-09-15T23:57:10.249513+0000","last_became_peered":"2024-09-15T23:57:10.249513+0000","last_unstale":"2024-09-15T23:57:11.239753+0000","last_undegraded":"2024-09-15T23:57:11.239753+0000","last_fullsized":"2024-09-15T23:57:11.239753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:38.523276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250655+0000","last_change":"2024-09-15T23:57:10.264976+0000","last_active":"2024-09-15T23:57:11.250655+0000","last_peered":"2024-09-15T23:57:11.250655+0000","last_clean":"2024-09-15T23:57:11.250655+0000","last_became_active":"2024-09-15T23:57:10.264726+0000","last_became_peered":"2024-09-15T23:57:10.264726+0000","last_unstale":"2024-09-15T23:57:11.250655+0000","last_undegraded":"2024-09-15T23:57:11.250655+0000","last_fullsized":"2024-09-15T23:57:11.250655+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:57.984243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253488+0000","last_change":"2024-09-15T23:57:10.265643+0000","last_active":"2024-09-15T23:57:11.253488+0000","last_peered":"2024-09-15T23:57:11.253488+0000","last_clean":"2024-09-15T23:57:11.253488+0000","last_became_active":"2024-09-15T23:57:10.265330+0000","last_became_peered":"2024-09-15T23:57:10.265330+0000","last_unstale":"2024-09-15T23:57:11.253488+0000","last_undegraded":"2024-09-15T23:57:11.253488+0000","last_fullsized":"2024-09-15T23:57:11.253488+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:24.127300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251540+0000","last_change":"2024-09-15T23:57:10.265808+0000","last_active":"2024-09-15T23:57:11.251540+0000","last_peered":"2024-09-15T23:57:11.251540+0000","last_clean":"2024-09-15T23:57:11.251540+0000","last_became_active":"2024-09-15T23:57:10.265102+0000","last_became_peered":"2024-09-15T23:57:10.265102+0000","last_unstale":"2024-09-15T23:57:11.251540+0000","last_undegraded":"2024-09-15T23:57:11.251540+0000","last_fullsized":"2024-09-15T23:57:11.251540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:26.554384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251570+0000","last_change":"2024-09-15T23:57:10.261975+0000","last_active":"2024-09-15T23:57:11.251570+0000","last_peered":"2024-09-15T23:57:11.251570+0000","last_clean":"2024-09-15T23:57:11.251570+0000","last_became_active":"2024-09-15T23:57:10.261041+0000","last_became_peered":"2024-09-15T23:57:10.261041+0000","last_unstale":"2024-09-15T23:57:11.251570+0000","last_undegraded":"2024-09-15T23:57:11.251570+0000","last_fullsized":"2024-09-15T23:57:11.251570+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:16.063265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254035+0000","last_change":"2024-09-15T23:57:10.269367+0000","last_active":"2024-09-15T23:57:11.254035+0000","last_peered":"2024-09-15T23:57:11.254035+0000","last_clean":"2024-09-15T23:57:11.254035+0000","last_became_active":"2024-09-15T23:57:10.268669+0000","last_became_peered":"2024-09-15T23:57:10.268669+0000","last_unstale":"2024-09-15T23:57:11.254035+0000","last_undegraded":"2024-09-15T23:57:11.254035+0000","last_fullsized":"2024-09-15T23:57:11.254035+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:31.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254329+0000","last_change":"2024-09-15T23:57:10.269427+0000","last_active":"2024-09-15T23:57:11.254329+0000","last_peered":"2024-09-15T23:57:11.254329+0000","last_clean":"2024-09-15T23:57:11.254329+0000","last_became_active":"2024-09-15T23:57:10.265561+0000","last_became_peered":"2024-09-15T23:57:10.265561+0000","last_unstale":"2024-09-15T23:57:11.254329+0000","last_undegraded":"2024-09-15T23:57:11.254329+0000","last_fullsized":"2024-09-15T23:57:11.254329+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:17.620084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251043+0000","last_change":"2024-09-15T23:57:10.263183+0000","last_active":"2024-09-15T23:57:11.251043+0000","last_peered":"2024-09-15T23:57:11.251043+0000","last_clean":"2024-09-15T23:57:11.251043+0000","last_became_active":"2024-09-15T23:57:10.262428+0000","last_became_peered":"2024-09-15T23:57:10.262428+0000","last_unstale":"2024-09-15T23:57:11.251043+0000","last_undegraded":"2024-09-15T23:57:11.251043+0000","last_fullsized":"2024-09-15T23:57:11.251043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:20.906195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250713+0000","last_change":"2024-09-15T23:57:10.263032+0000","last_active":"2024-09-15T23:57:11.250713+0000","last_peered":"2024-09-15T23:57:11.250713+0000","last_clean":"2024-09-15T23:57:11.250713+0000","last_became_active":"2024-09-15T23:57:10.262764+0000","last_became_peered":"2024-09-15T23:57:10.262764+0000","last_unstale":"2024-09-15T23:57:11.250713+0000","last_undegraded":"2024-09-15T23:57:11.250713+0000","last_fullsized":"2024-09-15T23:57:11.250713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:02.413822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253643+0000","last_change":"2024-09-15T23:57:10.255422+0000","last_active":"2024-09-15T23:57:11.253643+0000","last_peered":"2024-09-15T23:57:11.253643+0000","last_clean":"2024-09-15T23:57:11.253643+0000","last_became_active":"2024-09-15T23:57:10.253167+0000","last_became_peered":"2024-09-15T23:57:10.253167+0000","last_unstale":"2024-09-15T23:57:11.253643+0000","last_undegraded":"2024-09-15T23:57:11.253643+0000","last_fullsized":"2024-09-15T23:57:11.253643+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:40.542405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253560+0000","last_change":"2024-09-15T23:57:10.265557+0000","last_active":"2024-09-15T23:57:11.253560+0000","last_peered":"2024-09-15T23:57:11.253560+0000","last_clean":"2024-09-15T23:57:11.253560+0000","last_became_active":"2024-09-15T23:57:10.264986+0000","last_became_peered":"2024-09-15T23:57:10.264986+0000","last_unstale":"2024-09-15T23:57:11.253560+0000","last_undegraded":"2024-09-15T23:57:11.253560+0000","last_fullsized":"2024-09-15T23:57:11.253560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:45.090116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240294+0000","last_change":"2024-09-15T23:57:10.251218+0000","last_active":"2024-09-15T23:57:11.240294+0000","last_peered":"2024-09-15T23:57:11.240294+0000","last_clean":"2024-09-15T23:57:11.240294+0000","last_became_active":"2024-09-15T23:57:10.250839+0000","last_became_peered":"2024-09-15T23:57:10.250839+0000","last_unstale":"2024-09-15T23:57:11.240294+0000","last_undegraded":"2024-09-15T23:57:11.240294+0000","last_fullsized":"2024-09-15T23:57:11.240294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.275859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240403+0000","last_change":"2024-09-15T23:57:09.245124+0000","last_active":"2024-09-15T23:57:11.240403+0000","last_peered":"2024-09-15T23:57:11.240403+0000","last_clean":"2024-09-15T23:57:11.240403+0000","last_became_active":"2024-09-15T23:57:09.244022+0000","last_became_peered":"2024-09-15T23:57:09.244022+0000","last_unstale":"2024-09-15T23:57:11.240403+0000","last_undegraded":"2024-09-15T23:57:11.240403+0000","last_fullsized":"2024-09-15T23:57:11.240403+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:05.001211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240374+0000","last_change":"2024-09-15T23:57:10.266440+0000","last_active":"2024-09-15T23:57:11.240374+0000","last_peered":"2024-09-15T23:57:11.240374+0000","last_clean":"2024-09-15T23:57:11.240374+0000","last_became_active":"2024-09-15T23:57:10.266162+0000","last_became_peered":"2024-09-15T23:57:10.266162+0000","last_unstale":"2024-09-15T23:57:11.240374+0000","last_undegraded":"2024-09-15T23:57:11.240374+0000","last_fullsized":"2024-09-15T23:57:11.240374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:31.983353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254401+0000","last_change":"2024-09-15T23:57:09.244612+0000","last_active":"2024-09-15T23:57:11.254401+0000","last_peered":"2024-09-15T23:57:11.254401+0000","last_clean":"2024-09-15T23:57:11.254401+0000","last_became_active":"2024-09-15T23:57:09.244359+0000","last_became_peered":"2024-09-15T23:57:09.244359+0000","last_unstale":"2024-09-15T23:57:11.254401+0000","last_undegraded":"2024-09-15T23:57:11.254401+0000","last_fullsized":"2024-09-15T23:57:11.254401+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:45.157834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240156+0000","last_change":"2024-09-15T23:57:10.255423+0000","last_active":"2024-09-15T23:57:11.240156+0000","last_peered":"2024-09-15T23:57:11.240156+0000","last_clean":"2024-09-15T23:57:11.240156+0000","last_became_active":"2024-09-15T23:57:10.253503+0000","last_became_peered":"2024-09-15T23:57:10.253503+0000","last_unstale":"2024-09-15T23:57:11.240156+0000","last_undegraded":"2024-09-15T23:57:11.240156+0000","last_fullsized":"2024-09-15T23:57:11.240156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:45.791418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241044+0000","last_change":"2024-09-15T23:57:09.245650+0000","last_active":"2024-09-15T23:57:11.241044+0000","last_peered":"2024-09-15T23:57:11.241044+0000","last_clean":"2024-09-15T23:57:11.241044+0000","last_became_active":"2024-09-15T23:57:09.245403+0000","last_became_peered":"2024-09-15T23:57:09.245403+0000","last_unstale":"2024-09-15T23:57:11.241044+0000","last_undegraded":"2024-09-15T23:57:11.241044+0000","last_fullsized":"2024-09-15T23:57:11.241044+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:11.555250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251289+0000","last_change":"2024-09-15T23:57:10.268543+0000","last_active":"2024-09-15T23:57:11.251289+0000","last_peered":"2024-09-15T23:57:11.251289+0000","last_clean":"2024-09-15T23:57:11.251289+0000","last_became_active":"2024-09-15T23:57:10.268294+0000","last_became_peered":"2024-09-15T23:57:10.268294+0000","last_unstale":"2024-09-15T23:57:11.251289+0000","last_undegraded":"2024-09-15T23:57:11.251289+0000","last_fullsized":"2024-09-15T23:57:11.251289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:51:17.731744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240030+0000","last_change":"2024-09-15T23:57:09.242724+0000","last_active":"2024-09-15T23:57:11.240030+0000","last_peered":"2024-09-15T23:57:11.240030+0000","last_clean":"2024-09-15T23:57:11.240030+0000","last_became_active":"2024-09-15T23:57:09.242475+0000","last_became_peered":"2024-09-15T23:57:09.242475+0000","last_unstale":"2024-09-15T23:57:11.240030+0000","last_undegraded":"2024-09-15T23:57:11.240030+0000","last_fullsized":"2024-09-15T23:57:11.240030+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:33.905515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239920+0000","last_change":"2024-09-15T23:57:10.255581+0000","last_active":"2024-09-15T23:57:11.239920+0000","last_peered":"2024-09-15T23:57:11.239920+0000","last_clean":"2024-09-15T23:57:11.239920+0000","last_became_active":"2024-09-15T23:57:10.253442+0000","last_became_peered":"2024-09-15T23:57:10.253442+0000","last_unstale":"2024-09-15T23:57:11.239920+0000","last_undegraded":"2024-09-15T23:57:11.239920+0000","last_fullsized":"2024-09-15T23:57:11.239920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:51.460744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240673+0000","last_change":"2024-09-15T23:57:09.241567+0000","last_active":"2024-09-15T23:57:11.240673+0000","last_peered":"2024-09-15T23:57:11.240673+0000","last_clean":"2024-09-15T23:57:11.240673+0000","last_became_active":"2024-09-15T23:57:09.241269+0000","last_became_peered":"2024-09-15T23:57:09.241269+0000","last_unstale":"2024-09-15T23:57:11.240673+0000","last_undegraded":"2024-09-15T23:57:11.240673+0000","last_fullsized":"2024-09-15T23:57:11.240673+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:47.093140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240580+0000","last_change":"2024-09-15T23:57:10.269051+0000","last_active":"2024-09-15T23:57:11.240580+0000","last_peered":"2024-09-15T23:57:11.240580+0000","last_clean":"2024-09-15T23:57:11.240580+0000","last_became_active":"2024-09-15T23:57:10.268560+0000","last_became_peered":"2024-09-15T23:57:10.268560+0000","last_unstale":"2024-09-15T23:57:11.240580+0000","last_undegraded":"2024-09-15T23:57:11.240580+0000","last_fullsized":"2024-09-15T23:57:11.240580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:51.850597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250818+0000","last_change":"2024-09-15T23:57:09.251183+0000","last_active":"2024-09-15T23:57:11.250818+0000","last_peered":"2024-09-15T23:57:11.250818+0000","last_clean":"2024-09-15T23:57:11.250818+0000","last_became_active":"2024-09-15T23:57:09.250102+0000","last_became_peered":"2024-09-15T23:57:09.250102+0000","last_unstale":"2024-09-15T23:57:11.250818+0000","last_undegraded":"2024-09-15T23:57:11.250818+0000","last_fullsized":"2024-09-15T23:57:11.250818+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:44:55.236356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239495+0000","last_change":"2024-09-15T23:57:10.250962+0000","last_active":"2024-09-15T23:57:11.239495+0000","last_peered":"2024-09-15T23:57:11.239495+0000","last_clean":"2024-09-15T23:57:11.239495+0000","last_became_active":"2024-09-15T23:57:10.250218+0000","last_became_peered":"2024-09-15T23:57:10.250218+0000","last_unstale":"2024-09-15T23:57:11.239495+0000","last_undegraded":"2024-09-15T23:57:11.239495+0000","last_fullsized":"2024-09-15T23:57:11.239495+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:21.677278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250826+0000","last_change":"2024-09-15T23:57:09.251527+0000","last_active":"2024-09-15T23:57:11.250826+0000","last_peered":"2024-09-15T23:57:11.250826+0000","last_clean":"2024-09-15T23:57:11.250826+0000","last_became_active":"2024-09-15T23:57:09.250230+0000","last_became_peered":"2024-09-15T23:57:09.250230+0000","last_unstale":"2024-09-15T23:57:11.250826+0000","last_undegraded":"2024-09-15T23:57:11.250826+0000","last_fullsized":"2024-09-15T23:57:11.250826+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:53.370937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253813+0000","last_change":"2024-09-15T23:57:10.269107+0000","last_active":"2024-09-15T23:57:11.253813+0000","last_peered":"2024-09-15T23:57:11.253813+0000","last_clean":"2024-09-15T23:57:11.253813+0000","last_became_active":"2024-09-15T23:57:10.268730+0000","last_became_peered":"2024-09-15T23:57:10.268730+0000","last_unstale":"2024-09-15T23:57:11.253813+0000","last_undegraded":"2024-09-15T23:57:11.253813+0000","last_fullsized":"2024-09-15T23:57:11.253813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:10.585170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239588+0000","last_change":"2024-09-15T23:57:09.243572+0000","last_active":"2024-09-15T23:57:11.239588+0000","last_peered":"2024-09-15T23:57:11.239588+0000","last_clean":"2024-09-15T23:57:11.239588+0000","last_became_active":"2024-09-15T23:57:09.243104+0000","last_became_peered":"2024-09-15T23:57:09.243104+0000","last_unstale":"2024-09-15T23:57:11.239588+0000","last_undegraded":"2024-09-15T23:57:11.239588+0000","last_fullsized":"2024-09-15T23:57:11.239588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:50.985376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251693+0000","last_change":"2024-09-15T23:57:10.275288+0000","last_active":"2024-09-15T23:57:11.251693+0000","last_peered":"2024-09-15T23:57:11.251693+0000","last_clean":"2024-09-15T23:57:11.251693+0000","last_became_active":"2024-09-15T23:57:10.275032+0000","last_became_peered":"2024-09-15T23:57:10.275032+0000","last_unstale":"2024-09-15T23:57:11.251693+0000","last_undegraded":"2024-09-15T23:57:11.251693+0000","last_fullsized":"2024-09-15T23:57:11.251693+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:38.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254356+0000","last_change":"2024-09-15T23:57:09.255881+0000","last_active":"2024-09-15T23:57:11.254356+0000","last_peered":"2024-09-15T23:57:11.254356+0000","last_clean":"2024-09-15T23:57:11.254356+0000","last_became_active":"2024-09-15T23:57:09.255609+0000","last_became_peered":"2024-09-15T23:57:09.255609+0000","last_unstale":"2024-09-15T23:57:11.254356+0000","last_undegraded":"2024-09-15T23:57:11.254356+0000","last_fullsized":"2024-09-15T23:57:11.254356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:37.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254189+0000","last_change":"2024-09-15T23:57:10.267880+0000","last_active":"2024-09-15T23:57:11.254189+0000","last_peered":"2024-09-15T23:57:11.254189+0000","last_clean":"2024-09-15T23:57:11.254189+0000","last_became_active":"2024-09-15T23:57:10.267297+0000","last_became_peered":"2024-09-15T23:57:10.267297+0000","last_unstale":"2024-09-15T23:57:11.254189+0000","last_undegraded":"2024-09-15T23:57:11.254189+0000","last_fullsized":"2024-09-15T23:57:11.254189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:09.684075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254428+0000","last_change":"2024-09-15T23:57:09.245627+0000","last_active":"2024-09-15T23:57:11.254428+0000","last_peered":"2024-09-15T23:57:11.254428+0000","last_clean":"2024-09-15T23:57:11.254428+0000","last_became_active":"2024-09-15T23:57:09.245373+0000","last_became_peered":"2024-09-15T23:57:09.245373+0000","last_unstale":"2024-09-15T23:57:11.254428+0000","last_undegraded":"2024-09-15T23:57:11.254428+0000","last_fullsized":"2024-09-15T23:57:11.254428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:02.647200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254467+0000","last_change":"2024-09-15T23:57:10.270192+0000","last_active":"2024-09-15T23:57:11.254467+0000","last_peered":"2024-09-15T23:57:11.254467+0000","last_clean":"2024-09-15T23:57:11.254467+0000","last_became_active":"2024-09-15T23:57:10.269719+0000","last_became_peered":"2024-09-15T23:57:10.269719+0000","last_unstale":"2024-09-15T23:57:11.254467+0000","last_undegraded":"2024-09-15T23:57:11.254467+0000","last_fullsized":"2024-09-15T23:57:11.254467+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:40.074265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254087+0000","last_change":"2024-09-15T23:57:09.253375+0000","last_active":"2024-09-15T23:57:11.254087+0000","last_peered":"2024-09-15T23:57:11.254087+0000","last_clean":"2024-09-15T23:57:11.254087+0000","last_became_active":"2024-09-15T23:57:09.253070+0000","last_became_peered":"2024-09-15T23:57:09.253070+0000","last_unstale":"2024-09-15T23:57:11.254087+0000","last_undegraded":"2024-09-15T23:57:11.254087+0000","last_fullsized":"2024-09-15T23:57:11.254087+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:56.017362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240827+0000","last_change":"2024-09-15T23:57:10.269327+0000","last_active":"2024-09-15T23:57:11.240827+0000","last_peered":"2024-09-15T23:57:11.240827+0000","last_clean":"2024-09-15T23:57:11.240827+0000","last_became_active":"2024-09-15T23:57:10.267727+0000","last_became_peered":"2024-09-15T23:57:10.267727+0000","last_unstale":"2024-09-15T23:57:11.240827+0000","last_undegraded":"2024-09-15T23:57:11.240827+0000","last_fullsized":"2024-09-15T23:57:11.240827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:50.676912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251210+0000","last_change":"2024-09-15T23:57:09.249942+0000","last_active":"2024-09-15T23:57:11.251210+0000","last_peered":"2024-09-15T23:57:11.251210+0000","last_clean":"2024-09-15T23:57:11.251210+0000","last_became_active":"2024-09-15T23:57:09.249628+0000","last_became_peered":"2024-09-15T23:57:09.249628+0000","last_unstale":"2024-09-15T23:57:11.251210+0000","last_undegraded":"2024-09-15T23:57:11.251210+0000","last_fullsized":"2024-09-15T23:57:11.251210+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:39.694228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239947+0000","last_change":"2024-09-15T23:57:10.253718+0000","last_active":"2024-09-15T23:57:11.239947+0000","last_peered":"2024-09-15T23:57:11.239947+0000","last_clean":"2024-09-15T23:57:11.239947+0000","last_became_active":"2024-09-15T23:57:10.251724+0000","last_became_peered":"2024-09-15T23:57:10.251724+0000","last_unstale":"2024-09-15T23:57:11.239947+0000","last_undegraded":"2024-09-15T23:57:11.239947+0000","last_fullsized":"2024-09-15T23:57:11.239947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:37.811192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250979+0000","last_change":"2024-09-15T23:57:09.249963+0000","last_active":"2024-09-15T23:57:11.250979+0000","last_peered":"2024-09-15T23:57:11.250979+0000","last_clean":"2024-09-15T23:57:11.250979+0000","last_became_active":"2024-09-15T23:57:09.249641+0000","last_became_peered":"2024-09-15T23:57:09.249641+0000","last_unstale":"2024-09-15T23:57:11.250979+0000","last_undegraded":"2024-09-15T23:57:11.250979+0000","last_fullsized":"2024-09-15T23:57:11.250979+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:34.888866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250863+0000","last_change":"2024-09-15T23:57:10.275041+0000","last_active":"2024-09-15T23:57:11.250863+0000","last_peered":"2024-09-15T23:57:11.250863+0000","last_clean":"2024-09-15T23:57:11.250863+0000","last_became_active":"2024-09-15T23:57:10.274599+0000","last_became_peered":"2024-09-15T23:57:10.274599+0000","last_unstale":"2024-09-15T23:57:11.250863+0000","last_undegraded":"2024-09-15T23:57:11.250863+0000","last_fullsized":"2024-09-15T23:57:11.250863+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:33.888934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250873+0000","last_change":"2024-09-15T23:57:09.250958+0000","last_active":"2024-09-15T23:57:11.250873+0000","last_peered":"2024-09-15T23:57:11.250873+0000","last_clean":"2024-09-15T23:57:11.250873+0000","last_became_active":"2024-09-15T23:57:09.249973+0000","last_became_peered":"2024-09-15T23:57:09.249973+0000","last_unstale":"2024-09-15T23:57:11.250873+0000","last_undegraded":"2024-09-15T23:57:11.250873+0000","last_fullsized":"2024-09-15T23:57:11.250873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:40.452548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253725+0000","last_change":"2024-09-15T23:57:10.256447+0000","last_active":"2024-09-15T23:57:11.253725+0000","last_peered":"2024-09-15T23:57:11.253725+0000","last_clean":"2024-09-15T23:57:11.253725+0000","last_became_active":"2024-09-15T23:57:10.254570+0000","last_became_peered":"2024-09-15T23:57:10.254570+0000","last_unstale":"2024-09-15T23:57:11.253725+0000","last_undegraded":"2024-09-15T23:57:11.253725+0000","last_fullsized":"2024-09-15T23:57:11.253725+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:30.236610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250827+0000","last_change":"2024-09-15T23:57:09.251721+0000","last_active":"2024-09-15T23:57:11.250827+0000","last_peered":"2024-09-15T23:57:11.250827+0000","last_clean":"2024-09-15T23:57:11.250827+0000","last_became_active":"2024-09-15T23:57:09.251481+0000","last_became_peered":"2024-09-15T23:57:09.251481+0000","last_unstale":"2024-09-15T23:57:11.250827+0000","last_undegraded":"2024-09-15T23:57:11.250827+0000","last_fullsized":"2024-09-15T23:57:11.250827+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:58.521700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239735+0000","last_change":"2024-09-15T23:57:10.253377+0000","last_active":"2024-09-15T23:57:11.239735+0000","last_peered":"2024-09-15T23:57:11.239735+0000","last_clean":"2024-09-15T23:57:11.239735+0000","last_became_active":"2024-09-15T23:57:10.251740+0000","last_became_peered":"2024-09-15T23:57:10.251740+0000","last_unstale":"2024-09-15T23:57:11.239735+0000","last_undegraded":"2024-09-15T23:57:11.239735+0000","last_fullsized":"2024-09-15T23:57:11.239735+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:03.921614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251268+0000","last_change":"2024-09-15T23:57:09.244108+0000","last_active":"2024-09-15T23:57:11.251268+0000","last_peered":"2024-09-15T23:57:11.251268+0000","last_clean":"2024-09-15T23:57:11.251268+0000","last_became_active":"2024-09-15T23:57:09.243867+0000","last_became_peered":"2024-09-15T23:57:09.243867+0000","last_unstale":"2024-09-15T23:57:11.251268+0000","last_undegraded":"2024-09-15T23:57:11.251268+0000","last_fullsized":"2024-09-15T23:57:11.251268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:57.838702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254336+0000","last_change":"2024-09-15T23:57:10.268174+0000","last_active":"2024-09-15T23:57:11.254336+0000","last_peered":"2024-09-15T23:57:11.254336+0000","last_clean":"2024-09-15T23:57:11.254336+0000","last_became_active":"2024-09-15T23:57:10.267625+0000","last_became_peered":"2024-09-15T23:57:10.267625+0000","last_unstale":"2024-09-15T23:57:11.254336+0000","last_undegraded":"2024-09-15T23:57:11.254336+0000","last_fullsized":"2024-09-15T23:57:11.254336+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:39.329537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251712+0000","last_change":"2024-09-15T23:57:09.252674+0000","last_active":"2024-09-15T23:57:11.251712+0000","last_peered":"2024-09-15T23:57:11.251712+0000","last_clean":"2024-09-15T23:57:11.251712+0000","last_became_active":"2024-09-15T23:57:09.252218+0000","last_became_peered":"2024-09-15T23:57:09.252218+0000","last_unstale":"2024-09-15T23:57:11.251712+0000","last_undegraded":"2024-09-15T23:57:11.251712+0000","last_fullsized":"2024-09-15T23:57:11.251712+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:03.649619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254457+0000","last_change":"2024-09-15T23:57:10.258727+0000","last_active":"2024-09-15T23:57:11.254457+0000","last_peered":"2024-09-15T23:57:11.254457+0000","last_clean":"2024-09-15T23:57:11.254457+0000","last_became_active":"2024-09-15T23:57:10.258366+0000","last_became_peered":"2024-09-15T23:57:10.258366+0000","last_unstale":"2024-09-15T23:57:11.254457+0000","last_undegraded":"2024-09-15T23:57:11.254457+0000","last_fullsized":"2024-09-15T23:57:11.254457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.454627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254514+0000","last_change":"2024-09-15T23:57:09.254493+0000","last_active":"2024-09-15T23:57:11.254514+0000","last_peered":"2024-09-15T23:57:11.254514+0000","last_clean":"2024-09-15T23:57:11.254514+0000","last_became_active":"2024-09-15T23:57:09.254237+0000","last_became_peered":"2024-09-15T23:57:09.254237+0000","last_unstale":"2024-09-15T23:57:11.254514+0000","last_undegraded":"2024-09-15T23:57:11.254514+0000","last_fullsized":"2024-09-15T23:57:11.254514+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:55.181501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251063+0000","last_change":"2024-09-15T23:57:10.262174+0000","last_active":"2024-09-15T23:57:11.251063+0000","last_peered":"2024-09-15T23:57:11.251063+0000","last_clean":"2024-09-15T23:57:11.251063+0000","last_became_active":"2024-09-15T23:57:10.261248+0000","last_became_peered":"2024-09-15T23:57:10.261248+0000","last_unstale":"2024-09-15T23:57:11.251063+0000","last_undegraded":"2024-09-15T23:57:11.251063+0000","last_fullsized":"2024-09-15T23:57:11.251063+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:47.757637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254153+0000","last_change":"2024-09-15T23:57:09.253477+0000","last_active":"2024-09-15T23:57:11.254153+0000","last_peered":"2024-09-15T23:57:11.254153+0000","last_clean":"2024-09-15T23:57:11.254153+0000","last_became_active":"2024-09-15T23:57:09.253101+0000","last_became_peered":"2024-09-15T23:57:09.253101+0000","last_unstale":"2024-09-15T23:57:11.254153+0000","last_undegraded":"2024-09-15T23:57:11.254153+0000","last_fullsized":"2024-09-15T23:57:11.254153+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:14.328426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240957+0000","last_change":"2024-09-15T23:57:10.269074+0000","last_active":"2024-09-15T23:57:11.240957+0000","last_peered":"2024-09-15T23:57:11.240957+0000","last_clean":"2024-09-15T23:57:11.240957+0000","last_became_active":"2024-09-15T23:57:10.267359+0000","last_became_peered":"2024-09-15T23:57:10.267359+0000","last_unstale":"2024-09-15T23:57:11.240957+0000","last_undegraded":"2024-09-15T23:57:11.240957+0000","last_fullsized":"2024-09-15T23:57:11.240957+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:42.304840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240233+0000","last_change":"2024-09-15T23:57:09.242376+0000","last_active":"2024-09-15T23:57:11.240233+0000","last_peered":"2024-09-15T23:57:11.240233+0000","last_clean":"2024-09-15T23:57:11.240233+0000","last_became_active":"2024-09-15T23:57:09.242102+0000","last_became_peered":"2024-09-15T23:57:09.242102+0000","last_unstale":"2024-09-15T23:57:11.240233+0000","last_undegraded":"2024-09-15T23:57:11.240233+0000","last_fullsized":"2024-09-15T23:57:11.240233+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:13.352825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240619+0000","last_change":"2024-09-15T23:57:10.269449+0000","last_active":"2024-09-15T23:57:11.240619+0000","last_peered":"2024-09-15T23:57:11.240619+0000","last_clean":"2024-09-15T23:57:11.240619+0000","last_became_active":"2024-09-15T23:57:10.268211+0000","last_became_peered":"2024-09-15T23:57:10.268211+0000","last_unstale":"2024-09-15T23:57:11.240619+0000","last_undegraded":"2024-09-15T23:57:11.240619+0000","last_fullsized":"2024-09-15T23:57:11.240619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:15.490200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240039+0000","last_change":"2024-09-15T23:57:09.252363+0000","last_active":"2024-09-15T23:57:11.240039+0000","last_peered":"2024-09-15T23:57:11.240039+0000","last_clean":"2024-09-15T23:57:11.240039+0000","last_became_active":"2024-09-15T23:57:09.252104+0000","last_became_peered":"2024-09-15T23:57:09.252104+0000","last_unstale":"2024-09-15T23:57:11.240039+0000","last_undegraded":"2024-09-15T23:57:11.240039+0000","last_fullsized":"2024-09-15T23:57:11.240039+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:14.426492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239555+0000","last_change":"2024-09-15T23:57:10.248226+0000","last_active":"2024-09-15T23:57:11.239555+0000","last_peered":"2024-09-15T23:57:11.239555+0000","last_clean":"2024-09-15T23:57:11.239555+0000","last_became_active":"2024-09-15T23:57:10.247565+0000","last_became_peered":"2024-09-15T23:57:10.247565+0000","last_unstale":"2024-09-15T23:57:11.239555+0000","last_undegraded":"2024-09-15T23:57:11.239555+0000","last_fullsized":"2024-09-15T23:57:11.239555+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:25.047590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254162+0000","last_change":"2024-09-15T23:57:09.244979+0000","last_active":"2024-09-15T23:57:11.254162+0000","last_peered":"2024-09-15T23:57:11.254162+0000","last_clean":"2024-09-15T23:57:11.254162+0000","last_became_active":"2024-09-15T23:57:09.244709+0000","last_became_peered":"2024-09-15T23:57:09.244709+0000","last_unstale":"2024-09-15T23:57:11.254162+0000","last_undegraded":"2024-09-15T23:57:11.254162+0000","last_fullsized":"2024-09-15T23:57:11.254162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:04.524116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239580+0000","last_change":"2024-09-15T23:57:10.248014+0000","last_active":"2024-09-15T23:57:11.239580+0000","last_peered":"2024-09-15T23:57:11.239580+0000","last_clean":"2024-09-15T23:57:11.239580+0000","last_became_active":"2024-09-15T23:57:10.247514+0000","last_became_peered":"2024-09-15T23:57:10.247514+0000","last_unstale":"2024-09-15T23:57:11.239580+0000","last_undegraded":"2024-09-15T23:57:11.239580+0000","last_fullsized":"2024-09-15T23:57:11.239580+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:10.248049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.253652+0000","last_change":"2024-09-15T23:57:09.254664+0000","last_active":"2024-09-15T23:57:11.253652+0000","last_peered":"2024-09-15T23:57:11.253652+0000","last_clean":"2024-09-15T23:57:11.253652+0000","last_became_active":"2024-09-15T23:57:09.254407+0000","last_became_peered":"2024-09-15T23:57:09.254407+0000","last_unstale":"2024-09-15T23:57:11.253652+0000","last_undegraded":"2024-09-15T23:57:11.253652+0000","last_fullsized":"2024-09-15T23:57:11.253652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:29.103861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254272+0000","last_change":"2024-09-15T23:57:10.260848+0000","last_active":"2024-09-15T23:57:11.254272+0000","last_peered":"2024-09-15T23:57:11.254272+0000","last_clean":"2024-09-15T23:57:11.254272+0000","last_became_active":"2024-09-15T23:57:10.255001+0000","last_became_peered":"2024-09-15T23:57:10.255001+0000","last_unstale":"2024-09-15T23:57:11.254272+0000","last_undegraded":"2024-09-15T23:57:11.254272+0000","last_fullsized":"2024-09-15T23:57:11.254272+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:50.467455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254449+0000","last_change":"2024-09-15T23:57:09.254094+0000","last_active":"2024-09-15T23:57:11.254449+0000","last_peered":"2024-09-15T23:57:11.254449+0000","last_clean":"2024-09-15T23:57:11.254449+0000","last_became_active":"2024-09-15T23:57:09.253828+0000","last_became_peered":"2024-09-15T23:57:09.253828+0000","last_unstale":"2024-09-15T23:57:11.254449+0000","last_undegraded":"2024-09-15T23:57:11.254449+0000","last_fullsized":"2024-09-15T23:57:11.254449+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:48.882325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251619+0000","last_change":"2024-09-15T23:57:10.265601+0000","last_active":"2024-09-15T23:57:11.251619+0000","last_peered":"2024-09-15T23:57:11.251619+0000","last_clean":"2024-09-15T23:57:11.251619+0000","last_became_active":"2024-09-15T23:57:10.264485+0000","last_became_peered":"2024-09-15T23:57:10.264485+0000","last_unstale":"2024-09-15T23:57:11.251619+0000","last_undegraded":"2024-09-15T23:57:11.251619+0000","last_fullsized":"2024-09-15T23:57:11.251619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:51.351366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.252785+0000","last_change":"2024-09-15T23:57:09.249067+0000","last_active":"2024-09-15T23:57:11.252785+0000","last_peered":"2024-09-15T23:57:11.252785+0000","last_clean":"2024-09-15T23:57:11.252785+0000","last_became_active":"2024-09-15T23:57:09.248792+0000","last_became_peered":"2024-09-15T23:57:09.248792+0000","last_unstale":"2024-09-15T23:57:11.252785+0000","last_undegraded":"2024-09-15T23:57:11.252785+0000","last_fullsized":"2024-09-15T23:57:11.252785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:25.841265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254490+0000","last_change":"2024-09-15T23:57:10.256982+0000","last_active":"2024-09-15T23:57:11.254490+0000","last_peered":"2024-09-15T23:57:11.254490+0000","last_clean":"2024-09-15T23:57:11.254490+0000","last_became_active":"2024-09-15T23:57:10.256509+0000","last_became_peered":"2024-09-15T23:57:10.256509+0000","last_unstale":"2024-09-15T23:57:11.254490+0000","last_undegraded":"2024-09-15T23:57:11.254490+0000","last_fullsized":"2024-09-15T23:57:11.254490+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:37.752760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.241123+0000","last_change":"2024-09-15T23:57:09.253097+0000","last_active":"2024-09-15T23:57:11.241123+0000","last_peered":"2024-09-15T23:57:11.241123+0000","last_clean":"2024-09-15T23:57:11.241123+0000","last_became_active":"2024-09-15T23:57:09.252216+0000","last_became_peered":"2024-09-15T23:57:09.252216+0000","last_unstale":"2024-09-15T23:57:11.241123+0000","last_undegraded":"2024-09-15T23:57:11.241123+0000","last_fullsized":"2024-09-15T23:57:11.241123+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:30.012605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251394+0000","last_change":"2024-09-15T23:57:10.263232+0000","last_active":"2024-09-15T23:57:11.251394+0000","last_peered":"2024-09-15T23:57:11.251394+0000","last_clean":"2024-09-15T23:57:11.251394+0000","last_became_active":"2024-09-15T23:57:10.262946+0000","last_became_peered":"2024-09-15T23:57:10.262946+0000","last_unstale":"2024-09-15T23:57:11.251394+0000","last_undegraded":"2024-09-15T23:57:11.251394+0000","last_fullsized":"2024-09-15T23:57:11.251394+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:18.861312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254516+0000","last_change":"2024-09-15T23:57:09.254087+0000","last_active":"2024-09-15T23:57:11.254516+0000","last_peered":"2024-09-15T23:57:11.254516+0000","last_clean":"2024-09-15T23:57:11.254516+0000","last_became_active":"2024-09-15T23:57:09.253842+0000","last_became_peered":"2024-09-15T23:57:09.253842+0000","last_unstale":"2024-09-15T23:57:11.254516+0000","last_undegraded":"2024-09-15T23:57:11.254516+0000","last_fullsized":"2024-09-15T23:57:11.254516+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:33.714129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240083+0000","last_change":"2024-09-15T23:57:10.251416+0000","last_active":"2024-09-15T23:57:11.240083+0000","last_peered":"2024-09-15T23:57:11.240083+0000","last_clean":"2024-09-15T23:57:11.240083+0000","last_became_active":"2024-09-15T23:57:10.251170+0000","last_became_peered":"2024-09-15T23:57:10.251170+0000","last_unstale":"2024-09-15T23:57:11.240083+0000","last_undegraded":"2024-09-15T23:57:11.240083+0000","last_fullsized":"2024-09-15T23:57:11.240083+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:16.990001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240720+0000","last_change":"2024-09-15T23:57:09.241443+0000","last_active":"2024-09-15T23:57:11.240720+0000","last_peered":"2024-09-15T23:57:11.240720+0000","last_clean":"2024-09-15T23:57:11.240720+0000","last_became_active":"2024-09-15T23:57:09.240436+0000","last_became_peered":"2024-09-15T23:57:09.240436+0000","last_unstale":"2024-09-15T23:57:11.240720+0000","last_undegraded":"2024-09-15T23:57:11.240720+0000","last_fullsized":"2024-09-15T23:57:11.240720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:36.494323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.240716+0000","last_change":"2024-09-15T23:57:10.253185+0000","last_active":"2024-09-15T23:57:11.240716+0000","last_peered":"2024-09-15T23:57:11.240716+0000","last_clean":"2024-09-15T23:57:11.240716+0000","last_became_active":"2024-09-15T23:57:10.251823+0000","last_became_peered":"2024-09-15T23:57:10.251823+0000","last_unstale":"2024-09-15T23:57:11.240716+0000","last_undegraded":"2024-09-15T23:57:11.240716+0000","last_fullsized":"2024-09-15T23:57:11.240716+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:00.619599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250925+0000","last_change":"2024-09-15T23:57:09.251225+0000","last_active":"2024-09-15T23:57:11.250925+0000","last_peered":"2024-09-15T23:57:11.250925+0000","last_clean":"2024-09-15T23:57:11.250925+0000","last_became_active":"2024-09-15T23:57:09.249652+0000","last_became_peered":"2024-09-15T23:57:09.249652+0000","last_unstale":"2024-09-15T23:57:11.250925+0000","last_undegraded":"2024-09-15T23:57:11.250925+0000","last_fullsized":"2024-09-15T23:57:11.250925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:05.866322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251356+0000","last_change":"2024-09-15T23:57:10.262169+0000","last_active":"2024-09-15T23:57:11.251356+0000","last_peered":"2024-09-15T23:57:11.251356+0000","last_clean":"2024-09-15T23:57:11.251356+0000","last_became_active":"2024-09-15T23:57:10.260480+0000","last_became_peered":"2024-09-15T23:57:10.260480+0000","last_unstale":"2024-09-15T23:57:11.251356+0000","last_undegraded":"2024-09-15T23:57:11.251356+0000","last_fullsized":"2024-09-15T23:57:11.251356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:05.872651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254249+0000","last_change":"2024-09-15T23:57:09.245006+0000","last_active":"2024-09-15T23:57:11.254249+0000","last_peered":"2024-09-15T23:57:11.254249+0000","last_clean":"2024-09-15T23:57:11.254249+0000","last_became_active":"2024-09-15T23:57:09.244744+0000","last_became_peered":"2024-09-15T23:57:09.244744+0000","last_unstale":"2024-09-15T23:57:11.254249+0000","last_undegraded":"2024-09-15T23:57:11.254249+0000","last_fullsized":"2024-09-15T23:57:11.254249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:23.964729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.254060+0000","last_change":"2024-09-15T23:57:10.269146+0000","last_active":"2024-09-15T23:57:11.254060+0000","last_peered":"2024-09-15T23:57:11.254060+0000","last_clean":"2024-09-15T23:57:11.254060+0000","last_became_active":"2024-09-15T23:57:10.268874+0000","last_became_peered":"2024-09-15T23:57:10.268874+0000","last_unstale":"2024-09-15T23:57:11.254060+0000","last_undegraded":"2024-09-15T23:57:11.254060+0000","last_fullsized":"2024-09-15T23:57:11.254060+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:45.982264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.239650+0000","last_change":"2024-09-15T23:57:09.243369+0000","last_active":"2024-09-15T23:57:11.239650+0000","last_peered":"2024-09-15T23:57:11.239650+0000","last_clean":"2024-09-15T23:57:11.239650+0000","last_became_active":"2024-09-15T23:57:09.242790+0000","last_became_peered":"2024-09-15T23:57:09.242790+0000","last_unstale":"2024-09-15T23:57:11.239650+0000","last_undegraded":"2024-09-15T23:57:11.239650+0000","last_fullsized":"2024-09-15T23:57:11.239650+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:47.312694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.250780+0000","last_change":"2024-09-15T23:57:10.261141+0000","last_active":"2024-09-15T23:57:11.250780+0000","last_peered":"2024-09-15T23:57:11.250780+0000","last_clean":"2024-09-15T23:57:11.250780+0000","last_became_active":"2024-09-15T23:57:10.260825+0000","last_became_peered":"2024-09-15T23:57:10.260825+0000","last_unstale":"2024-09-15T23:57:11.250780+0000","last_undegraded":"2024-09-15T23:57:11.250780+0000","last_fullsized":"2024-09-15T23:57:11.250780+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:09.224989+0000","last_clean_scrub_stamp":"2024-09-15T23:57:09.224989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:53.414767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251090+0000","last_change":"2024-09-15T23:57:09.249324+0000","last_active":"2024-09-15T23:57:11.251090+0000","last_peered":"2024-09-15T23:57:11.251090+0000","last_clean":"2024-09-15T23:57:11.251090+0000","last_became_active":"2024-09-15T23:57:09.249068+0000","last_became_peered":"2024-09-15T23:57:09.249068+0000","last_unstale":"2024-09-15T23:57:11.251090+0000","last_undegraded":"2024-09-15T23:57:11.251090+0000","last_fullsized":"2024-09-15T23:57:11.251090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:08.219096+0000","last_clean_scrub_stamp":"2024-09-15T23:57:08.219096+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:17.870650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"46'141","reported_seq":379,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T23:57:11.251378+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:11.251378+0000","last_peered":"2024-09-15T23:57:11.251378+0000","last_clean":"2024-09-15T23:57:11.251378+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:11.251378+0000","last_undegraded":"2024-09-15T23:57:11.251378+0000","last_fullsized":"2024-09-15T23:57:11.251378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":490,"num_read_kb":915,"num_write":217,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705691,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":561152,"data_stored":206528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705691,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":796736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":794646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:13.494 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:57:13.494 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:57:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.637+0000 7fd8ca186640 1 Processor -- start 2024-09-15T23:57:13.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.637+0000 7fd8ca186640 1 -- start start 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8ca186640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd8c40a3b90 0x7fd8c40a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8ca186640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c40a4560 con 0x7fd8c40a37b0 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8ca186640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c409b4f0 con 0x7fd8c40a3b90 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8c2ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd8c40a3b90 0x7fd8c40a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8c37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd8c40a37b0 0x7fd8c409acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55206/0 (socket says 172.21.15.121:55206) 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8c37fe640 1 -- 172.21.15.121:0/4178479714 learned_addr learned my addr 172.21.15.121:0/4178479714 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8c2ffd640 1 -- 172.21.15.121:0/4178479714 >> v1:172.21.15.121:6789/0 conn(0x7fd8c40a37b0 legacy=0x7fd8c409acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.638+0000 7fd8c2ffd640 1 -- 172.21.15.121:0/4178479714 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c40a1c90 con 0x7fd8c40a3b90 2024-09-15T23:57:13.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8c2ffd640 1 --2- 172.21.15.121:0/4178479714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a3b90 0x7fd8c40a4020 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009720 tx=0x7fd8b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0972699a475e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8c27fc640 1 -- 172.21.15.121:0/4178479714 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8037070 con 0x7fd8c40a3b90 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8c27fc640 1 -- 172.21.15.121:0/4178479714 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b802ad90 con 0x7fd8c40a3b90 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8c27fc640 1 -- 172.21.15.121:0/4178479714 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b8032590 con 0x7fd8c40a3b90 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 -- 172.21.15.121:0/4178479714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a3b90 msgr2=0x7fd8c40a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 --2- 172.21.15.121:0/4178479714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a3b90 0x7fd8c40a4020 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009720 tx=0x7fd8b802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 -- 172.21.15.121:0/4178479714 shutdown_connections 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 --2- 172.21.15.121:0/4178479714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a3b90 0x7fd8c40a4020 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 -- 172.21.15.121:0/4178479714 >> 172.21.15.121:0/4178479714 conn(0x7fd8c40a8430 msgr2=0x7fd8c40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 -- 172.21.15.121:0/4178479714 shutdown_connections 2024-09-15T23:57:13.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.639+0000 7fd8ca186640 1 -- 172.21.15.121:0/4178479714 wait complete. 2024-09-15T23:57:13.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.640+0000 7fd8ca186640 1 Processor -- start 2024-09-15T23:57:13.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.640+0000 7fd8ca186640 1 -- start start 2024-09-15T23:57:13.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8ca186640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8ca186640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c40a5220 con 0x7fd8c40a37b0 2024-09-15T23:57:13.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8c37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52310/0 (socket says 172.21.15.121:52310) 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8c37fe640 1 -- 172.21.15.121:0/3253687758 learned_addr learned my addr 172.21.15.121:0/3253687758 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8c37fe640 1 -- 172.21.15.121:0/3253687758 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c4071610 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8c37fe640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c4a0 tx=0x7fd8b400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4017070 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.641+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b4005c10 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.642+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c411ec50 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.642+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8b4007070 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.642+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c4072160 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.642+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fd8b401a070 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.642+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c40a2490 con 0x7fd8c40a37b0 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.643+0000 7fd8abfff640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 0x7fd8b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.643+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7fd8b404a4a0 con 0x7fd8c40a37b0 2024-09-15T23:57:13.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.643+0000 7fd8c2ffd640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 0x7fd8b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.643+0000 7fd8c2ffd640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 0x7fd8b003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009720 tx=0x7fd8b802e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.647+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8c40a2490 con 0x7fd8c40a37b0 2024-09-15T23:57:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.876+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd8c40a4020 con 0x7fd8c40a37b0 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.877+0000 7fd8abfff640 1 -- 172.21.15.121:0/3253687758 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fd8b40117a0 con 0x7fd8c40a37b0 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg== 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-15T23:57:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 msgr2=0x7fd8b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 0x7fd8b003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009720 tx=0x7fd8b802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 msgr2=0x7fd8c411e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c4a0 tx=0x7fd8b400c960 comp rx=0 tx=0).stop 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 shutdown_connections 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fd8b00382a0 0x7fd8b003a760 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 --2- 172.21.15.121:0/3253687758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8c40a37b0 0x7fd8c411e580 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 >> 172.21.15.121:0/3253687758 conn(0x7fd8c40a8430 msgr2=0x7fd8c41bcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.879+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 shutdown_connections 2024-09-15T23:57:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.880+0000 7fd8ca186640 1 -- 172.21.15.121:0/3253687758 wait complete. 2024-09-15T23:57:13.891 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.988+0000 7f816e0e6640 1 Processor -- start 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.988+0000 7f816e0e6640 1 -- start start 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f816e0e6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f81680a39c0 0x7f8168132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f816e0e6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81680a16c0 con 0x7f8168133470 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f816e0e6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f81680a1490 con 0x7f81680a39c0 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f81677fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f81680a39c0 0x7f8168132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f8166ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8168133470 0x7f8168135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55214/0 (socket says 172.21.15.121:55214) 2024-09-15T23:57:13.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f8166ffd640 1 -- 172.21.15.121:0/3806782780 learned_addr learned my addr 172.21.15.121:0/3806782780 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:13.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f81677fe640 1 -- 172.21.15.121:0/3806782780 >> v1:172.21.15.121:6789/0 conn(0x7f8168133470 legacy=0x7f8168135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f81677fe640 1 -- 172.21.15.121:0/3806782780 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81680a4010 con 0x7f81680a39c0 2024-09-15T23:57:13.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.989+0000 7f81667fc640 1 -- 172.21.15.121:0/3806782780 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4247434327 0 0) 0x7f81680a16c0 con 0x7f8168133470 2024-09-15T23:57:13.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.990+0000 7f81677fe640 1 --2- 172.21.15.121:0/3806782780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f8168132f30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f815800a8c0 tx=0x7f815802b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb63db4c443e096 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.990+0000 7f81667fc640 1 -- 172.21.15.121:0/3806782780 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f815800b040 con 0x7f81680a39c0 2024-09-15T23:57:13.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.990+0000 7f81667fc640 1 -- 172.21.15.121:0/3806782780 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8158030640 con 0x7f81680a39c0 2024-09-15T23:57:13.992 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.990+0000 7f81667fc640 1 -- 172.21.15.121:0/3806782780 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8158030940 con 0x7f81680a39c0 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 -- 172.21.15.121:0/3806782780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 msgr2=0x7f8168132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 --2- 172.21.15.121:0/3806782780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f8168132f30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f815800a8c0 tx=0x7f815802b4d0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 -- 172.21.15.121:0/3806782780 shutdown_connections 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 --2- 172.21.15.121:0/3806782780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f8168132f30 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 -- 172.21.15.121:0/3806782780 >> 172.21.15.121:0/3806782780 conn(0x7f81680a85e0 msgr2=0x7f81680a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 -- 172.21.15.121:0/3806782780 shutdown_connections 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 -- 172.21.15.121:0/3806782780 wait complete. 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.991+0000 7f816e0e6640 1 Processor -- start 2024-09-15T23:57:13.993 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f816e0e6640 1 -- start start 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f816e0e6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f816e0e6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81681329c0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f81677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f81677fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52318/0 (socket says 172.21.15.121:52318) 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f81677fe640 1 -- 172.21.15.121:0/1592548809 learned_addr learned my addr 172.21.15.121:0/1592548809 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.992+0000 7f81677fe640 1 -- 172.21.15.121:0/1592548809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8168133ed0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f81677fe640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f815800a8c0 tx=0x7f81580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f815803f030 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8158033ad0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8158033df0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81680737c0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.993+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8168072fd0 con 0x7f81680a39c0 2024-09-15T23:57:13.996 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f8158042030 con 0x7f81680a39c0 2024-09-15T23:57:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f814ffff640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 0x7f815403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81680a23d0 con 0x7f81680a39c0 2024-09-15T23:57:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f8158040070 con 0x7f81680a39c0 2024-09-15T23:57:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f8166ffd640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 0x7f815403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:13.997 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.994+0000 7f8166ffd640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 0x7f815403a760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f815c000c00 tx=0x7f815c007a40 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:13.998+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8158035120 con 0x7f81680a39c0 2024-09-15T23:57:14.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.200+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816811ed00 con 0x7f81680a39c0 2024-09-15T23:57:14.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.201+0000 7f814ffff640 1 -- 172.21.15.121:0/1592548809 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7f815803b950 con 0x7f81680a39c0 2024-09-15T23:57:14.202 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:14.202 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:14.202 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:14.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 msgr2=0x7f815403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 0x7f815403a760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f815c000c00 tx=0x7f815c007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 msgr2=0x7f816812faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f815800a8c0 tx=0x7f81580046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 shutdown_connections 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f81540382a0 0x7f815403a760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 --2- 172.21.15.121:0/1592548809 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81680a39c0 0x7f816812faa0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 >> 172.21.15.121:0/1592548809 conn(0x7f81680a85e0 msgr2=0x7f81681368a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 shutdown_connections 2024-09-15T23:57:14.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.203+0000 7f816e0e6640 1 -- 172.21.15.121:0/1592548809 wait complete. 2024-09-15T23:57:14.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:57:09.570850+0000', 'modified': '2024-09-15T23:57:11.564778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4823': {'gid': 4823, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6824/2407589341', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6825', 'nonce': 2407589341}, {'type': 'v1', 'addr': '172.21.15.121:6824', 'nonce': 2407589341}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4823, 'qdb_cluster': [4823]} 2024-09-15T23:57:14.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:57:14.416 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.515+0000 7f76bb903640 1 Processor -- start 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.515+0000 7f76bb903640 1 -- start start 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76bb903640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f76b4135b50 0x7f76b409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76bb903640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b409b020 con 0x7f76b4135f30 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76bb903640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f76b409b310 con 0x7f76b4135b50 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76b969f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f76b4135b50 0x7f76b409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76b8e9e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f76b4135f30 0x7f76b40a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55226/0 (socket says 172.21.15.121:55226) 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76b8e9e640 1 -- 172.21.15.121:0/1395025788 learned_addr learned my addr 172.21.15.121:0/1395025788 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76b969f640 1 -- 172.21.15.121:0/1395025788 >> v1:172.21.15.121:6789/0 conn(0x7f76b4135f30 legacy=0x7f76b40a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.516+0000 7f76b969f640 1 -- 172.21.15.121:0/1395025788 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b40a08c0 con 0x7f76b4135b50 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.517+0000 7f76b969f640 1 --2- 172.21.15.121:0/1395025788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b409aae0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009720 tx=0x7f76b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7244d883c2b3df9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.517+0000 7f76abfff640 1 -- 172.21.15.121:0/1395025788 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0037070 con 0x7f76b4135b50 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.517+0000 7f76abfff640 1 -- 172.21.15.121:0/1395025788 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b002ae20 con 0x7f76b4135b50 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.517+0000 7f76abfff640 1 -- 172.21.15.121:0/1395025788 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0032590 con 0x7f76b4135b50 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 -- 172.21.15.121:0/1395025788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 msgr2=0x7f76b409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 --2- 172.21.15.121:0/1395025788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b409aae0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009720 tx=0x7f76b002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 -- 172.21.15.121:0/1395025788 shutdown_connections 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 --2- 172.21.15.121:0/1395025788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b409aae0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 -- 172.21.15.121:0/1395025788 >> 172.21.15.121:0/1395025788 conn(0x7f76b40a85e0 msgr2=0x7f76b40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 -- 172.21.15.121:0/1395025788 shutdown_connections 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 -- 172.21.15.121:0/1395025788 wait complete. 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.518+0000 7f76bb903640 1 Processor -- start 2024-09-15T23:57:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76bb903640 1 -- start start 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76bb903640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76bb903640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76b40a5430 con 0x7f76b4135b50 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52334/0 (socket says 172.21.15.121:52334) 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76b969f640 1 -- 172.21.15.121:0/931246863 learned_addr learned my addr 172.21.15.121:0/931246863 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76b969f640 1 -- 172.21.15.121:0/931246863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b4123e80 con 0x7f76b4135b50 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.519+0000 7f76b969f640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f76b002adf0 tx=0x7f76b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.520+0000 7f76a9ffb640 1 -- 172.21.15.121:0/931246863 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0041070 con 0x7f76b4135b50 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.520+0000 7f76a9ffb640 1 -- 172.21.15.121:0/931246863 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b003c590 con 0x7f76b4135b50 2024-09-15T23:57:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.520+0000 7f76a9ffb640 1 -- 172.21.15.121:0/931246863 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0037040 con 0x7f76b4135b50 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.520+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b4124100 con 0x7f76b4135b50 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.520+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b40a2f80 con 0x7f76b4135b50 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.521+0000 7f76a9ffb640 1 -- 172.21.15.121:0/931246863 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f76b0044070 con 0x7f76b4135b50 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.521+0000 7f76a9ffb640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 0x7f769803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.521+0000 7f76a9ffb640 1 -- 172.21.15.121:0/931246863 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f76b006bbd0 con 0x7f76b4135b50 2024-09-15T23:57:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.521+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 0x7f769803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.524 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.522+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 0x7f769803a760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76a4007fd0 tx=0x7f76a4007ac0 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76be69c740 1 Processor -- start 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76be69c740 1 -- start start 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76be69c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76be69c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e260e98520 con 0x55e260f4cc80 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52338/0 (socket says 172.21.15.121:52338) 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76b969f640 1 -- 172.21.15.121:0/165973493 learned_addr learned my addr 172.21.15.121:0/165973493 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76b969f640 1 -- 172.21.15.121:0/165973493 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e260e5b2f0 con 0x55e260f4cc80 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.523+0000 7f76b969f640 1 --2- 172.21.15.121:0/165973493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f76b0044fd0 tx=0x7f76b004ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51f2cabcefda86 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f7696ffd640 1 -- 172.21.15.121:0/165973493 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0062020 con 0x55e260f4cc80 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f7696ffd640 1 -- 172.21.15.121:0/165973493 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b003d8c0 con 0x55e260f4cc80 2024-09-15T23:57:14.525 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f7696ffd640 1 -- 172.21.15.121:0/165973493 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b003cc30 con 0x55e260f4cc80 2024-09-15T23:57:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 -- 172.21.15.121:0/165973493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 msgr2=0x55e260f50f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 --2- 172.21.15.121:0/165973493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f76b0044fd0 tx=0x7f76b004ec20 comp rx=0 tx=0).stop 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 -- 172.21.15.121:0/165973493 shutdown_connections 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 --2- 172.21.15.121:0/165973493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f50f10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 -- 172.21.15.121:0/165973493 >> 172.21.15.121:0/165973493 conn(0x55e260f331d0 msgr2=0x55e260f33f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 -- 172.21.15.121:0/165973493 shutdown_connections 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.524+0000 7f76be69c740 1 -- 172.21.15.121:0/165973493 wait complete. 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76be69c740 1 -- start start 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76be69c740 1 Processor -- start 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76be69c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76be69c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e260e944e0 con 0x55e260f4cc80 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76be69c740 10 client.0 _ll_register_callbacks cb 0x55e260baaac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.525+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52350/0 (socket says 172.21.15.121:52350) 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76b969f640 1 -- 172.21.15.121:0/3932538427 learned_addr learned my addr 172.21.15.121:0/3932538427 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76b969f640 1 -- 172.21.15.121:0/3932538427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e260bab2d0 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76b969f640 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f76b004efd0 tx=0x7f76b003df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a6e1ccfbdb9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b006be60 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f76b0069250 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76b003d8c0 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76b0055070 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 10 client.4876 fetch_fsmap learned FSMap version 30 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55e260c756b0 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b003d8c0 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 2292+0+0 (secure 0 0 0) 0x7f76b0069450 con 0x55e260f4cc80 2024-09-15T23:57:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 10 client.4876 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 10 client.4876 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 20 client.4876 populate_metadata read hostname 'smithi121' 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260f4dd60 0x55e260f700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 4 client.4876 mds_command: new command op to 4823 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.526+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 --> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e260ea5c50 con 0x55e260f4dd60 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260f4dd60 0x55e260f700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f768ffff640 10 client.4876 ms_handle_connect on v2:172.21.15.121:6825/2407589341 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260f4dd60 0x55e260f700c0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaba8505cbff0067 server_cookie=2e8b622fc789a4eb in_seq=0 out_seq=0 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f768ffff640 1 -- 172.21.15.121:0/3932538427 <== mds.0 v2:172.21.15.121:6825/2407589341 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e260ea5c50 con 0x55e260f4dd60 2024-09-15T23:57:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f768ffff640 10 client.4876 handle_command_reply: tid=0 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f76be69c740 1 client.4876 shutdown 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.527+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 msgr2=0x55e260f582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f76b004efd0 tx=0x7f76b003df90 comp rx=0 tx=0).stop 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 shutdown_connections 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260f4dd60 0x55e260f700c0 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 --2- 172.21.15.121:0/3932538427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f582a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f768ffff640 0 client.4876 ms_handle_reset on v2:172.21.15.121:6825/2407589341 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 >> 172.21.15.121:0/3932538427 conn(0x55e260f331d0 msgr2=0x55e260f5fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 shutdown_connections 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 1 -- 172.21.15.121:0/3932538427 wait complete. 2024-09-15T23:57:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.528+0000 7f76be69c740 20 client.4876 trim_cache size 0 max 16384 2024-09-15T23:57:14.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.545+0000 7f76be69c740 1 Processor -- start 2024-09-15T23:57:14.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.545+0000 7f76be69c740 1 -- start start 2024-09-15T23:57:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76be69c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76be69c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76b41206c0 con 0x55e260f4cc80 2024-09-15T23:57:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52356/0 (socket says 172.21.15.121:52356) 2024-09-15T23:57:14.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76b969f640 1 -- 172.21.15.121:0/285275116 learned_addr learned my addr 172.21.15.121:0/285275116 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76b969f640 1 -- 172.21.15.121:0/285275116 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e260e1ef70 con 0x55e260f4cc80 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76b969f640 1 --2- 172.21.15.121:0/285275116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f76b004e3d0 tx=0x7f76b0055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c99ccf6387e59e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76967fc640 1 -- 172.21.15.121:0/285275116 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b007a070 con 0x55e260f4cc80 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76967fc640 1 -- 172.21.15.121:0/285275116 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b003ba70 con 0x55e260f4cc80 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.546+0000 7f76967fc640 1 -- 172.21.15.121:0/285275116 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b0062040 con 0x55e260f4cc80 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- 172.21.15.121:0/285275116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 msgr2=0x55e260f560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 --2- 172.21.15.121:0/285275116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f76b004e3d0 tx=0x7f76b0055000 comp rx=0 tx=0).stop 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- 172.21.15.121:0/285275116 shutdown_connections 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 --2- 172.21.15.121:0/285275116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260f560f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- 172.21.15.121:0/285275116 >> 172.21.15.121:0/285275116 conn(0x55e260f331d0 msgr2=0x55e260f51890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- 172.21.15.121:0/285275116 shutdown_connections 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- 172.21.15.121:0/285275116 wait complete. 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.547+0000 7f76be69c740 1 -- start start 2024-09-15T23:57:14.549 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76be69c740 1 Processor -- start 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76be69c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76be69c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e260e403e0 con 0x55e260f4cc80 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76be69c740 10 client.0 _ll_register_callbacks cb 0x7f76b005ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76b969f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52372/0 (socket says 172.21.15.121:52372) 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76b969f640 1 -- 172.21.15.121:0/919541417 learned_addr learned my addr 172.21.15.121:0/919541417 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.548+0000 7f76b969f640 1 -- 172.21.15.121:0/919541417 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e260fd7530 con 0x55e260f4cc80 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76b969f640 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f76b003bfb0 tx=0x7f76b003d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c373386e79790 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b007a070 con 0x55e260f4cc80 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f76b003d210 con 0x55e260f4cc80 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76b003ba70 con 0x55e260f4cc80 2024-09-15T23:57:14.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f76b0062040 con 0x55e260f4cc80 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 10 client.4878 fetch_fsmap learned FSMap version 30 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55e260fd7530 con 0x55e260f4cc80 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b003ba70 con 0x55e260f4cc80 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 30) ==== 2292+0+0 (secure 0 0 0) 0x7f76b0069250 con 0x55e260f4cc80 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 10 client.4878 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 10 client.4878 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 20 client.4878 populate_metadata read hostname 'smithi121' 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260fd7ea0 0x55e260fd3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 4 client.4878 mds_command: new command op to 4823 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 --> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] -- command(tid 0: {"prefix": "status"}) -- 0x55e260e9ffa0 con 0x55e260fd7ea0 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.549+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260fd7ea0 0x55e260fd3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f768ffff640 10 client.4878 ms_handle_connect on v2:172.21.15.121:6825/2407589341 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76b8e9e640 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260fd7ea0 0x55e260fd3e40 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44888063a956b7f server_cookie=4e517b4bd5a6dee7 in_seq=0 out_seq=0 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f768ffff640 1 -- 172.21.15.121:0/919541417 <== mds.0 v2:172.21.15.121:6825/2407589341 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e260e9ffa0 con 0x55e260fd7ea0 2024-09-15T23:57:14.554 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f768ffff640 10 client.4878 handle_command_reply: tid=0 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 client.4878 shutdown 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 msgr2=0x55e260fd7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f76b003bfb0 tx=0x7f76b003d4a0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 shutdown_connections 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:6825/2407589341,v1:172.21.15.121:6824/2407589341] conn(0x55e260fd7ea0 0x55e260fd3e40 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 --2- 172.21.15.121:0/919541417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e260f4cc80 0x55e260fd7960 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f768ffff640 0 client.4878 ms_handle_reset on v2:172.21.15.121:6825/2407589341 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 >> 172.21.15.121:0/919541417 conn(0x55e260f331d0 msgr2=0x55e260f337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 shutdown_connections 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 1 -- 172.21.15.121:0/919541417 wait complete. 2024-09-15T23:57:14.555 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.550+0000 7f76be69c740 20 client.4878 trim_cache size 0 max 16384 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "822f5905-71ec-4c9e-8017-14fcc3976ad1", 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4823, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 4.3148265810000002, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 30, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 57, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 57, 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 8.4018048790000002 2024-09-15T23:57:14.556 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:14.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 msgr2=0x7f769803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 0x7f769803a760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76a4007fd0 tx=0x7f76a4007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 msgr2=0x7f76b4120d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.557 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f76b002adf0 tx=0x7f76b00046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 shutdown_connections 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f76980382a0 0x7f769803a760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 --2- 172.21.15.121:0/931246863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76b4135b50 0x7f76b4120d80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 >> 172.21.15.121:0/931246863 conn(0x7f76b40a85e0 msgr2=0x7f76b409d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 shutdown_connections 2024-09-15T23:57:14.558 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.551+0000 7f76bb903640 1 -- 172.21.15.121:0/931246863 wait complete. 2024-09-15T23:57:14.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:14.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.658+0000 7f72a44a5640 1 Processor -- start 2024-09-15T23:57:14.659 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.658+0000 7f72a44a5640 1 -- start start 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.658+0000 7f72a44a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f729c135f30 0x7f729c13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.658+0000 7f72a44a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f729c0a08c0 con 0x7f729c135b50 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.658+0000 7f72a44a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f729c09b310 con 0x7f729c135f30 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.659+0000 7f72a1a40640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f729c135f30 0x7f729c13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.659+0000 7f72a2241640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f729c135b50 0x7f729c09aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55236/0 (socket says 172.21.15.121:55236) 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.659+0000 7f72a2241640 1 -- 172.21.15.121:0/1666723234 learned_addr learned my addr 172.21.15.121:0/1666723234 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.659+0000 7f72a1a40640 1 -- 172.21.15.121:0/1666723234 >> v1:172.21.15.121:6789/0 conn(0x7f729c135b50 legacy=0x7f729c09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.659+0000 7f72a1a40640 1 -- 172.21.15.121:0/1666723234 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c0a2270 con 0x7f729c135f30 2024-09-15T23:57:14.661 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a1a40640 1 --2- 172.21.15.121:0/1666723234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135f30 0x7f729c13bb80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f728c009720 tx=0x7f728c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ebcf956d80907 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a123f640 1 -- 172.21.15.121:0/1666723234 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c037070 con 0x7f729c135f30 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a123f640 1 -- 172.21.15.121:0/1666723234 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c02ae20 con 0x7f729c135f30 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a123f640 1 -- 172.21.15.121:0/1666723234 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c032590 con 0x7f729c135f30 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 -- 172.21.15.121:0/1666723234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135f30 msgr2=0x7f729c13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 --2- 172.21.15.121:0/1666723234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135f30 0x7f729c13bb80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f728c009720 tx=0x7f728c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 -- 172.21.15.121:0/1666723234 shutdown_connections 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 --2- 172.21.15.121:0/1666723234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135f30 0x7f729c13bb80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 -- 172.21.15.121:0/1666723234 >> 172.21.15.121:0/1666723234 conn(0x7f729c0a85e0 msgr2=0x7f729c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 -- 172.21.15.121:0/1666723234 shutdown_connections 2024-09-15T23:57:14.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.660+0000 7f72a44a5640 1 -- 172.21.15.121:0/1666723234 wait complete. 2024-09-15T23:57:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.661+0000 7f72a44a5640 1 Processor -- start 2024-09-15T23:57:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.661+0000 7f72a44a5640 1 -- start start 2024-09-15T23:57:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a44a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a44a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f729c136350 con 0x7f729c135b50 2024-09-15T23:57:14.664 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a2241640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a2241640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52392/0 (socket says 172.21.15.121:52392) 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a2241640 1 -- 172.21.15.121:0/4085454343 learned_addr learned my addr 172.21.15.121:0/4085454343 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a2241640 1 -- 172.21.15.121:0/4085454343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c125900 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a2241640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f729800c4a0 tx=0x7f729800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298017070 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7298005c10 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7298007070 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729c126260 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.662+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729c1255f0 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.663+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7f729801a070 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.663+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f729c126050 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.663+0000 7f7292ffd640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 0x7f728003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.663+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7f729804a4c0 con 0x7f729c135b50 2024-09-15T23:57:14.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.664+0000 7f72a1a40640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 0x7f728003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:14.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.664+0000 7f72a1a40640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 0x7f728003a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f728c034000 tx=0x7f728c02e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:14.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.668+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f729801b3b0 con 0x7f729c135b50 2024-09-15T23:57:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.868+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f729c0a1f10 con 0x7f729c135b50 2024-09-15T23:57:14.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.868+0000 7f7292ffd640 1 -- 172.21.15.121:0/4085454343 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7f7298010c00 con 0x7f729c135b50 2024-09-15T23:57:14.869 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 msgr2=0x7f728003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 0x7f728003a760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f728c034000 tx=0x7f728c02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 msgr2=0x7f729c1ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f729800c4a0 tx=0x7f729800c960 comp rx=0 tx=0).stop 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 shutdown_connections 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7f72800382a0 0x7f728003a760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 --2- 172.21.15.121:0/4085454343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f729c135b50 0x7f729c1ce990 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 >> 172.21.15.121:0/4085454343 conn(0x7f729c0a85e0 msgr2=0x7f729c0a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:14.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 shutdown_connections 2024-09-15T23:57:14.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:14.870+0000 7f72a44a5640 1 -- 172.21.15.121:0/4085454343 wait complete. 2024-09-15T23:57:14.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:14.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:14.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:14.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:14.882 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:57:14.898 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:14.899 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:14.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:14.901 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:14.961 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:57:14.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:14.962 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:57:15.019 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:57:15.019 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:15.019 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:15.019 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:15.019 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:15.019 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:15.019 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:57:15.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:15.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:15.020 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:15.020 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:57:15.106 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:15.138 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:15.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.144 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:57:15.160 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:57:15.160 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:15.160 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:15.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-15T23:57:15.225 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:57:15.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:15.226 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:15.282 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:15.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:15.282 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:15.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:15.402 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:15.457 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:15.458 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:15.459 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:15.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.460 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:15.512 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:57:15.513 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:57:15.555 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:15.580 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:15.637 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:15.638 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:15.639 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:15.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.640 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:15.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-09-15T23:57:15.637+0000 7f114d1c9480 -1 init, newargv = 0x562e3dc3bac0 newargc=15 2024-09-15T23:57:15.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[54108]: starting ceph client 2024-09-15T23:57:15.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[54108]: starting fuse 2024-09-15T23:57:15.657 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:15.657 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:57:15.657 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:57:15.658 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:15.659 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:15.659 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:57:15.659 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:57:15.773 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.54108.asok 2024-09-15T23:57:15.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:15.783 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54108.asok 2024-09-15T23:57:15.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.784 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54108.asok status 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:57:15.916 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "54108", 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4884, 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4884 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:15.917 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2364110304 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 2364110304 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4884 192.168.0.1:0/2364110304", 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/2364110304", 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 30, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 57, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:15.918 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:57:15.919 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:57:15.919 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:15.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.924 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:57:15.924 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:15.940 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:57:15.940 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:15.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:16.006 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:16.145 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb84de27640 1 Processor -- start 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb84de27640 1 -- start start 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb84de27640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb848135f30 0x7fb84813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb84de27640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8480a08c0 con 0x7fb848135b50 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb84de27640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb84809b310 con 0x7fb848135f30 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb83ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb848135f30 0x7fb84813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb83ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb848135f30 0x7fb84813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52398/0 (socket says 172.21.15.121:52398) 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb83ffff640 1 -- 172.21.15.121:0/3175012396 learned_addr learned my addr 172.21.15.121:0/3175012396 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.144+0000 7fb8477fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb848135b50 0x7fb84809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55244/0 (socket says 172.21.15.121:55244) 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.145+0000 7fb83ffff640 1 -- 172.21.15.121:0/3175012396 >> v1:172.21.15.121:6789/0 conn(0x7fb848135b50 legacy=0x7fb84809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.145+0000 7fb846ffd640 1 -- 172.21.15.121:0/3175012396 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716001127 0 0) 0x7fb8480a08c0 con 0x7fb848135b50 2024-09-15T23:57:16.146 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.145+0000 7fb83ffff640 1 -- 172.21.15.121:0/3175012396 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8480a2270 con 0x7fb848135f30 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.145+0000 7fb83ffff640 1 --2- 172.21.15.121:0/3175012396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135f30 0x7fb84813bb80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb8300097f0 tx=0x7fb83002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a84f174d2259c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.145+0000 7fb846ffd640 1 -- 172.21.15.121:0/3175012396 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb830037070 con 0x7fb848135f30 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb846ffd640 1 -- 172.21.15.121:0/3175012396 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb830032440 con 0x7fb848135f30 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb846ffd640 1 -- 172.21.15.121:0/3175012396 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb830032740 con 0x7fb848135f30 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 -- 172.21.15.121:0/3175012396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135f30 msgr2=0x7fb84813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 --2- 172.21.15.121:0/3175012396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135f30 0x7fb84813bb80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb8300097f0 tx=0x7fb83002a270 comp rx=0 tx=0).stop 2024-09-15T23:57:16.149 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 -- 172.21.15.121:0/3175012396 shutdown_connections 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 --2- 172.21.15.121:0/3175012396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135f30 0x7fb84813bb80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 -- 172.21.15.121:0/3175012396 >> 172.21.15.121:0/3175012396 conn(0x7fb8480a85e0 msgr2=0x7fb8480a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 -- 172.21.15.121:0/3175012396 shutdown_connections 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.146+0000 7fb84de27640 1 -- 172.21.15.121:0/3175012396 wait complete. 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.147+0000 7fb84de27640 1 Processor -- start 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.147+0000 7fb84de27640 1 -- start start 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.147+0000 7fb84de27640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.147+0000 7fb84de27640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb848136350 con 0x7fb848135b50 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb8477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb8477fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52400/0 (socket says 172.21.15.121:52400) 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb8477fe640 1 -- 172.21.15.121:0/1877609197 learned_addr learned my addr 172.21.15.121:0/1877609197 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb8477fe640 1 -- 172.21.15.121:0/1877609197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb848071df0 con 0x7fb848135b50 2024-09-15T23:57:16.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb8477fe640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c420 tx=0x7fb83800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:16.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb838018070 con 0x7fb848135b50 2024-09-15T23:57:16.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8380074d0 con 0x7fb848135b50 2024-09-15T23:57:16.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb838004950 con 0x7fb848135b50 2024-09-15T23:57:16.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8481233f0 con 0x7fb848135b50 2024-09-15T23:57:16.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.148+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8481230e0 con 0x7fb848135b50 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.149+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fb83801b070 con 0x7fb848135b50 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.149+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84809aae0 con 0x7fb848135b50 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.149+0000 7fb844ff9640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 0x7fb82803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.149+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7fb83804a580 con 0x7fb848135b50 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.149+0000 7fb83ffff640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 0x7fb82803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:16.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.150+0000 7fb83ffff640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 0x7fb82803a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb830034000 tx=0x7fb83002e000 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:16.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.154+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb838011980 con 0x7fb848135b50 2024-09-15T23:57:16.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.355+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb8480a1f10 con 0x7fb848135b50 2024-09-15T23:57:16.356 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.356+0000 7fb844ff9640 1 -- 172.21.15.121:0/1877609197 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7fb838011be0 con 0x7fb848135b50 2024-09-15T23:57:16.357 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 msgr2=0x7fb82803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 0x7fb82803a760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb830034000 tx=0x7fb83002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 msgr2=0x7fb848070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c420 tx=0x7fb83800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 shutdown_connections 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fb8280382a0 0x7fb82803a760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 --2- 172.21.15.121:0/1877609197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb848135b50 0x7fb848070920 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 >> 172.21.15.121:0/1877609197 conn(0x7fb8480a85e0 msgr2=0x7fb8481bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 shutdown_connections 2024-09-15T23:57:16.359 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16.358+0000 7fb84de27640 1 -- 172.21.15.121:0/1877609197 wait complete. 2024-09-15T23:57:16.369 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:16.369 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:16.370 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:16.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.370 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:16.386 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.387 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:16.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.388 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:16.450 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:57:16.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.452 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:16.509 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:16.509 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:16.509 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:57:16.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:16.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:16.510 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:16.510 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:57:16.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:16.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.634 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:57:16.650 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:57:16.650 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:16.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:16.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.650 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:57:16.715 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:57:16.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:16.716 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:16.771 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:16.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:16.771 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:16.827 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:16.892 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:16.948 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:16.949 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:16.950 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:16.951 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:16.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:16.951 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:17.003 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:17.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:57:17.003 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:57:17.046 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:17.071 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:17.128 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:17.129 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:17.130 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:17.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:17.131 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:17.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:57:17.127+0000 7f3d4ff88480 -1 init, newargv = 0x5584ffb25dd0 newargc=15 2024-09-15T23:57:17.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[54525]: starting ceph client 2024-09-15T23:57:17.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[54525]: starting fuse 2024-09-15T23:57:17.146 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:17.146 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:57:17.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:57:17.147 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:17.148 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:57:17.149 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:57:17.266 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.54525.asok 2024-09-15T23:57:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:17.276 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.54525.asok 2024-09-15T23:57:17.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:17.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.54525.asok status 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "54525", 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:57:17.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4890, 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 4890 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1517037574 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:17.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 1517037574 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.4890 192.168.0.2:0/1517037574", 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/1517037574", 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 30, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 57, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:57:17.411 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:17.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:17.417 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:57:17.417 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:17.433 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:57:17.433 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:17.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:17.433 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:17.498 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac86391640 1 Processor -- start 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac86391640 1 -- start start 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac86391640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac800a37b0 0x7fac8009acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac86391640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8009b200 con 0x7fac800a3b90 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac86391640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fac8009b4f0 con 0x7fac800a37b0 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac7ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac800a37b0 0x7fac8009acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac7f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fac800a3b90 0x7fac800a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:55248/0 (socket says 172.21.15.121:55248) 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac7f7fe640 1 -- 172.21.15.121:0/486129674 learned_addr learned my addr 172.21.15.121:0/486129674 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.638+0000 7fac7ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fac800a37b0 0x7fac8009acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52402/0 (socket says 172.21.15.121:52402) 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.639+0000 7fac7ffff640 1 -- 172.21.15.121:0/486129674 >> v1:172.21.15.121:6789/0 conn(0x7fac800a3b90 legacy=0x7fac800a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:17.640 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.639+0000 7fac7effd640 1 -- 172.21.15.121:0/486129674 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082432023 0 0) 0x7fac8009b200 con 0x7fac800a3b90 2024-09-15T23:57:17.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.639+0000 7fac7ffff640 1 -- 172.21.15.121:0/486129674 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac800a1c90 con 0x7fac800a37b0 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.639+0000 7fac7ffff640 1 --2- 172.21.15.121:0/486129674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac8009acc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fac70009720 tx=0x7fac7002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158228ce5281cee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.639+0000 7fac7effd640 1 -- 172.21.15.121:0/486129674 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac70037070 con 0x7fac800a37b0 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac7effd640 1 -- 172.21.15.121:0/486129674 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7002ad90 con 0x7fac800a37b0 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac7effd640 1 -- 172.21.15.121:0/486129674 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac70032590 con 0x7fac800a37b0 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 -- 172.21.15.121:0/486129674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 msgr2=0x7fac8009acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:17.643 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 --2- 172.21.15.121:0/486129674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac8009acc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fac70009720 tx=0x7fac7002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 -- 172.21.15.121:0/486129674 shutdown_connections 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 --2- 172.21.15.121:0/486129674 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac8009acc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 -- 172.21.15.121:0/486129674 >> 172.21.15.121:0/486129674 conn(0x7fac800a8430 msgr2=0x7fac800a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 -- 172.21.15.121:0/486129674 shutdown_connections 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.640+0000 7fac86391640 1 -- 172.21.15.121:0/486129674 wait complete. 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.641+0000 7fac86391640 1 Processor -- start 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.641+0000 7fac86391640 1 -- start start 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac86391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac86391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac800a5220 con 0x7fac800a37b0 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:52404/0 (socket says 172.21.15.121:52404) 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7ffff640 1 -- 172.21.15.121:0/2567813087 learned_addr learned my addr 172.21.15.121:0/2567813087 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7ffff640 1 -- 172.21.15.121:0/2567813087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac80072460 con 0x7fac800a37b0 2024-09-15T23:57:17.644 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7ffff640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fac70009840 tx=0x7fac700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:17.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac70041070 con 0x7fac800a37b0 2024-09-15T23:57:17.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7003c460 con 0x7fac800a37b0 2024-09-15T23:57:17.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac70037040 con 0x7fac800a37b0 2024-09-15T23:57:17.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.642+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac80070890 con 0x7fac800a37b0 2024-09-15T23:57:17.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.643+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac800704e0 con 0x7fac800a37b0 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.643+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 25) ==== 45737+0+0 (secure 0 0 0) 0x7fac70044070 con 0x7fac800a37b0 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.644+0000 7fac7cff9640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 0x7fac6c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.644+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8009acc0 con 0x7fac800a37b0 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.644+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 3439+0+0 (secure 0 0 0) 0x7fac7006bee0 con 0x7fac800a37b0 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.644+0000 7fac7f7fe640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 0x7fac6c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:17.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.644+0000 7fac7f7fe640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 0x7fac6c03a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac74000c00 tx=0x7fac74007970 comp rx=0 tx=0).ready entity=mgr.4716 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:17.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.648+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac7004c260 con 0x7fac800a37b0 2024-09-15T23:57:17.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:17.857+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7fac800a1f00 con 0x7fac800a37b0 2024-09-15T23:57:18.248 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.247+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v26) ==== 84+0+0 (secure 0 0 0) 0x7fac7004c4a0 con 0x7fac800a37b0 2024-09-15T23:57:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.250+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 msgr2=0x7fac6c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.250+0000 7fac86391640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 0x7fac6c03a760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac74000c00 tx=0x7fac74007970 comp rx=0 tx=0).stop 2024-09-15T23:57:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.250+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 msgr2=0x7fac801ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac7cff9640 1 -- 172.21.15.121:0/2567813087 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 26) ==== 45746+0+0 (secure 0 0 0) 0x7fac70070070 con 0x7fac800a37b0 2024-09-15T23:57:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fac70009840 tx=0x7fac700046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 shutdown_connections 2024-09-15T23:57:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:6828/3810060514,v1:172.21.15.121:6829/3810060514] conn(0x7fac6c0382a0 0x7fac6c03a760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 --2- 172.21.15.121:0/2567813087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac800a37b0 0x7fac801ca090 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 >> 172.21.15.121:0/2567813087 conn(0x7fac800a8430 msgr2=0x7fac8009f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 shutdown_connections 2024-09-15T23:57:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:18.251+0000 7fac86391640 1 -- 172.21.15.121:0/2567813087 wait complete. 2024-09-15T23:57:18.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:18.268 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --id=admin --selftest) 2024-09-15T23:57:18.377 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.377+0000 7f1599737040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:57:18.418 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.418+0000 7f1599737040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:18.550 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.549+0000 7f1599737040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:57:18.599 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.598+0000 7f1599737040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:57:18.707 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.706+0000 7f1599737040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:18.799 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:18.798+0000 7f1599737040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:57:19.061 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:19.060+0000 7f1599737040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:57:19.104 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:19.103+0000 7f1599737040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:57:19.219 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:19.218+0000 7f1599737040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:57:19.921 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:19.920+0000 7f1599737040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:57:19.963 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:19.963+0000 7f1599737040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:57:20.276 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.275+0000 7f1599737040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:57:20.359 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.358+0000 7f1599737040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:57:20.464 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.463+0000 7f1599737040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:20.510 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.505+0000 7f1599737040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:57:20.615 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.615+0000 7f1599737040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:57:20.667 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.666+0000 7f1599737040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:57:20.708 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.708+0000 7f1599737040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:57:20.819 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.818+0000 7f1599737040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:57:20.867 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.866+0000 7f1599737040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:57:20.918 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.914+0000 7f1599737040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:57:20.967 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:20.966+0000 7f1599737040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:21.008 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.008+0000 7f1599737040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:57:21.050 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.049+0000 7f1599737040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:57:21.615 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.614+0000 7f1599737040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f151b505640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f151b505640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f151b505640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f151b505640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f151b505640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f1518cc0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f1518cc0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.659 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f1518cc0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.660 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f1518cc0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:21.660 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:21.658+0000 7f1518cc0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:22.630 INFO:teuthology.orchestra.run.smithi121.stdout:selftest ok 2024-09-15T23:57:22.638 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-15T23:57:22.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.742+0000 7f64bb531640 1 Processor -- start 2024-09-15T23:57:22.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.742+0000 7f64bb531640 1 -- start start 2024-09-15T23:57:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64bb531640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f64b40a7140 0x7f64b40a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64bb531640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b40a6d10 con 0x7f64b40a4ab0 2024-09-15T23:57:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64bb531640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f64b406e230 con 0x7f64b40a7140 2024-09-15T23:57:22.744 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64b92cd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f64b40a7140 0x7f64b40a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:22.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64b92cd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f64b40a7140 0x7f64b40a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60268/0 (socket says 172.21.15.121:60268) 2024-09-15T23:57:22.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64b92cd640 1 -- 172.21.15.121:0/3637007861 learned_addr learned my addr 172.21.15.121:0/3637007861 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:22.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64b92cd640 1 -- 172.21.15.121:0/3637007861 >> v1:172.21.15.121:6789/0 conn(0x7f64b40a4ab0 legacy=0x7f64b4139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:22.745 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.743+0000 7f64b92cd640 1 -- 172.21.15.121:0/3637007861 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b40a3ae0 con 0x7f64b40a7140 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.744+0000 7f64b92cd640 1 --2- 172.21.15.121:0/3637007861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a7140 0x7f64b40a7520 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009e50 tx=0x7f64b002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9751674ae565a370 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.744+0000 7f64abfff640 1 -- 172.21.15.121:0/3637007861 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b0036070 con 0x7f64b40a7140 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.744+0000 7f64abfff640 1 -- 172.21.15.121:0/3637007861 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b0031400 con 0x7f64b40a7140 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.744+0000 7f64abfff640 1 -- 172.21.15.121:0/3637007861 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00315d0 con 0x7f64b40a7140 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 -- 172.21.15.121:0/3637007861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a7140 msgr2=0x7f64b40a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:22.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 --2- 172.21.15.121:0/3637007861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a7140 0x7f64b40a7520 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009e50 tx=0x7f64b002a730 comp rx=0 tx=0).stop 2024-09-15T23:57:22.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 -- 172.21.15.121:0/3637007861 shutdown_connections 2024-09-15T23:57:22.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 --2- 172.21.15.121:0/3637007861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a7140 0x7f64b40a7520 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:22.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 -- 172.21.15.121:0/3637007861 >> 172.21.15.121:0/3637007861 conn(0x7f64b40ac370 msgr2=0x7f64b40ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:22.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 -- 172.21.15.121:0/3637007861 shutdown_connections 2024-09-15T23:57:22.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.745+0000 7f64bb531640 1 -- 172.21.15.121:0/3637007861 wait complete. 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64bb531640 1 Processor -- start 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64bb531640 1 -- start start 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64bb531640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64bb531640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f64b40a7fc0 con 0x7f64b40a4ab0 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64b92cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64b92cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60276/0 (socket says 172.21.15.121:60276) 2024-09-15T23:57:22.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.746+0000 7f64b92cd640 1 -- 172.21.15.121:0/1223012902 learned_addr learned my addr 172.21.15.121:0/1223012902 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64b92cd640 1 -- 172.21.15.121:0/1223012902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b4125260 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64b92cd640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f64b0000f80 tx=0x7f64b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b0041020 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b0031e00 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b4124820 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b0036040 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.747+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b4124f70 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.748+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 28) ==== 45584+0+0 (secure 0 0 0) 0x7f64b0044020 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.748+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b4122c50 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.748+0000 7f64a9ffb640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 0x7f649803a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.748+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f64b006bde0 con 0x7f64b40a4ab0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.748+0000 7f64b8acc640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 0x7f649803a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:22.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.749+0000 7f64b8acc640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 0x7f649803a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000f60 tx=0x7f64a4007a30 comp rx=0 tx=0).ready entity=mgr.4896 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:22.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.753+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64b004b030 con 0x7f64b40a4ab0 2024-09-15T23:57:22.961 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:22.960+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7f64b40a2680 con 0x7f64b40a4ab0 2024-09-15T23:57:23.623 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.622+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v29) ==== 85+0+0 (secure 0 0 0) 0x7f64b40a2680 con 0x7f64b40a4ab0 2024-09-15T23:57:23.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64a9ffb640 1 -- 172.21.15.121:0/1223012902 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f64b003c470 con 0x7f64b40a4ab0 2024-09-15T23:57:23.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 msgr2=0x7f649803a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:23.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 0x7f649803a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000f60 tx=0x7f64a4007a30 comp rx=0 tx=0).stop 2024-09-15T23:57:23.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 msgr2=0x7f64b40a1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f64b0000f80 tx=0x7f64b0004a40 comp rx=0 tx=0).stop 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 shutdown_connections 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f64980380f0 0x7f649803a5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 --2- 172.21.15.121:0/1223012902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f64b40a4ab0 0x7f64b40a1130 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 >> 172.21.15.121:0/1223012902 conn(0x7f64b40ac370 msgr2=0x7f64b40a8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 shutdown_connections 2024-09-15T23:57:23.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.625+0000 7f64bb531640 1 -- 172.21.15.121:0/1223012902 wait complete. 2024-09-15T23:57:23.642 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:23.642 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:23.685 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:23.685 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:23.686 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:23.686 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:23.743 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:23.755 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:23.754+0000 7fb289b1e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:57:23.798 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:23.797+0000 7fb289b1e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:23.854 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.853+0000 7f60059a1640 1 Processor -- start 2024-09-15T23:57:23.855 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.854+0000 7f60059a1640 1 -- start start 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.854+0000 7f60059a1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6000133640 0x7f600013b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.854+0000 7f60059a1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60000a16c0 con 0x7f60000a39c0 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.854+0000 7f60059a1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f60000a1490 con 0x7f6000133640 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ffeffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f60000a39c0 0x7f6000132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60176/0 (socket says 172.21.15.121:60176) 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ffeffd640 1 -- 172.21.15.121:0/4054932200 learned_addr learned my addr 172.21.15.121:0/4054932200 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ff7fff640 1 --2- 172.21.15.121:0/4054932200 >> v2:172.21.15.121:3300/0 conn(0x7f6000133640 0x7f600013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ffe7fc640 1 -- 172.21.15.121:0/4054932200 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789347814 0 0) 0x7f60000a16c0 con 0x7f60000a39c0 2024-09-15T23:57:23.856 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ffe7fc640 1 -- 172.21.15.121:0/4054932200 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fec003520 con 0x7f60000a39c0 2024-09-15T23:57:23.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ff7fff640 1 -- 172.21.15.121:0/4054932200 >> v1:172.21.15.121:6789/0 conn(0x7f60000a39c0 legacy=0x7f6000132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:23.857 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.855+0000 7f5ff7fff640 1 -- 172.21.15.121:0/4054932200 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60000a4010 con 0x7f6000133640 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.856+0000 7f5ff7fff640 1 --2- 172.21.15.121:0/4054932200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6000133640 0x7f600013b270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009720 tx=0x7f5fe802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e56633b59c92a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.856+0000 7f5ffe7fc640 1 -- 172.21.15.121:0/4054932200 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8037070 con 0x7f6000133640 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.856+0000 7f5ffe7fc640 1 -- 172.21.15.121:0/4054932200 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe802ad90 con 0x7f6000133640 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.856+0000 7f5ffe7fc640 1 -- 172.21.15.121:0/4054932200 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8032590 con 0x7f6000133640 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 -- 172.21.15.121:0/4054932200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6000133640 msgr2=0x7f600013b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 --2- 172.21.15.121:0/4054932200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6000133640 0x7f600013b270 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009720 tx=0x7f5fe802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:23.858 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 -- 172.21.15.121:0/4054932200 shutdown_connections 2024-09-15T23:57:23.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 --2- 172.21.15.121:0/4054932200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6000133640 0x7f600013b270 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:23.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 -- 172.21.15.121:0/4054932200 >> 172.21.15.121:0/4054932200 conn(0x7f60000a85e0 msgr2=0x7f60000a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:23.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 -- 172.21.15.121:0/4054932200 shutdown_connections 2024-09-15T23:57:23.859 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.857+0000 7f60059a1640 1 -- 172.21.15.121:0/4054932200 wait complete. 2024-09-15T23:57:23.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f60059a1640 1 Processor -- start 2024-09-15T23:57:23.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f60059a1640 1 -- start start 2024-09-15T23:57:23.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f60059a1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:23.861 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f60059a1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60001329c0 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60304/0 (socket says 172.21.15.121:60304) 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.858+0000 7f5ffeffd640 1 -- 172.21.15.121:0/270443538 learned_addr learned my addr 172.21.15.121:0/270443538 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f5ffeffd640 1 -- 172.21.15.121:0/270443538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6000071970 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f5ffeffd640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c390 tx=0x7f5ff000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff0017070 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0005c10 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff00070d0 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6000073430 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.859+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60001312b0 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f5ff001a070 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60000a2340 con 0x7f60000a39c0 2024-09-15T23:57:23.862 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f5ffcff9640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 0x7f5fe003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:23.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f5ff7fff640 1 -- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 msgr2=0x7f5fe003a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:23.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f5ff004a790 con 0x7f60000a39c0 2024-09-15T23:57:23.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.860+0000 7f5ff7fff640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 0x7f5fe003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:23.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:23.865+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ff0019e10 con 0x7f60000a39c0 2024-09-15T23:57:23.933 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:23.932+0000 7fb289b1e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:57:23.981 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:23.980+0000 7fb289b1e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:57:24.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.044+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6000073660 con 0x7f60000a39c0 2024-09-15T23:57:24.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.045+0000 7f5ffcff9640 1 -- 172.21.15.121:0/270443538 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v58) ==== 80+0+358 (secure 0 0 0) 0x7f5ff0010b90 con 0x7f60000a39c0 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/3810060514 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6828/3810060514 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1007260614 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/566597017 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3026375199 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/485194523 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.046 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 msgr2=0x7f5fe003a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 0x7f5fe003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 msgr2=0x7f600006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c390 tx=0x7f5ff000c850 comp rx=0 tx=0).stop 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 shutdown_connections 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f5fe0038330 0x7f5fe003a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 --2- 172.21.15.121:0/270443538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60000a39c0 0x7f600006e950 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 >> 172.21.15.121:0/270443538 conn(0x7f60000a85e0 msgr2=0x7f60000a7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 shutdown_connections 2024-09-15T23:57:24.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.047+0000 7f60059a1640 1 -- 172.21.15.121:0/270443538 wait complete. 2024-09-15T23:57:24.058 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:57:24.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:24.059 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:24.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[54108]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:24.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:57:24.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:24.084 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:57:24.094 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:24.093+0000 7fb289b1e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:24.189 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:24.188+0000 7fb289b1e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:57:24.219 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:24.219 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:24.219 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:24.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:24.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.415+0000 7f1ad5142640 1 Processor -- start 2024-09-15T23:57:24.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.415+0000 7f1ad5142640 1 -- start start 2024-09-15T23:57:24.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1ad5142640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ad013a280 0x7f1ad013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1ad5142640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad013a080 con 0x7f1ad00a4c20 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1ad5142640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad00a3d50 con 0x7f1ad013a280 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1aced9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1ad013a280 0x7f1ad013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1ace59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1ad00a4c20 0x7f1ad00a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60192/0 (socket says 172.21.15.121:60192) 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1ace59c640 1 -- 172.21.15.121:0/3335877289 learned_addr learned my addr 172.21.15.121:0/3335877289 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1aced9d640 1 -- 172.21.15.121:0/3335877289 >> v1:172.21.15.121:6789/0 conn(0x7f1ad00a4c20 legacy=0x7f1ad00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1acdd9b640 1 -- 172.21.15.121:0/3335877289 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2561168607 0 0) 0x7f1ad013a080 con 0x7f1ad00a4c20 2024-09-15T23:57:24.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.416+0000 7f1aced9d640 1 -- 172.21.15.121:0/3335877289 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad00a3f80 con 0x7f1ad013a280 2024-09-15T23:57:24.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.417+0000 7f1aced9d640 1 --2- 172.21.15.121:0/3335877289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad013a280 0x7f1ad013a660 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009720 tx=0x7f1ac002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6315c7224933a3b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:24.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.417+0000 7f1acdd9b640 1 -- 172.21.15.121:0/3335877289 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0037070 con 0x7f1ad013a280 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.417+0000 7f1acdd9b640 1 -- 172.21.15.121:0/3335877289 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac002ad90 con 0x7f1ad013a280 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.417+0000 7f1acdd9b640 1 -- 172.21.15.121:0/3335877289 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0032590 con 0x7f1ad013a280 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 -- 172.21.15.121:0/3335877289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad013a280 msgr2=0x7f1ad013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3335877289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad013a280 0x7f1ad013a660 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009720 tx=0x7f1ac002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 -- 172.21.15.121:0/3335877289 shutdown_connections 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3335877289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad013a280 0x7f1ad013a660 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 -- 172.21.15.121:0/3335877289 >> 172.21.15.121:0/3335877289 conn(0x7f1ad00ac3e0 msgr2=0x7f1ad00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 -- 172.21.15.121:0/3335877289 shutdown_connections 2024-09-15T23:57:24.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.418+0000 7f1ad5142640 1 -- 172.21.15.121:0/3335877289 wait complete. 2024-09-15T23:57:24.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.419+0000 7f1ad5142640 1 Processor -- start 2024-09-15T23:57:24.422 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.419+0000 7f1ad5142640 1 -- start start 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1ad5142640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1ad5142640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0139d40 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1aced9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1aced9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60332/0 (socket says 172.21.15.121:60332) 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1aced9d640 1 -- 172.21.15.121:0/3154012927 learned_addr learned my addr 172.21.15.121:0/3154012927 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1aced9d640 1 -- 172.21.15.121:0/3154012927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad0124fa0 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1aced9d640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009720 tx=0x7f1ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0041070 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac003c460 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.420+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac0037040 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.421+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad0137fd0 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.421+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad01228e0 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.421+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f1ac0044070 con 0x7f1ad00a4c20 2024-09-15T23:57:24.423 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.421+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad006dab0 con 0x7f1ad00a4c20 2024-09-15T23:57:24.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.422+0000 7f1ac77fe640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 0x7f1ab003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.422+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f1ac006be30 con 0x7f1ad00a4c20 2024-09-15T23:57:24.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.422+0000 7f1ace59c640 1 -- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 msgr2=0x7f1ab003a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:24.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.422+0000 7f1ace59c640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 0x7f1ab003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:24.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.426+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ac003a520 con 0x7f1ad00a4c20 2024-09-15T23:57:24.467 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:24.466+0000 7fb289b1e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:57:24.512 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:24.511+0000 7fb289b1e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:57:24.610 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.609+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ad00a2f50 con 0x7f1ad00a4c20 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.610+0000 7f1ac77fe640 1 -- 172.21.15.121:0/3154012927 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v58) ==== 80+0+358 (secure 0 0 0) 0x7f1ac003a780 con 0x7f1ad00a4c20 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6829/3810060514 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:6828/3810060514 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/1007260614 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/566597017 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/3026375199 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.611 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121:0/485194523 2024-09-16T23:57:21.616754+0000 2024-09-15T23:57:24.612 INFO:teuthology.orchestra.run.smithi121.stderr:listed 6 entries 2024-09-15T23:57:24.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 msgr2=0x7f1ab003a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:24.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 0x7f1ab003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 msgr2=0x7f1ad00a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009720 tx=0x7f1ac00046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 shutdown_connections 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f1ab0038330 0x7f1ab003a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 --2- 172.21.15.121:0/3154012927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ad00a4c20 0x7f1ad00a1020 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 >> 172.21.15.121:0/3154012927 conn(0x7f1ad00ac3e0 msgr2=0x7f1ad00aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 shutdown_connections 2024-09-15T23:57:24.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.612+0000 7f1ad5142640 1 -- 172.21.15.121:0/3154012927 wait complete. 2024-09-15T23:57:24.624 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:57:24.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:24.624 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:24.634 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:24.633+0000 7fb289b1e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:57:24.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[54525]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:24.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:57:24.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:24.649 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:57:24.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:24.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.865+0000 7f76a0b52640 1 Processor -- start 2024-09-15T23:57:24.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.865+0000 7f76a0b52640 1 -- start start 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f76a0b52640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f769c0a4c20 0x7f769c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f76a0b52640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c13a080 con 0x7f769c13a280 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f76a0b52640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f769c0a3d50 con 0x7f769c0a4c20 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f7699d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f769c0a4c20 0x7f769c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f769a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f769c13a280 0x7f769c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60198/0 (socket says 172.21.15.121:60198) 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f769a59c640 1 -- 172.21.15.121:0/1605362950 learned_addr learned my addr 172.21.15.121:0/1605362950 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f7699d9b640 1 -- 172.21.15.121:0/1605362950 >> v1:172.21.15.121:6789/0 conn(0x7f769c13a280 legacy=0x7f769c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.866+0000 7f7699d9b640 1 -- 172.21.15.121:0/1605362950 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0a3f80 con 0x7f769c0a4c20 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f7699d9b640 1 --2- 172.21.15.121:0/1605362950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c13f060 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7690009720 tx=0x7f769002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8da59268abf3305 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f769959a640 1 -- 172.21.15.121:0/1605362950 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7690037070 con 0x7f769c0a4c20 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f769959a640 1 -- 172.21.15.121:0/1605362950 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769002ad90 con 0x7f769c0a4c20 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f769959a640 1 -- 172.21.15.121:0/1605362950 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7690032590 con 0x7f769c0a4c20 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f76a0b52640 1 -- 172.21.15.121:0/1605362950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 msgr2=0x7f769c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.867+0000 7f76a0b52640 1 --2- 172.21.15.121:0/1605362950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c13f060 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7690009720 tx=0x7f769002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.868+0000 7f76a0b52640 1 -- 172.21.15.121:0/1605362950 shutdown_connections 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.868+0000 7f76a0b52640 1 --2- 172.21.15.121:0/1605362950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c13f060 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.868+0000 7f76a0b52640 1 -- 172.21.15.121:0/1605362950 >> 172.21.15.121:0/1605362950 conn(0x7f769c0ac3e0 msgr2=0x7f769c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.868+0000 7f76a0b52640 1 -- 172.21.15.121:0/1605362950 shutdown_connections 2024-09-15T23:57:24.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.868+0000 7f76a0b52640 1 -- 172.21.15.121:0/1605362950 wait complete. 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f76a0b52640 1 Processor -- start 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f76a0b52640 1 -- start start 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f76a0b52640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f76a0b52640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0a7ec0 con 0x7f769c0a4c20 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f769a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f769a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60350/0 (socket says 172.21.15.121:60350) 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f769a59c640 1 -- 172.21.15.121:0/117919914 learned_addr learned my addr 172.21.15.121:0/117919914 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.869+0000 7f769a59c640 1 -- 172.21.15.121:0/117919914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c125070 con 0x7f769c0a4c20 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f769a59c640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c4a0 tx=0x7f768c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f768c017070 con 0x7f769c0a4c20 2024-09-15T23:57:24.872 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f768c005c10 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f768c007070 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c124780 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.870+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c124470 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f768c01a070 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f768affd640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 0x7f767c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f768c04a650 con 0x7f769c0a4c20 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f7699d9b640 1 -- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 msgr2=0x7f767c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f7699d9b640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 0x7f767c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:24.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.871+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c122c20 con 0x7f769c0a4c20 2024-09-15T23:57:24.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:24.876+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f768c01b3b0 con 0x7f769c0a4c20 2024-09-15T23:57:25.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.072+0000 7f7699d9b640 1 -- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 msgr2=0x7f767c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:25.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.072+0000 7f7699d9b640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 0x7f767c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:25.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.079+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f769c124950 con 0x7f769c0a4c20 2024-09-15T23:57:25.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.079+0000 7f768affd640 1 -- 172.21.15.121:0/117919914 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7f768c010c00 con 0x7f769c0a4c20 2024-09-15T23:57:25.080 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:25.080 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:25.080 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 msgr2=0x7f767c03a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 0x7f767c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 msgr2=0x7f769c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c4a0 tx=0x7f768c00c960 comp rx=0 tx=0).stop 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 shutdown_connections 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f767c038330 0x7f767c03a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 --2- 172.21.15.121:0/117919914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f769c0a4c20 0x7f769c0a0ff0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 >> 172.21.15.121:0/117919914 conn(0x7f769c0ac3e0 msgr2=0x7f769c0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 shutdown_connections 2024-09-15T23:57:25.083 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.081+0000 7f76a0b52640 1 -- 172.21.15.121:0/117919914 wait complete. 2024-09-15T23:57:25.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:25.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.191+0000 7f54d0bf6640 1 Processor -- start 2024-09-15T23:57:25.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.191+0000 7f54d0bf6640 1 -- start start 2024-09-15T23:57:25.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54d0bf6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54cc0a4c20 0x7f54cc13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54d0bf6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc13a080 con 0x7f54cc13a280 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54d0bf6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f54cc0a3d50 con 0x7f54cc0a4c20 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54c9d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54cc0a4c20 0x7f54cc13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54ca59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f54cc13a280 0x7f54cc13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60212/0 (socket says 172.21.15.121:60212) 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54c9d9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f54cc0a4c20 0x7f54cc13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60364/0 (socket says 172.21.15.121:60364) 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.192+0000 7f54ca59c640 1 -- 172.21.15.121:0/3291526907 learned_addr learned my addr 172.21.15.121:0/3291526907 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c9d9b640 1 -- 172.21.15.121:0/3291526907 >> v1:172.21.15.121:6789/0 conn(0x7f54cc13a280 legacy=0x7f54cc13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c959a640 1 -- 172.21.15.121:0/3291526907 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693927449 0 0) 0x7f54cc13a080 con 0x7f54cc13a280 2024-09-15T23:57:25.194 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c9d9b640 1 -- 172.21.15.121:0/3291526907 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc0a3f80 con 0x7f54cc0a4c20 2024-09-15T23:57:25.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c9d9b640 1 --2- 172.21.15.121:0/3291526907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc13f060 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009720 tx=0x7f54b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b57f8ac6baf8ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.195 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c959a640 1 -- 172.21.15.121:0/3291526907 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b4037070 con 0x7f54cc0a4c20 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c959a640 1 -- 172.21.15.121:0/3291526907 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b402ad90 con 0x7f54cc0a4c20 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.193+0000 7f54c959a640 1 -- 172.21.15.121:0/3291526907 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54b4032590 con 0x7f54cc0a4c20 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 -- 172.21.15.121:0/3291526907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 msgr2=0x7f54cc13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/3291526907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc13f060 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009720 tx=0x7f54b402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 -- 172.21.15.121:0/3291526907 shutdown_connections 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/3291526907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc13f060 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 -- 172.21.15.121:0/3291526907 >> 172.21.15.121:0/3291526907 conn(0x7f54cc0ac3e0 msgr2=0x7f54cc0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 -- 172.21.15.121:0/3291526907 shutdown_connections 2024-09-15T23:57:25.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.194+0000 7f54d0bf6640 1 -- 172.21.15.121:0/3291526907 wait complete. 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.195+0000 7f54d0bf6640 1 Processor -- start 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.195+0000 7f54d0bf6640 1 -- start start 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54d0bf6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54d0bf6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0a7ec0 con 0x7f54cc0a4c20 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54ca59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54ca59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60376/0 (socket says 172.21.15.121:60376) 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54ca59c640 1 -- 172.21.15.121:0/1071340205 learned_addr learned my addr 172.21.15.121:0/1071340205 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54ca59c640 1 -- 172.21.15.121:0/1071340205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc124f10 con 0x7f54cc0a4c20 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54ca59c640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00c420 tx=0x7f54bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54bc018070 con 0x7f54cc0a4c20 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc0074d0 con 0x7f54cc0a4c20 2024-09-15T23:57:25.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc124690 con 0x7f54cc0a4c20 2024-09-15T23:57:25.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54bc004950 con 0x7f54cc0a4c20 2024-09-15T23:57:25.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.196+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc1238a0 con 0x7f54cc0a4c20 2024-09-15T23:57:25.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.197+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc122b30 con 0x7f54cc0a4c20 2024-09-15T23:57:25.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.197+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f54bc01b070 con 0x7f54cc0a4c20 2024-09-15T23:57:25.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.198+0000 7f54c2ffd640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 0x7f54ac03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.198+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f54bc04a710 con 0x7f54cc0a4c20 2024-09-15T23:57:25.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.198+0000 7f54c9d9b640 1 -- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 msgr2=0x7f54ac03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:25.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.198+0000 7f54c9d9b640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 0x7f54ac03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:25.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.202+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54bc011980 con 0x7f54cc0a4c20 2024-09-15T23:57:25.375 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:25.374+0000 7fb289b1e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:57:25.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.399+0000 7f54c9d9b640 1 -- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 msgr2=0x7f54ac03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:25.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.399+0000 7f54c9d9b640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 0x7f54ac03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.413+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54cc0a2f00 con 0x7f54cc0a4c20 2024-09-15T23:57:25.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.413+0000 7f54c2ffd640 1 -- 172.21.15.121:0/1071340205 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7f54bc011be0 con 0x7f54cc0a4c20 2024-09-15T23:57:25.418 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:25.418 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:25.418 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 msgr2=0x7f54ac03a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 0x7f54ac03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 msgr2=0x7f54cc0a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00c420 tx=0x7f54bc00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 shutdown_connections 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f54ac038330 0x7f54ac03a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 --2- 172.21.15.121:0/1071340205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54cc0a4c20 0x7f54cc0a1080 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 >> 172.21.15.121:0/1071340205 conn(0x7f54cc0ac3e0 msgr2=0x7f54cc139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 shutdown_connections 2024-09-15T23:57:25.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.415+0000 7f54d0bf6640 1 -- 172.21.15.121:0/1071340205 wait complete. 2024-09-15T23:57:25.421 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:25.420+0000 7fb289b1e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:57:25.427 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.525+0000 7fb44ed13640 1 Processor -- start 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.525+0000 7fb44ed13640 1 -- start start 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb44ed13640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb4480a4c20 0x7fb44813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb44ed13640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44813a080 con 0x7fb44813a280 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb44ed13640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb4480a3d50 con 0x7fb4480a4c20 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb447fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb4480a4c20 0x7fb44813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.527 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb44caaf640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb44813a280 0x7fb44813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60228/0 (socket says 172.21.15.121:60228) 2024-09-15T23:57:25.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb44caaf640 1 -- 172.21.15.121:0/84124971 learned_addr learned my addr 172.21.15.121:0/84124971 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:25.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb447fff640 1 -- 172.21.15.121:0/84124971 >> v1:172.21.15.121:6789/0 conn(0x7fb44813a280 legacy=0x7fb44813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb447fff640 1 -- 172.21.15.121:0/84124971 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4480a3f80 con 0x7fb4480a4c20 2024-09-15T23:57:25.528 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.526+0000 7fb4477fe640 1 -- 172.21.15.121:0/84124971 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368427004 0 0) 0x7fb44813a080 con 0x7fb44813a280 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.527+0000 7fb447fff640 1 --2- 172.21.15.121:0/84124971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb44813f060 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb434009720 tx=0x7fb43402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5132439b312135b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.527+0000 7fb4477fe640 1 -- 172.21.15.121:0/84124971 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434037070 con 0x7fb4480a4c20 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.527+0000 7fb4477fe640 1 -- 172.21.15.121:0/84124971 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43402ad90 con 0x7fb4480a4c20 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.527+0000 7fb4477fe640 1 -- 172.21.15.121:0/84124971 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb434032590 con 0x7fb4480a4c20 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 -- 172.21.15.121:0/84124971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 msgr2=0x7fb44813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 --2- 172.21.15.121:0/84124971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb44813f060 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb434009720 tx=0x7fb43402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 -- 172.21.15.121:0/84124971 shutdown_connections 2024-09-15T23:57:25.529 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 --2- 172.21.15.121:0/84124971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb44813f060 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 -- 172.21.15.121:0/84124971 >> 172.21.15.121:0/84124971 conn(0x7fb4480ac3e0 msgr2=0x7fb4480ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 -- 172.21.15.121:0/84124971 shutdown_connections 2024-09-15T23:57:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.528+0000 7fb44ed13640 1 -- 172.21.15.121:0/84124971 wait complete. 2024-09-15T23:57:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.529+0000 7fb44ed13640 1 Processor -- start 2024-09-15T23:57:25.530 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.529+0000 7fb44ed13640 1 -- start start 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44ed13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44ed13640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb4480a7ec0 con 0x7fb4480a4c20 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44caaf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44caaf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60406/0 (socket says 172.21.15.121:60406) 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44caaf640 1 -- 172.21.15.121:0/608749119 learned_addr learned my addr 172.21.15.121:0/608749119 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.530+0000 7fb44caaf640 1 -- 172.21.15.121:0/608749119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4480a2a70 con 0x7fb4480a4c20 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb44caaf640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c420 tx=0x7fb43c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c018070 con 0x7fb4480a4c20 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43c0074d0 con 0x7fb4480a4c20 2024-09-15T23:57:25.532 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44809f760 con 0x7fb4480a4c20 2024-09-15T23:57:25.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb43c004950 con 0x7fb4480a4c20 2024-09-15T23:57:25.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.531+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44809f480 con 0x7fb4480a4c20 2024-09-15T23:57:25.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4480a2f50 con 0x7fb4480a4c20 2024-09-15T23:57:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7fb43c01b070 con 0x7fb4480a4c20 2024-09-15T23:57:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb4457fa640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 0x7fb42c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7fb43c04a710 con 0x7fb4480a4c20 2024-09-15T23:57:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb447fff640 1 -- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 msgr2=0x7fb42c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:25.534 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.532+0000 7fb447fff640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 0x7fb42c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:25.537 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.536+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb43c011bf0 con 0x7fb4480a4c20 2024-09-15T23:57:25.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.706+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4480732e0 con 0x7fb4480a4c20 2024-09-15T23:57:25.708 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.707+0000 7fb4457fa640 1 -- 172.21.15.121:0/608749119 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+11059 (secure 0 0 0) 0x7fb43c01c8d0 con 0x7fb4480a4c20 2024-09-15T23:57:25.708 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:25.708 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":58,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:21.616784+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:08.177705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:08.542745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6829/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:6828/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/1007260614":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/566597017":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/3026375199":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/485194523":"2024-09-16T23:57:21.616754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:25.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 msgr2=0x7fb42c03a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:25.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 0x7fb42c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 msgr2=0x7fb4480a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c420 tx=0x7fb43c00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.710 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 shutdown_connections 2024-09-15T23:57:25.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7fb42c038330 0x7fb42c03a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 --2- 172.21.15.121:0/608749119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4480a4c20 0x7fb4480a1d10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 >> 172.21.15.121:0/608749119 conn(0x7fb4480ac3e0 msgr2=0x7fb4480a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 shutdown_connections 2024-09-15T23:57:25.711 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.709+0000 7fb44ed13640 1 -- 172.21.15.121:0/608749119 wait complete. 2024-09-15T23:57:25.721 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:57:25.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:25.745 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:25.745+0000 7fb289b1e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:57:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.820+0000 7f9e91d42640 1 Processor -- start 2024-09-15T23:57:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.820+0000 7f9e91d42640 1 -- start start 2024-09-15T23:57:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e91d42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e8c13a280 0x7f9e8c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e91d42640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8c13a080 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.822 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e91d42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c0a3d50 con 0x7f9e8c13a280 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e8b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9e8c13a280 0x7f9e8c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e83fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9e8c0a4c20 0x7f9e8c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60238/0 (socket says 172.21.15.121:60238) 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e83fff640 1 -- 172.21.15.121:0/4147811108 learned_addr learned my addr 172.21.15.121:0/4147811108 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e8b7fe640 1 --2- 172.21.15.121:0/4147811108 >> v2:172.21.15.121:3300/0 conn(0x7f9e8c13a280 0x7f9e8c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60420/0 (socket says 172.21.15.121:60420) 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e8b7fe640 1 -- 172.21.15.121:0/4147811108 >> v1:172.21.15.121:6789/0 conn(0x7f9e8c0a4c20 legacy=0x7f9e8c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.823 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.821+0000 7f9e8b7fe640 1 -- 172.21.15.121:0/4147811108 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c0a3f80 con 0x7f9e8c13a280 2024-09-15T23:57:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.822+0000 7f9e8b7fe640 1 --2- 172.21.15.121:0/4147811108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c13a280 0x7f9e8c13a660 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009720 tx=0x7f9e7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a98358df3697ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.822+0000 7f9e8affd640 1 -- 172.21.15.121:0/4147811108 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e7c037070 con 0x7f9e8c13a280 2024-09-15T23:57:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.822+0000 7f9e8affd640 1 -- 172.21.15.121:0/4147811108 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c02ad90 con 0x7f9e8c13a280 2024-09-15T23:57:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.822+0000 7f9e8affd640 1 -- 172.21.15.121:0/4147811108 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e7c032590 con 0x7f9e8c13a280 2024-09-15T23:57:25.824 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 -- 172.21.15.121:0/4147811108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c13a280 msgr2=0x7f9e8c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 --2- 172.21.15.121:0/4147811108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c13a280 0x7f9e8c13a660 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009720 tx=0x7f9e7c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 -- 172.21.15.121:0/4147811108 shutdown_connections 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 --2- 172.21.15.121:0/4147811108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c13a280 0x7f9e8c13a660 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 -- 172.21.15.121:0/4147811108 >> 172.21.15.121:0/4147811108 conn(0x7f9e8c0ac3e0 msgr2=0x7f9e8c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 -- 172.21.15.121:0/4147811108 shutdown_connections 2024-09-15T23:57:25.825 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.823+0000 7f9e91d42640 1 -- 172.21.15.121:0/4147811108 wait complete. 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e91d42640 1 Processor -- start 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e91d42640 1 -- start start 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e91d42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e91d42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c139d40 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e8b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60428/0 (socket says 172.21.15.121:60428) 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.824+0000 7f9e8b7fe640 1 -- 172.21.15.121:0/709524156 learned_addr learned my addr 172.21.15.121:0/709524156 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:25.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e8b7fe640 1 -- 172.21.15.121:0/709524156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c124ff0 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e8b7fe640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009840 tx=0x7f9e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e7c041020 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c03d550 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c125270 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e7c037040 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.825+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c138290 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f9e7c044020 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e88ff9640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 0x7f9e6c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e83fff640 1 -- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 msgr2=0x7f9e6c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f9e7c06ba60 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e83fff640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 0x7f9e6c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:25.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.826+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c06dab0 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.832 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:25.831+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e7c04b030 con 0x7f9e8c0a4c20 2024-09-15T23:57:25.836 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:25.835+0000 7fb289b1e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:57:25.960 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:25.959+0000 7fb289b1e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:26.002 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.001+0000 7fb289b1e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:57:26.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.027+0000 7f9e83fff640 1 -- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 msgr2=0x7f9e6c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:26.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.027+0000 7f9e83fff640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 0x7f9e6c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:26.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.057+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8c0a2f50 con 0x7f9e8c0a4c20 2024-09-15T23:57:26.058 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.057+0000 7f9e88ff9640 1 -- 172.21.15.121:0/709524156 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7f9e8c124ff0 con 0x7f9e8c0a4c20 2024-09-15T23:57:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:26.058 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:26.059 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 msgr2=0x7f9e6c03a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 0x7f9e6c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 msgr2=0x7f9e8c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009840 tx=0x7f9e7c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 shutdown_connections 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f9e6c038330 0x7f9e6c03a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 --2- 172.21.15.121:0/709524156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e8c0a4c20 0x7f9e8c0a1150 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 >> 172.21.15.121:0/709524156 conn(0x7f9e8c0ac3e0 msgr2=0x7f9e8c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.059+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 shutdown_connections 2024-09-15T23:57:26.061 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.060+0000 7f9e91d42640 1 -- 172.21.15.121:0/709524156 wait complete. 2024-09-15T23:57:26.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:26.117 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.116+0000 7fb289b1e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:57:26.172 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.171+0000 7fb289b1e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:57:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.210+0000 7ff90bcc9640 1 Processor -- start 2024-09-15T23:57:26.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff90bcc9640 1 -- start start 2024-09-15T23:57:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff90bcc9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff90413a4b0 0x7ff9040a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff90bcc9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9040a8340 con 0x7ff9040a4c20 2024-09-15T23:57:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff90bcc9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff9040a3d50 con 0x7ff90413a4b0 2024-09-15T23:57:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff909a65640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff90413a4b0 0x7ff9040a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff909a65640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff90413a4b0 0x7ff9040a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60434/0 (socket says 172.21.15.121:60434) 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff909264640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff9040a4c20 0x7ff9040a70d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60242/0 (socket says 172.21.15.121:60242) 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.211+0000 7ff909a65640 1 -- 172.21.15.121:0/1371683419 learned_addr learned my addr 172.21.15.121:0/1371683419 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff909a65640 1 -- 172.21.15.121:0/1371683419 >> v1:172.21.15.121:6789/0 conn(0x7ff9040a4c20 legacy=0x7ff9040a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff909a65640 1 -- 172.21.15.121:0/1371683419 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90413a080 con 0x7ff90413a4b0 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff909a65640 1 --2- 172.21.15.121:0/1371683419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff90413a4b0 0x7ff9040a6b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff9000097f0 tx=0x7ff90002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48882f02a7a0375 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff908a63640 1 -- 172.21.15.121:0/1371683419 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff900037070 con 0x7ff90413a4b0 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff908a63640 1 -- 172.21.15.121:0/1371683419 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff900032440 con 0x7ff90413a4b0 2024-09-15T23:57:26.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.212+0000 7ff908a63640 1 -- 172.21.15.121:0/1371683419 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff90002ae60 con 0x7ff90413a4b0 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1371683419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff90413a4b0 msgr2=0x7ff9040a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1371683419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff90413a4b0 0x7ff9040a6b90 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff9000097f0 tx=0x7ff90002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1371683419 shutdown_connections 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1371683419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff90413a4b0 0x7ff9040a6b90 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1371683419 >> 172.21.15.121:0/1371683419 conn(0x7ff9040ac370 msgr2=0x7ff9040ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1371683419 shutdown_connections 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.213+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1371683419 wait complete. 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.214+0000 7ff90bcc9640 1 Processor -- start 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.214+0000 7ff90bcc9640 1 -- start start 2024-09-15T23:57:26.216 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.214+0000 7ff90bcc9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.214+0000 7ff90bcc9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff904139cd0 con 0x7ff9040a4c20 2024-09-15T23:57:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff909a65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff909a65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60440/0 (socket says 172.21.15.121:60440) 2024-09-15T23:57:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff909a65640 1 -- 172.21.15.121:0/1017569036 learned_addr learned my addr 172.21.15.121:0/1017569036 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:26.217 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff909a65640 1 -- 172.21.15.121:0/1017569036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff904125950 con 0x7ff9040a4c20 2024-09-15T23:57:26.217 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.215+0000 7fb289b1e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff909a65640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff900035040 tx=0x7ff9000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff900041070 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90003c7a0 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff904138420 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff900037040 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.215+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff904124c70 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.216+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90406d7e0 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.216+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7ff900044070 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.217+0000 7ff8fa7fc640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 0x7ff8e803a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.217+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7ff90006bed0 con 0x7ff9040a4c20 2024-09-15T23:57:26.219 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.217+0000 7ff909264640 1 -- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 msgr2=0x7ff8e803a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:26.220 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.217+0000 7ff909264640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 0x7ff8e803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:26.222 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.221+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff90003a760 con 0x7ff9040a4c20 2024-09-15T23:57:26.337 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.337+0000 7fb289b1e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:57:26.387 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.386+0000 7fb289b1e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:57:26.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.418+0000 7ff909264640 1 -- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 msgr2=0x7ff8e803a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:26.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.418+0000 7ff909264640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 0x7ff8e803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:26.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.432+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9040a2f50 con 0x7ff9040a4c20 2024-09-15T23:57:26.434 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.433+0000 7ff8fa7fc640 1 -- 172.21.15.121:0/1017569036 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3581 (secure 0 0 0) 0x7ff90003d3f0 con 0x7ff9040a4c20 2024-09-15T23:57:26.434 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:26.434 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":30,"btime":"2024-09-15T23:57:12:237346+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:09.570850+0000","modified":"2024-09-15T23:57:11.564778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4823":{"gid":4823,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6824/2407589341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6825","nonce":2407589341},{"type":"v1","addr":"172.21.15.121:6824","nonce":2407589341}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4823,"qdb_cluster":[4823]},"id":5}]} 2024-09-15T23:57:26.435 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 30 2024-09-15T23:57:26.436 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 msgr2=0x7ff8e803a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 0x7ff8e803a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 msgr2=0x7ff9041366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff900035040 tx=0x7ff9000046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 shutdown_connections 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7ff8e8038330 0x7ff8e803a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 --2- 172.21.15.121:0/1017569036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9040a4c20 0x7ff9041366a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 >> 172.21.15.121:0/1017569036 conn(0x7ff9040ac370 msgr2=0x7ff9040a8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 shutdown_connections 2024-09-15T23:57:26.437 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.435+0000 7ff90bcc9640 1 -- 172.21.15.121:0/1017569036 wait complete. 2024-09-15T23:57:26.437 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.435+0000 7fb289b1e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:57:26.447 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:26.490 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.490+0000 7fb289b1e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:26.535 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.535+0000 7fb289b1e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:57:26.579 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:26.578+0000 7fb289b1e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:57:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.587+0000 7f762a352640 1 Processor -- start 2024-09-15T23:57:26.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.587+0000 7f762a352640 1 -- start start 2024-09-15T23:57:26.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f762a352640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f762413a280 0x7f762413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f762a352640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762413a080 con 0x7f76240a4c20 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f762a352640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f76240a3d50 con 0x7f762413a280 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f7623fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f762413a280 0x7f762413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f76237fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f76240a4c20 0x7f76240a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60248/0 (socket says 172.21.15.121:60248) 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f7623fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f762413a280 0x7f762413a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60454/0 (socket says 172.21.15.121:60454) 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f76237fe640 1 -- 172.21.15.121:0/531504903 learned_addr learned my addr 172.21.15.121:0/531504903 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f7623fff640 1 -- 172.21.15.121:0/531504903 >> v1:172.21.15.121:6789/0 conn(0x7f76240a4c20 legacy=0x7f76240a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.588+0000 7f7623fff640 1 -- 172.21.15.121:0/531504903 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240a3f80 con 0x7f762413a280 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.589+0000 7f7623fff640 1 --2- 172.21.15.121:0/531504903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762413a280 0x7f762413a660 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7614009720 tx=0x7f761402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b718894c7d374a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.589+0000 7f7622ffd640 1 -- 172.21.15.121:0/531504903 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614037070 con 0x7f762413a280 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.589+0000 7f7622ffd640 1 -- 172.21.15.121:0/531504903 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761402ad90 con 0x7f762413a280 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.589+0000 7f7622ffd640 1 -- 172.21.15.121:0/531504903 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614032590 con 0x7f762413a280 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 -- 172.21.15.121:0/531504903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762413a280 msgr2=0x7f762413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 --2- 172.21.15.121:0/531504903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762413a280 0x7f762413a660 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7614009720 tx=0x7f761402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 -- 172.21.15.121:0/531504903 shutdown_connections 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 --2- 172.21.15.121:0/531504903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f762413a280 0x7f762413a660 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 -- 172.21.15.121:0/531504903 >> 172.21.15.121:0/531504903 conn(0x7f76240ac3e0 msgr2=0x7f76240ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 -- 172.21.15.121:0/531504903 shutdown_connections 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.590+0000 7f762a352640 1 -- 172.21.15.121:0/531504903 wait complete. 2024-09-15T23:57:26.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.591+0000 7f762a352640 1 Processor -- start 2024-09-15T23:57:26.593 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.592+0000 7f762a352640 1 -- start start 2024-09-15T23:57:26.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.592+0000 7f762a352640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.592+0000 7f762a352640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7624139d40 con 0x7f76240a4c20 2024-09-15T23:57:26.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7623fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7623fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60464/0 (socket says 172.21.15.121:60464) 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7623fff640 1 -- 172.21.15.121:0/3702153492 learned_addr learned my addr 172.21.15.121:0/3702153492 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7623fff640 1 -- 172.21.15.121:0/3702153492 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624124ff0 con 0x7f76240a4c20 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7623fff640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7614009840 tx=0x7f76140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614041020 con 0x7f76240a4c20 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761403d550 con 0x7f76240a4c20 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7614037040 con 0x7f76240a4c20 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7624125270 con 0x7f76240a4c20 2024-09-15T23:57:26.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.593+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7624138290 con 0x7f76240a4c20 2024-09-15T23:57:26.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.594+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762406dab0 con 0x7f76240a4c20 2024-09-15T23:57:26.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.594+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f7614044020 con 0x7f76240a4c20 2024-09-15T23:57:26.596 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.594+0000 7f7620ff9640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 0x7f761003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.595+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f761406bad0 con 0x7f76240a4c20 2024-09-15T23:57:26.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.595+0000 7f76237fe640 1 -- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 msgr2=0x7f761003a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:26.597 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.595+0000 7f76237fe640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 0x7f761003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:26.600 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.599+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f761404b030 con 0x7f76240a4c20 2024-09-15T23:57:26.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.775+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76240a2f50 con 0x7f76240a4c20 2024-09-15T23:57:26.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.776+0000 7f7620ff9640 1 -- 172.21.15.121:0/3702153492 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+11059 (secure 0 0 0) 0x7f7624124ff0 con 0x7f76240a4c20 2024-09-15T23:57:26.777 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:26.777 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":58,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:21.616784+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:08.177705+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:08.542745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6829/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:6828/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/1007260614":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/566597017":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/3026375199":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/485194523":"2024-09-16T23:57:21.616754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 msgr2=0x7f761003a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 0x7f761003a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 msgr2=0x7f76240a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7614009840 tx=0x7f76140046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 shutdown_connections 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f7610038330 0x7f761003a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 --2- 172.21.15.121:0/3702153492 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76240a4c20 0x7f76240a1150 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 >> 172.21.15.121:0/3702153492 conn(0x7f76240ac3e0 msgr2=0x7f76240aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 shutdown_connections 2024-09-15T23:57:26.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.779+0000 7f762a352640 1 -- 172.21.15.121:0/3702153492 wait complete. 2024-09-15T23:57:26.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:57:26.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.889+0000 7f1831d33640 1 Processor -- start 2024-09-15T23:57:26.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.889+0000 7f1831d33640 1 -- start start 2024-09-15T23:57:26.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f1831d33640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f182c13a280 0x7f182c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f1831d33640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f182c13a080 con 0x7f182c0a4c20 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f1831d33640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f182c0a3d50 con 0x7f182c13a280 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f182b7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f182c13a280 0x7f182c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f1823fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f182c0a4c20 0x7f182c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60256/0 (socket says 172.21.15.121:60256) 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f1823fff640 1 -- 172.21.15.121:0/2158669295 learned_addr learned my addr 172.21.15.121:0/2158669295 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f182b7fe640 1 --2- 172.21.15.121:0/2158669295 >> v2:172.21.15.121:3300/0 conn(0x7f182c13a280 0x7f182c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60472/0 (socket says 172.21.15.121:60472) 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f182b7fe640 1 -- 172.21.15.121:0/2158669295 >> v1:172.21.15.121:6789/0 conn(0x7f182c0a4c20 legacy=0x7f182c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.890+0000 7f182b7fe640 1 -- 172.21.15.121:0/2158669295 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c0a3f80 con 0x7f182c13a280 2024-09-15T23:57:26.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.891+0000 7f182b7fe640 1 --2- 172.21.15.121:0/2158669295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c13a280 0x7f182c13a660 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f181c009720 tx=0x7f181c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8a4387968b8bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.891+0000 7f182affd640 1 -- 172.21.15.121:0/2158669295 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f181c037070 con 0x7f182c13a280 2024-09-15T23:57:26.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.891+0000 7f182affd640 1 -- 172.21.15.121:0/2158669295 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c02ad90 con 0x7f182c13a280 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.891+0000 7f182affd640 1 -- 172.21.15.121:0/2158669295 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f181c032590 con 0x7f182c13a280 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 -- 172.21.15.121:0/2158669295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c13a280 msgr2=0x7f182c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 --2- 172.21.15.121:0/2158669295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c13a280 0x7f182c13a660 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f181c009720 tx=0x7f181c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 -- 172.21.15.121:0/2158669295 shutdown_connections 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 --2- 172.21.15.121:0/2158669295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c13a280 0x7f182c13a660 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 -- 172.21.15.121:0/2158669295 >> 172.21.15.121:0/2158669295 conn(0x7f182c0ac3e0 msgr2=0x7f182c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 -- 172.21.15.121:0/2158669295 shutdown_connections 2024-09-15T23:57:26.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.892+0000 7f1831d33640 1 -- 172.21.15.121:0/2158669295 wait complete. 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.893+0000 7f1831d33640 1 Processor -- start 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.893+0000 7f1831d33640 1 -- start start 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f1831d33640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f1831d33640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f182c139d40 con 0x7f182c0a4c20 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f182b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f182b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60478/0 (socket says 172.21.15.121:60478) 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f182b7fe640 1 -- 172.21.15.121:0/3446597464 learned_addr learned my addr 172.21.15.121:0/3446597464 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.894+0000 7f182b7fe640 1 -- 172.21.15.121:0/3446597464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c124ff0 con 0x7f182c0a4c20 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f182b7fe640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f181c009840 tx=0x7f181c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:26.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f181c041020 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c03d550 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c125270 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f181c037040 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.895+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c138290 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 29) ==== 45783+0+0 (secure 0 0 0) 0x7f181c044020 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c06dab0 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1828ff9640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 0x7f180c03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1823fff640 1 -- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 msgr2=0x7f180c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 3697+0+0 (secure 0 0 0) 0x7f181c06ba40 con 0x7f182c0a4c20 2024-09-15T23:57:26.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.896+0000 7f1823fff640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 0x7f180c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:26.901 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:26.901+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f181c04b030 con 0x7f182c0a4c20 2024-09-15T23:57:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.097+0000 7f1823fff640 1 -- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 msgr2=0x7f180c03a7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/4115821051 2024-09-15T23:57:27.097 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.097+0000 7f1823fff640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 0x7f180c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:27.109 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.109+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f182c0a2f50 con 0x7f182c0a4c20 2024-09-15T23:57:27.110 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:57:27.109+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:57:27.113 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.112+0000 7f1828ff9640 1 -- 172.21.15.121:0/3446597464 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7f182c124ff0 con 0x7f182c0a4c20 2024-09-15T23:57:27.113 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:57:27.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 msgr2=0x7f180c03a7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:27.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 0x7f180c03a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 msgr2=0x7f182c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f181c009840 tx=0x7f181c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 shutdown_connections 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:6828/4115821051,v1:172.21.15.121:6829/4115821051] conn(0x7f180c038330 0x7f180c03a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 --2- 172.21.15.121:0/3446597464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f182c0a4c20 0x7f182c0a1150 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 >> 172.21.15.121:0/3446597464 conn(0x7f182c0ac3e0 msgr2=0x7f182c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 shutdown_connections 2024-09-15T23:57:27.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.114+0000 7f1831d33640 1 -- 172.21.15.121:0/3446597464 wait complete. 2024-09-15T23:57:27.116 INFO:tasks.ceph.mds.b.smithi121.stderr: -2766> 2024-09-15T23:57:06.147+0000 7f7d3f4d7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2024-09-15T23:57:27.117 INFO:tasks.ceph.mds.b.smithi121.stderr: -1685> 2024-09-15T23:57:11.499+0000 7f7d394cb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:27.128 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:57:27.147 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:57:27.181 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.180+0000 7fb289b1e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20d090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20d090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20d090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20d090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20d090640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20a88b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20a88b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20a88b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20a88b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:27.229+0000 7fb20a88b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:57:27.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.236+0000 7f95ec6e4640 1 Processor -- start 2024-09-15T23:57:27.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.236+0000 7f95ec6e4640 1 -- start start 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ec6e4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95e406dab0 0x7f95e40a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ec6e4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e406e410 con 0x7f95e40a7140 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ec6e4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f95e406de90 con 0x7f95e406dab0 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ea480640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f95e406dab0 0x7f95e40a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95e9c7f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f95e40a7140 0x7f95e4136990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60278/0 (socket says 172.21.15.121:60278) 2024-09-15T23:57:27.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95e9c7f640 1 -- 172.21.15.121:0/3442487354 learned_addr learned my addr 172.21.15.121:0/3442487354 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:27.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ea480640 1 --2- 172.21.15.121:0/3442487354 >> v2:172.21.15.121:3300/0 conn(0x7f95e406dab0 0x7f95e40a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60604/0 (socket says 172.21.15.121:60604) 2024-09-15T23:57:27.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ea480640 1 -- 172.21.15.121:0/3442487354 >> v1:172.21.15.121:6789/0 conn(0x7f95e40a7140 legacy=0x7f95e4136990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95ea480640 1 -- 172.21.15.121:0/3442487354 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40a8140 con 0x7f95e406dab0 2024-09-15T23:57:27.239 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.237+0000 7f95e947e640 1 -- 172.21.15.121:0/3442487354 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094088214 0 0) 0x7f95e406e410 con 0x7f95e40a7140 2024-09-15T23:57:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ea480640 1 --2- 172.21.15.121:0/3442487354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a6c00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009720 tx=0x7f95e002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d886aebb843fca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.242 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95e947e640 1 -- 172.21.15.121:0/3442487354 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0037070 con 0x7f95e406dab0 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95e947e640 1 -- 172.21.15.121:0/3442487354 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e002ad90 con 0x7f95e406dab0 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95e947e640 1 -- 172.21.15.121:0/3442487354 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0032590 con 0x7f95e406dab0 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ec6e4640 1 -- 172.21.15.121:0/3442487354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 msgr2=0x7f95e40a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ec6e4640 1 --2- 172.21.15.121:0/3442487354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a6c00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009720 tx=0x7f95e002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ec6e4640 1 -- 172.21.15.121:0/3442487354 shutdown_connections 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ec6e4640 1 --2- 172.21.15.121:0/3442487354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a6c00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.238+0000 7f95ec6e4640 1 -- 172.21.15.121:0/3442487354 >> 172.21.15.121:0/3442487354 conn(0x7f95e40ac620 msgr2=0x7f95e40aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.239+0000 7f95ec6e4640 1 -- 172.21.15.121:0/3442487354 shutdown_connections 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.239+0000 7f95ec6e4640 1 -- 172.21.15.121:0/3442487354 wait complete. 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.239+0000 7f95ec6e4640 1 Processor -- start 2024-09-15T23:57:27.243 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.239+0000 7f95ec6e4640 1 -- start start 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ec6e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ec6e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40a3c70 con 0x7f95e406dab0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ea480640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ea480640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60610/0 (socket says 172.21.15.121:60610) 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ea480640 1 -- 172.21.15.121:0/2013088919 learned_addr learned my addr 172.21.15.121:0/2013088919 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ea480640 1 -- 172.21.15.121:0/2013088919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e409fba0 con 0x7f95e406dab0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95ea480640 1 --2- 172.21.15.121:0/2013088919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f95e0035040 tx=0x7f95e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.240+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0041070 con 0x7f95e406dab0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.241+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e003c460 con 0x7f95e406dab0 2024-09-15T23:57:27.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.241+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0037040 con 0x7f95e406dab0 2024-09-15T23:57:27.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.241+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e40a1770 con 0x7f95e406dab0 2024-09-15T23:57:27.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.241+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e409f8c0 con 0x7f95e406dab0 2024-09-15T23:57:27.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.241+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 30) ==== 45448+0+0 (secure 0 0 0) 0x7f95e0044070 con 0x7f95e406dab0 2024-09-15T23:57:27.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.242+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4084+0+0 (secure 0 0 0) 0x7f95e006bac0 con 0x7f95e406dab0 2024-09-15T23:57:27.245 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.242+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e40a2b00 con 0x7f95e406dab0 2024-09-15T23:57:27.247 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.246+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95e003d3f0 con 0x7f95e406dab0 2024-09-15T23:57:27.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:27.446+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f95e40a6c00 con 0x7f95e406dab0 2024-09-15T23:57:28.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.114+0000 7f95daffd640 1 -- 172.21.15.121:0/2013088919 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f95e003c990 con 0x7f95e406dab0 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 msgr2=0x7f95e40a21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 --2- 172.21.15.121:0/2013088919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f95e0035040 tx=0x7f95e00046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 shutdown_connections 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 --2- 172.21.15.121:0/2013088919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95e406dab0 0x7f95e40a21c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 >> 172.21.15.121:0/2013088919 conn(0x7f95e40ac620 msgr2=0x7f95e4139660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 shutdown_connections 2024-09-15T23:57:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.116+0000 7f95ec6e4640 1 -- 172.21.15.121:0/2013088919 wait complete. 2024-09-15T23:57:28.130 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.278+0000 7fc96e8a5640 1 Processor -- start 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.278+0000 7fc96e8a5640 1 -- start start 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc96e8a5640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc9680a37b0 0x7fc96809f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc96e8a5640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc96809ce40 con 0x7fc9680a3b90 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc96e8a5640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc96809f960 con 0x7fc9680a37b0 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc967fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc9680a37b0 0x7fc96809f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc95ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc9680a3b90 0x7fc9680a4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60290/0 (socket says 172.21.15.121:60290) 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc95ffff640 1 -- 172.21.15.121:0/2085129884 learned_addr learned my addr 172.21.15.121:0/2085129884 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:28.280 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc967fff640 1 -- 172.21.15.121:0/2085129884 >> v1:172.21.15.121:6789/0 conn(0x7fc9680a3b90 legacy=0x7fc9680a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc967fff640 1 -- 172.21.15.121:0/2085129884 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96809d7a0 con 0x7fc9680a37b0 2024-09-15T23:57:28.281 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.279+0000 7fc9677fe640 1 -- 172.21.15.121:0/2085129884 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981618791 0 0) 0x7fc96809ce40 con 0x7fc9680a3b90 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc967fff640 1 --2- 172.21.15.121:0/2085129884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96809f230 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc958009720 tx=0x7fc95802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26357031e3dc6d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc9677fe640 1 -- 172.21.15.121:0/2085129884 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc958037070 con 0x7fc9680a37b0 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc9677fe640 1 -- 172.21.15.121:0/2085129884 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95802ad90 con 0x7fc9680a37b0 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc9677fe640 1 -- 172.21.15.121:0/2085129884 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc958032590 con 0x7fc9680a37b0 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc96e8a5640 1 -- 172.21.15.121:0/2085129884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 msgr2=0x7fc96809f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/2085129884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96809f230 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc958009720 tx=0x7fc95802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:28.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc96e8a5640 1 -- 172.21.15.121:0/2085129884 shutdown_connections 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/2085129884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96809f230 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.280+0000 7fc96e8a5640 1 -- 172.21.15.121:0/2085129884 >> 172.21.15.121:0/2085129884 conn(0x7fc9680a8430 msgr2=0x7fc9680a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.281+0000 7fc96e8a5640 1 -- 172.21.15.121:0/2085129884 shutdown_connections 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.281+0000 7fc96e8a5640 1 -- 172.21.15.121:0/2085129884 wait complete. 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.281+0000 7fc96e8a5640 1 Processor -- start 2024-09-15T23:57:28.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.281+0000 7fc96e8a5640 1 -- start start 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc96e8a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc96e8a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680a5220 con 0x7fc9680a37b0 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc967fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc967fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60632/0 (socket says 172.21.15.121:60632) 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc967fff640 1 -- 172.21.15.121:0/563197002 learned_addr learned my addr 172.21.15.121:0/563197002 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc967fff640 1 -- 172.21.15.121:0/563197002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc968134590 con 0x7fc9680a37b0 2024-09-15T23:57:28.285 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.282+0000 7fc967fff640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc958035040 tx=0x7fc9580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc958037040 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958004160 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9681cb220 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc958004440 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96811ff40 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 31) ==== 45575+0+0 (secure 0 0 0) 0x7fc958003610 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.283+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96809f230 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.284+0000 7fc9657fa640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 0x7fc94803a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.284+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4084+0+0 (secure 0 0 0) 0x7fc95806c2a0 con 0x7fc9680a37b0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.284+0000 7fc95ffff640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 0x7fc94803a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:28.286 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.284+0000 7fc95ffff640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 0x7fc94803a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc950000c00 tx=0x7fc950007970 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:28.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.288+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc95803ec70 con 0x7fc9680a37b0 2024-09-15T23:57:28.455 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:28.454+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc96809e840 con 0x7fc9680a37b0 2024-09-15T23:57:29.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.190+0000 7fc9657fa640 1 -- 172.21.15.121:0/563197002 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) ==== 181+0+0 (secure 0 0 0) 0x7fc95803ccd0 con 0x7fc9680a37b0 2024-09-15T23:57:29.191 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.194+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 msgr2=0x7fc94803a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.194+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 0x7fc94803a5b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc950000c00 tx=0x7fc950007970 comp rx=0 tx=0).stop 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.194+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 msgr2=0x7fc96811ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.194+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc958035040 tx=0x7fc9580046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 shutdown_connections 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc9480380f0 0x7fc94803a5b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 --2- 172.21.15.121:0/563197002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9680a37b0 0x7fc96811ea00 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 >> 172.21.15.121:0/563197002 conn(0x7fc9680a8430 msgr2=0x7fc9680a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 shutdown_connections 2024-09-15T23:57:29.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.195+0000 7fc96e8a5640 1 -- 172.21.15.121:0/563197002 wait complete. 2024-09-15T23:57:29.211 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:57:29.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.321+0000 7f024f5f1640 1 Processor -- start 2024-09-15T23:57:29.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.321+0000 7f024f5f1640 1 -- start start 2024-09-15T23:57:29.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024f5f1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f02480a3b90 0x7f02480a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024f5f1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02480a4560 con 0x7f02480a37b0 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024f5f1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f024809b4f0 con 0x7f02480a3b90 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024d38d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f02480a37b0 0x7f024809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60296/0 (socket says 172.21.15.121:60296) 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024d38d640 1 -- 172.21.15.121:0/1015267114 learned_addr learned my addr 172.21.15.121:0/1015267114 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024cb8c640 1 --2- 172.21.15.121:0/1015267114 >> v2:172.21.15.121:3300/0 conn(0x7f02480a3b90 0x7f02480a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f0247fff640 1 -- 172.21.15.121:0/1015267114 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471854118 0 0) 0x7f02480a4560 con 0x7f02480a37b0 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f0247fff640 1 -- 172.21.15.121:0/1015267114 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0230003520 con 0x7f02480a37b0 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024cb8c640 1 -- 172.21.15.121:0/1015267114 >> v1:172.21.15.121:6789/0 conn(0x7f02480a37b0 legacy=0x7f024809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.322+0000 7f024cb8c640 1 -- 172.21.15.121:0/1015267114 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02480a1c90 con 0x7f02480a3b90 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.323+0000 7f024cb8c640 1 --2- 172.21.15.121:0/1015267114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a3b90 0x7f02480a4020 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f023c009720 tx=0x7f023c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2282cb2aea0af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.323+0000 7f0247fff640 1 -- 172.21.15.121:0/1015267114 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023c037070 con 0x7f02480a3b90 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.323+0000 7f0247fff640 1 -- 172.21.15.121:0/1015267114 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c02ad90 con 0x7f02480a3b90 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.323+0000 7f0247fff640 1 -- 172.21.15.121:0/1015267114 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f023c032590 con 0x7f02480a3b90 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 -- 172.21.15.121:0/1015267114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a3b90 msgr2=0x7f02480a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 --2- 172.21.15.121:0/1015267114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a3b90 0x7f02480a4020 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f023c009720 tx=0x7f023c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 -- 172.21.15.121:0/1015267114 shutdown_connections 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 --2- 172.21.15.121:0/1015267114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a3b90 0x7f02480a4020 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 -- 172.21.15.121:0/1015267114 >> 172.21.15.121:0/1015267114 conn(0x7f02480a8430 msgr2=0x7f02480a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 -- 172.21.15.121:0/1015267114 shutdown_connections 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.324+0000 7f024f5f1640 1 -- 172.21.15.121:0/1015267114 wait complete. 2024-09-15T23:57:29.327 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024f5f1640 1 Processor -- start 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024f5f1640 1 -- start start 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024f5f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024f5f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02480a5220 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024d38d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024d38d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60672/0 (socket says 172.21.15.121:60672) 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.325+0000 7f024d38d640 1 -- 172.21.15.121:0/4268217447 learned_addr learned my addr 172.21.15.121:0/4268217447 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f024d38d640 1 -- 172.21.15.121:0/4268217447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0248072090 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f024d38d640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f023800ede0 tx=0x7f023800c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0238015070 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0238011680 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0238011960 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0248134fd0 con 0x7f02480a37b0 2024-09-15T23:57:29.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.326+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0248070e10 con 0x7f02480a37b0 2024-09-15T23:57:29.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 31) ==== 45575+0+0 (secure 0 0 0) 0x7f0238018070 con 0x7f02480a37b0 2024-09-15T23:57:29.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f0245ffb640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 0x7f023403a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:29.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 3646+0+0 (secure 0 0 0) 0x7f023804dda0 con 0x7f02480a37b0 2024-09-15T23:57:29.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f024cb8c640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 0x7f023403a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:29.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02480a4020 con 0x7f02480a37b0 2024-09-15T23:57:29.330 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.327+0000 7f024cb8c640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 0x7f023403a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f023c009720 tx=0x7f023c02e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:29.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.332+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0238007590 con 0x7f02480a37b0 2024-09-15T23:57:29.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.497+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02480a1f00 con 0x7f02480a37b0 2024-09-15T23:57:29.631 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:29.630+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 32) ==== 45681+0+0 (secure 0 0 0) 0x7f0238007070 con 0x7f02480a37b0 2024-09-15T23:57:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.192+0000 7f0245ffb640 1 -- 172.21.15.121:0/4268217447 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) ==== 169+0+0 (secure 0 0 0) 0x7f023803ba10 con 0x7f02480a37b0 2024-09-15T23:57:30.193 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-15T23:57:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 msgr2=0x7f023403a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 0x7f023403a5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f023c009720 tx=0x7f023c02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 msgr2=0x7f02481cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f023800ede0 tx=0x7f023800c640 comp rx=0 tx=0).stop 2024-09-15T23:57:30.196 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 shutdown_connections 2024-09-15T23:57:30.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f02340380f0 0x7f023403a5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 --2- 172.21.15.121:0/4268217447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02480a37b0 0x7f02481cb1d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 >> 172.21.15.121:0/4268217447 conn(0x7f02480a8430 msgr2=0x7f0248133c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 shutdown_connections 2024-09-15T23:57:30.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.195+0000 7f024f5f1640 1 -- 172.21.15.121:0/4268217447 wait complete. 2024-09-15T23:57:30.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:57:30.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.321+0000 7fa20273a640 1 Processor -- start 2024-09-15T23:57:30.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa20273a640 1 -- start start 2024-09-15T23:57:30.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa20273a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa1fc0a7140 0x7fa1fc0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa20273a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0a6d10 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa20273a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa1fc06e230 con 0x7fa1fc0a7140 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1fbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa1fc0a7140 0x7fa1fc0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1f3fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa1fc0a4ab0 0x7fa1fc139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60298/0 (socket says 172.21.15.121:60298) 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1f3fff640 1 -- 172.21.15.121:0/923670316 learned_addr learned my addr 172.21.15.121:0/923670316 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1fbfff640 1 -- 172.21.15.121:0/923670316 >> v1:172.21.15.121:6789/0 conn(0x7fa1fc0a4ab0 legacy=0x7fa1fc139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1fb7fe640 1 -- 172.21.15.121:0/923670316 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977156282 0 0) 0x7fa1fc0a6d10 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.324 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.322+0000 7fa1fbfff640 1 -- 172.21.15.121:0/923670316 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc0a3ae0 con 0x7fa1fc0a7140 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.323+0000 7fa1fbfff640 1 --2- 172.21.15.121:0/923670316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a7140 0x7fa1fc0a7520 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009720 tx=0x7fa1ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f9b7d4ed79633 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.323+0000 7fa1fb7fe640 1 -- 172.21.15.121:0/923670316 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec037070 con 0x7fa1fc0a7140 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.323+0000 7fa1fb7fe640 1 -- 172.21.15.121:0/923670316 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec02ad90 con 0x7fa1fc0a7140 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.323+0000 7fa1fb7fe640 1 -- 172.21.15.121:0/923670316 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec032590 con 0x7fa1fc0a7140 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 -- 172.21.15.121:0/923670316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a7140 msgr2=0x7fa1fc0a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.325 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 --2- 172.21.15.121:0/923670316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a7140 0x7fa1fc0a7520 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009720 tx=0x7fa1ec02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:30.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 -- 172.21.15.121:0/923670316 shutdown_connections 2024-09-15T23:57:30.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 --2- 172.21.15.121:0/923670316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a7140 0x7fa1fc0a7520 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 -- 172.21.15.121:0/923670316 >> 172.21.15.121:0/923670316 conn(0x7fa1fc0ac370 msgr2=0x7fa1fc0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 -- 172.21.15.121:0/923670316 shutdown_connections 2024-09-15T23:57:30.326 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.324+0000 7fa20273a640 1 -- 172.21.15.121:0/923670316 wait complete. 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa20273a640 1 Processor -- start 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa20273a640 1 -- start start 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa20273a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa20273a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0a7fc0 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa1fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa1fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60682/0 (socket says 172.21.15.121:60682) 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.325+0000 7fa1fbfff640 1 -- 172.21.15.121:0/883710165 learned_addr learned my addr 172.21.15.121:0/883710165 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:30.328 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa1fbfff640 1 -- 172.21.15.121:0/883710165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc09e710 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa1fbfff640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009840 tx=0x7fa1ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec041020 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec03d550 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc09e430 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec037040 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.326+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc0a0cc0 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 32) ==== 45681+0+0 (secure 0 0 0) 0x7fa1ec044020 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa1f97fa640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 0x7fa1dc03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7fa1ec06b6b0 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa1f3fff640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 0x7fa1dc03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc0008d0 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.329 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.327+0000 7fa1f3fff640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 0x7fa1dc03a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40011e0 tx=0x7fa1e4007930 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.332 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.332+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1ec04b030 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.498+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa1fc0a0f50 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.501 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.500+0000 7fa1f97fa640 1 -- 172.21.15.121:0/883710165 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fa1ec03d870 con 0x7fa1fc0a4ab0 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 msgr2=0x7fa1dc03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 0x7fa1dc03a6d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40011e0 tx=0x7fa1e4007930 comp rx=0 tx=0).stop 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 msgr2=0x7fa1fc1ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009840 tx=0x7fa1ec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 shutdown_connections 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fa1dc038210 0x7fa1dc03a6d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 --2- 172.21.15.121:0/883710165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1fc0a4ab0 0x7fa1fc1ce510 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 >> 172.21.15.121:0/883710165 conn(0x7fa1fc0ac370 msgr2=0x7fa1fc137210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.502+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 shutdown_connections 2024-09-15T23:57:30.504 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.503+0000 7fa20273a640 1 -- 172.21.15.121:0/883710165 wait complete. 2024-09-15T23:57:30.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop' 2024-09-15T23:57:30.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.611+0000 7f2ced87b640 1 Processor -- start 2024-09-15T23:57:30.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.611+0000 7f2ced87b640 1 -- start start 2024-09-15T23:57:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ced87b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ce813a280 0x7f2ce813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ced87b640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce813a080 con 0x7f2ce80a4c20 2024-09-15T23:57:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ced87b640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce80a3d50 con 0x7f2ce813a280 2024-09-15T23:57:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ce6ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2ce813a280 0x7f2ce813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.613 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ce67fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2ce80a4c20 0x7f2ce80a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60308/0 (socket says 172.21.15.121:60308) 2024-09-15T23:57:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ce67fc640 1 -- 172.21.15.121:0/89387269 learned_addr learned my addr 172.21.15.121:0/89387269 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ce6ffd640 1 -- 172.21.15.121:0/89387269 >> v1:172.21.15.121:6789/0 conn(0x7f2ce80a4c20 legacy=0x7f2ce80a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.612+0000 7f2ce6ffd640 1 -- 172.21.15.121:0/89387269 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce80a3f80 con 0x7f2ce813a280 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.613+0000 7f2ce6ffd640 1 --2- 172.21.15.121:0/89387269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce813a280 0x7f2ce813a660 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009720 tx=0x7f2cd802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52053eec64e0502 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.613+0000 7f2ce5ffb640 1 -- 172.21.15.121:0/89387269 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cd8037070 con 0x7f2ce813a280 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.613+0000 7f2ce5ffb640 1 -- 172.21.15.121:0/89387269 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd802ad90 con 0x7f2ce813a280 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.613+0000 7f2ce5ffb640 1 -- 172.21.15.121:0/89387269 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cd8032590 con 0x7f2ce813a280 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 -- 172.21.15.121:0/89387269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce813a280 msgr2=0x7f2ce813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:30.615 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 --2- 172.21.15.121:0/89387269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce813a280 0x7f2ce813a660 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009720 tx=0x7f2cd802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 -- 172.21.15.121:0/89387269 shutdown_connections 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 --2- 172.21.15.121:0/89387269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce813a280 0x7f2ce813a660 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 -- 172.21.15.121:0/89387269 >> 172.21.15.121:0/89387269 conn(0x7f2ce80ac3e0 msgr2=0x7f2ce80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 -- 172.21.15.121:0/89387269 shutdown_connections 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 -- 172.21.15.121:0/89387269 wait complete. 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.614+0000 7f2ced87b640 1 Processor -- start 2024-09-15T23:57:30.616 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ced87b640 1 -- start start 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ced87b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ced87b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce8139d40 con 0x7f2ce80a4c20 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ce6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60710/0 (socket says 172.21.15.121:60710) 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ce6ffd640 1 -- 172.21.15.121:0/1415722535 learned_addr learned my addr 172.21.15.121:0/1415722535 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.615+0000 7f2ce6ffd640 1 -- 172.21.15.121:0/1415722535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce8124ff0 con 0x7f2ce80a4c20 2024-09-15T23:57:30.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ce6ffd640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009840 tx=0x7f2cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cd8041020 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd803d550 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cd8037040 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce8125270 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.616+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce8138290 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 32) ==== 45681+0+0 (secure 0 0 0) 0x7f2cd8044020 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce806dab0 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ccffff640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 0x7f2cd403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7f2cd806b740 con 0x7f2ce80a4c20 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ce67fc640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 0x7f2cd403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:30.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.617+0000 7f2ce67fc640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 0x7f2cd403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc007fd0 tx=0x7f2cdc007ac0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:30.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.622+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cd804b030 con 0x7f2ce80a4c20 2024-09-15T23:57:30.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:30.852+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]} v 0) -- 0x7f2ce80a2f50 con 0x7f2ce80a4c20 2024-09-15T23:57:31.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.635+0000 7f2ccffff640 1 -- 172.21.15.121:0/1415722535 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop"]}]=0 v147) ==== 123+0+0 (secure 0 0 0) 0x7f2ce8124ff0 con 0x7f2ce80a4c20 2024-09-15T23:57:31.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.638+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 msgr2=0x7f2cd403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.638+0000 7f2ced87b640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 0x7f2cd403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc007fd0 tx=0x7f2cdc007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.638+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 msgr2=0x7f2ce80a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.638+0000 7f2ced87b640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009840 tx=0x7f2cd80046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 shutdown_connections 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2cd4038210 0x7f2cd403a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 --2- 172.21.15.121:0/1415722535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ce80a4c20 0x7f2ce80a1150 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 >> 172.21.15.121:0/1415722535 conn(0x7f2ce80ac3e0 msgr2=0x7f2ce80aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 shutdown_connections 2024-09-15T23:57:31.641 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.639+0000 7f2ced87b640 1 -- 172.21.15.121:0/1415722535 wait complete. 2024-09-15T23:57:31.653 INFO:tasks.cephfs_test_runner:test_fstop (tasks.cephfs.test_fstop.TestFSTop) ... ok 2024-09-15T23:57:31.653 INFO:tasks.cephfs_test_runner:Starting test: test_fstop_non_existent_cluster (tasks.cephfs.test_fstop.TestFSTop) 2024-09-15T23:57:31.654 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:31.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff07120e640 1 Processor -- start 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff07120e640 1 -- start start 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff07120e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff06c0a39c0 0x7ff06c0a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff07120e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06c0a2280 con 0x7ff06c09ee30 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff07120e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff06c09e6e0 con 0x7ff06c0a39c0 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.756+0000 7ff06ad9d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff06c0a39c0 0x7ff06c0a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.757+0000 7ff06a59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff06c09ee30 0x7ff06c134760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60310/0 (socket says 172.21.15.121:60310) 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.757+0000 7ff06a59c640 1 -- 172.21.15.121:0/835252489 learned_addr learned my addr 172.21.15.121:0/835252489 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.757+0000 7ff06ad9d640 1 -- 172.21.15.121:0/835252489 >> v1:172.21.15.121:6789/0 conn(0x7ff06c09ee30 legacy=0x7ff06c134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.757+0000 7ff06ad9d640 1 -- 172.21.15.121:0/835252489 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c09e3d0 con 0x7ff06c0a39c0 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.757+0000 7ff06ad9d640 1 --2- 172.21.15.121:0/835252489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c0a39c0 0x7ff06c0a3da0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009720 tx=0x7ff05c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9932d3614ade675f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff069d9b640 1 -- 172.21.15.121:0/835252489 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff05c037070 con 0x7ff06c0a39c0 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff069d9b640 1 -- 172.21.15.121:0/835252489 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c02ad90 con 0x7ff06c0a39c0 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff069d9b640 1 -- 172.21.15.121:0/835252489 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff05c032590 con 0x7ff06c0a39c0 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 -- 172.21.15.121:0/835252489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c0a39c0 msgr2=0x7ff06c0a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 --2- 172.21.15.121:0/835252489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c0a39c0 0x7ff06c0a3da0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009720 tx=0x7ff05c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 -- 172.21.15.121:0/835252489 shutdown_connections 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 --2- 172.21.15.121:0/835252489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c0a39c0 0x7ff06c0a3da0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 -- 172.21.15.121:0/835252489 >> 172.21.15.121:0/835252489 conn(0x7ff06c0a85e0 msgr2=0x7ff06c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 -- 172.21.15.121:0/835252489 shutdown_connections 2024-09-15T23:57:31.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.758+0000 7ff07120e640 1 -- 172.21.15.121:0/835252489 wait complete. 2024-09-15T23:57:31.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.759+0000 7ff07120e640 1 Processor -- start 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.759+0000 7ff07120e640 1 -- start start 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff07120e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff07120e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0a1ed0 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff06ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60736/0 (socket says 172.21.15.121:60736) 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff06ad9d640 1 -- 172.21.15.121:0/3192393225 learned_addr learned my addr 172.21.15.121:0/3192393225 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff06ad9d640 1 -- 172.21.15.121:0/3192393225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c073400 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.760+0000 7ff06ad9d640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff05c02a680 tx=0x7ff05c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff05c037040 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff05c03b430 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c06fbf0 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff05c03b710 con 0x7ff06c09ee30 2024-09-15T23:57:31.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c072180 con 0x7ff06c09ee30 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.761+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7ff05c044020 con 0x7ff06c09ee30 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.762+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c11edb0 con 0x7ff06c09ee30 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.762+0000 7ff0537fe640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 0x7ff05803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.762+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7ff05c042020 con 0x7ff06c09ee30 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.762+0000 7ff06a59c640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 0x7ff05803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:31.764 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.762+0000 7ff06a59c640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 0x7ff05803a760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff060007fd0 tx=0x7ff060007ac0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:31.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.766+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff06c11edb0 con 0x7ff06c09ee30 2024-09-15T23:57:31.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.933+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff06c0a3da0 con 0x7ff06c09ee30 2024-09-15T23:57:31.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.934+0000 7ff0537fe640 1 -- 172.21.15.121:0/3192393225 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+7752 (secure 0 0 0) 0x7ff05c03b960 con 0x7ff06c09ee30 2024-09-15T23:57:31.935 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:31.935 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":62,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:30.191398+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/2384789452":"2024-09-16T23:57:27.182568+0000","172.21.15.121:0/2226648915":"2024-09-16T23:57:27.182568+0000","172.21.15.121:0/451036945":"2024-09-16T23:57:27.182568+0000","172.21.15.121:6828/4115821051":"2024-09-16T23:57:27.182568+0000","172.21.15.121:0/626025373":"2024-09-16T23:57:27.182568+0000","172.21.15.121:6825/2407589341":"2024-09-16T23:57:27.110101+0000","172.21.15.121:6824/2407589341":"2024-09-16T23:57:27.110101+0000","172.21.15.121:6829/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:6829/4115821051":"2024-09-16T23:57:27.182568+0000","172.21.15.121:0/3050264443":"2024-09-16T23:57:27.182568+0000","172.21.15.121:6828/3810060514":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/1007260614":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/566597017":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/3026375199":"2024-09-16T23:57:21.616754+0000","172.21.15.121:0/485194523":"2024-09-16T23:57:21.616754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:31.936 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 msgr2=0x7ff05803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 0x7ff05803a760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff060007fd0 tx=0x7ff060007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 msgr2=0x7ff06c11e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff05c02a680 tx=0x7ff05c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 shutdown_connections 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff0580382a0 0x7ff05803a760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 --2- 172.21.15.121:0/3192393225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff06c09ee30 0x7ff06c11e870 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.935+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 >> 172.21.15.121:0/3192393225 conn(0x7ff06c0a85e0 msgr2=0x7ff06c0a1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.936+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 shutdown_connections 2024-09-15T23:57:31.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:31.936+0000 7ff07120e640 1 -- 172.21.15.121:0/3192393225 wait complete. 2024-09-15T23:57:31.947 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:55:04.051077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:57:31.948 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:57:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f582118d640 1 Processor -- start 2024-09-15T23:57:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f582118d640 1 -- start start 2024-09-15T23:57:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f582118d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f581c0a3b90 0x7f581c0a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f582118d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c0a4560 con 0x7f581c0a37b0 2024-09-15T23:57:32.049 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f582118d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f581c09b4f0 con 0x7f581c0a3b90 2024-09-15T23:57:32.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f581a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f581c0a3b90 0x7f581c0a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f581ad9d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f581c0a37b0 0x7f581c09acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:60316/0 (socket says 172.21.15.121:60316) 2024-09-15T23:57:32.050 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.048+0000 7f581ad9d640 1 -- 172.21.15.121:0/3536272744 learned_addr learned my addr 172.21.15.121:0/3536272744 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.049+0000 7f581a59c640 1 -- 172.21.15.121:0/3536272744 >> v1:172.21.15.121:6789/0 conn(0x7f581c0a37b0 legacy=0x7f581c09acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.049+0000 7f581a59c640 1 -- 172.21.15.121:0/3536272744 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c0a1c90 con 0x7f581c0a3b90 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.049+0000 7f581a59c640 1 --2- 172.21.15.121:0/3536272744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a3b90 0x7f581c0a4020 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe0c0a4f18f8050 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f5819d9b640 1 -- 172.21.15.121:0/3536272744 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5810037070 con 0x7f581c0a3b90 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f5819d9b640 1 -- 172.21.15.121:0/3536272744 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f581002ad90 con 0x7f581c0a3b90 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f5819d9b640 1 -- 172.21.15.121:0/3536272744 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5810032590 con 0x7f581c0a3b90 2024-09-15T23:57:32.051 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 -- 172.21.15.121:0/3536272744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a3b90 msgr2=0x7f581c0a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 --2- 172.21.15.121:0/3536272744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a3b90 0x7f581c0a4020 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 -- 172.21.15.121:0/3536272744 shutdown_connections 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 --2- 172.21.15.121:0/3536272744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a3b90 0x7f581c0a4020 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 -- 172.21.15.121:0/3536272744 >> 172.21.15.121:0/3536272744 conn(0x7f581c0a8430 msgr2=0x7f581c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 -- 172.21.15.121:0/3536272744 shutdown_connections 2024-09-15T23:57:32.052 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.050+0000 7f582118d640 1 -- 172.21.15.121:0/3536272744 wait complete. 2024-09-15T23:57:32.053 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.051+0000 7f582118d640 1 Processor -- start 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.051+0000 7f582118d640 1 -- start start 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f582118d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f582118d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f581c0a5220 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f581ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f581ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:60752/0 (socket says 172.21.15.121:60752) 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f581ad9d640 1 -- 172.21.15.121:0/632848862 learned_addr learned my addr 172.21.15.121:0/632848862 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f581ad9d640 1 -- 172.21.15.121:0/632848862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c072c30 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f581ad9d640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c380 tx=0x7f580c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c005c10 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c005db0 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.052+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c072f40 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.053+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c004930 con 0x7f581c0a37b0 2024-09-15T23:57:32.054 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.053+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c11e930 con 0x7f581c0a37b0 2024-09-15T23:57:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.053+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f580c01a020 con 0x7f581c0a37b0 2024-09-15T23:57:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.053+0000 7f58037fe640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 0x7f580803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.055 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.054+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7f580c04a8e0 con 0x7f581c0a37b0 2024-09-15T23:57:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.054+0000 7f581a59c640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 0x7f580803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.054+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581c0a4020 con 0x7f581c0a37b0 2024-09-15T23:57:32.056 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.054+0000 7f581a59c640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 0x7f580803a760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.059 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.058+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f580c0127f0 con 0x7f581c0a37b0 2024-09-15T23:57:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.224+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f581c0a1f00 con 0x7f581c0a37b0 2024-09-15T23:57:32.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.224+0000 7f58037fe640 1 -- 172.21.15.121:0/632848862 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7f580c012a50 con 0x7f581c0a37b0 2024-09-15T23:57:32.225 INFO:teuthology.orchestra.run.smithi121.stdout:pg_num: 1 2024-09-15T23:57:32.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 msgr2=0x7f580803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 0x7f580803a760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5810009720 tx=0x7f581002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 msgr2=0x7f581c11e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f580c00c380 tx=0x7f580c00c840 comp rx=0 tx=0).stop 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 shutdown_connections 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f58080382a0 0x7f580803a760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 --2- 172.21.15.121:0/632848862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f581c0a37b0 0x7f581c11e3f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 >> 172.21.15.121:0/632848862 conn(0x7f581c0a8430 msgr2=0x7f581c09dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 shutdown_connections 2024-09-15T23:57:32.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.226+0000 7f582118d640 1 -- 172.21.15.121:0/632848862 wait complete. 2024-09-15T23:57:32.238 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster' 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.336+0000 7f2a5a2a6640 1 Processor -- start 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.336+0000 7f2a5a2a6640 1 -- start start 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.336+0000 7f2a5a2a6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2a540a39c0 0x7f2a540a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.336+0000 7f2a5a2a6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a540a2280 con 0x7f2a5409ee30 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.336+0000 7f2a5a2a6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5409e6e0 con 0x7f2a540a39c0 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.337+0000 7f2a53fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2a540a39c0 0x7f2a540a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.337+0000 7f2a537fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2a5409ee30 0x7f2a54134760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33764/0 (socket says 172.21.15.121:33764) 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.337+0000 7f2a537fe640 1 -- 172.21.15.121:0/1347462642 learned_addr learned my addr 172.21.15.121:0/1347462642 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.337+0000 7f2a53fff640 1 -- 172.21.15.121:0/1347462642 >> v1:172.21.15.121:6789/0 conn(0x7f2a5409ee30 legacy=0x7f2a54134760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.338 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.337+0000 7f2a53fff640 1 -- 172.21.15.121:0/1347462642 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5409e3d0 con 0x7f2a540a39c0 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a53fff640 1 --2- 172.21.15.121:0/1347462642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a540a39c0 0x7f2a540a3da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009720 tx=0x7f2a4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dc14898621997a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a52ffd640 1 -- 172.21.15.121:0/1347462642 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a44037070 con 0x7f2a540a39c0 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a52ffd640 1 -- 172.21.15.121:0/1347462642 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4402ad90 con 0x7f2a540a39c0 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a52ffd640 1 -- 172.21.15.121:0/1347462642 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a44032590 con 0x7f2a540a39c0 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/1347462642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a540a39c0 msgr2=0x7f2a540a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/1347462642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a540a39c0 0x7f2a540a3da0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009720 tx=0x7f2a4402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/1347462642 shutdown_connections 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/1347462642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a540a39c0 0x7f2a540a3da0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/1347462642 >> 172.21.15.121:0/1347462642 conn(0x7f2a540a85e0 msgr2=0x7f2a540a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/1347462642 shutdown_connections 2024-09-15T23:57:32.340 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.338+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/1347462642 wait complete. 2024-09-15T23:57:32.341 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.339+0000 7f2a5a2a6640 1 Processor -- start 2024-09-15T23:57:32.342 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.339+0000 7f2a5a2a6640 1 -- start start 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a5a2a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a5a2a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a540a1ed0 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47412/0 (socket says 172.21.15.121:47412) 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a53fff640 1 -- 172.21.15.121:0/473624896 learned_addr learned my addr 172.21.15.121:0/473624896 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a53fff640 1 -- 172.21.15.121:0/473624896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a54073030 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a53fff640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a44041020 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4403d550 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.340+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a44037040 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.341+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a54137fd0 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.341+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5406fd70 con 0x7f2a5409ee30 2024-09-15T23:57:32.343 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f2a44044020 con 0x7f2a5409ee30 2024-09-15T23:57:32.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a540717e0 con 0x7f2a5409ee30 2024-09-15T23:57:32.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a50ff9640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 0x7f2a4003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7f2a4406b7c0 con 0x7f2a5409ee30 2024-09-15T23:57:32.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a537fe640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 0x7f2a4003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.344 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.342+0000 7f2a537fe640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 0x7f2a4003a760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007fd0 tx=0x7f2a48007ac0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.347 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.346+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a4404b030 con 0x7f2a5409ee30 2024-09-15T23:57:32.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.575+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]} v 0) -- 0x7f2a5406bde0 con 0x7f2a5409ee30 2024-09-15T23:57:32.636 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.636+0000 7f2a50ff9640 1 -- 172.21.15.121:0/473624896 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]}]=0 v148) ==== 147+0+0 (secure 0 0 0) 0x7f2a4403d920 con 0x7f2a5409ee30 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.637+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 msgr2=0x7f2a4003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.637+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 0x7f2a4003a760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2a48007fd0 tx=0x7f2a48007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.637+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 msgr2=0x7f2a5411e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.637+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a440046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 shutdown_connections 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f2a400382a0 0x7f2a4003a760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 --2- 172.21.15.121:0/473624896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a5409ee30 0x7f2a5411e600 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 >> 172.21.15.121:0/473624896 conn(0x7f2a540a85e0 msgr2=0x7f2a540a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 shutdown_connections 2024-09-15T23:57:32.639 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.638+0000 7f2a5a2a6640 1 -- 172.21.15.121:0/473624896 wait complete. 2024-09-15T23:57:32.649 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:57:32.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.748+0000 7fbe31928640 1 Processor -- start 2024-09-15T23:57:32.749 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe31928640 1 -- start start 2024-09-15T23:57:32.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe31928640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe2c0a3b90 0x7fbe2c0a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe31928640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2c0a4560 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe31928640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2c09b4f0 con 0x7fbe2c0a3b90 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe2a7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe2c0a3b90 0x7fbe2c0a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe2affd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe2c0a37b0 0x7fbe2c09acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33778/0 (socket says 172.21.15.121:33778) 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe2affd640 1 -- 172.21.15.121:0/1031163759 learned_addr learned my addr 172.21.15.121:0/1031163759 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe2a7fc640 1 -- 172.21.15.121:0/1031163759 >> v1:172.21.15.121:6789/0 conn(0x7fbe2c0a37b0 legacy=0x7fbe2c09acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.749+0000 7fbe2a7fc640 1 -- 172.21.15.121:0/1031163759 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c0a1c90 con 0x7fbe2c0a3b90 2024-09-15T23:57:32.752 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.750+0000 7fbe2a7fc640 1 --2- 172.21.15.121:0/1031163759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a3b90 0x7fbe2c0a4020 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009720 tx=0x7fbe1402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3e84fd8623e0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.750+0000 7fbe29ffb640 1 -- 172.21.15.121:0/1031163759 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe14037070 con 0x7fbe2c0a3b90 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.750+0000 7fbe29ffb640 1 -- 172.21.15.121:0/1031163759 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1402ad90 con 0x7fbe2c0a3b90 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.750+0000 7fbe29ffb640 1 -- 172.21.15.121:0/1031163759 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe14032590 con 0x7fbe2c0a3b90 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 -- 172.21.15.121:0/1031163759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a3b90 msgr2=0x7fbe2c0a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 --2- 172.21.15.121:0/1031163759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a3b90 0x7fbe2c0a4020 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009720 tx=0x7fbe1402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 -- 172.21.15.121:0/1031163759 shutdown_connections 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 --2- 172.21.15.121:0/1031163759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a3b90 0x7fbe2c0a4020 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 -- 172.21.15.121:0/1031163759 >> 172.21.15.121:0/1031163759 conn(0x7fbe2c0a8430 msgr2=0x7fbe2c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 -- 172.21.15.121:0/1031163759 shutdown_connections 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.751+0000 7fbe31928640 1 -- 172.21.15.121:0/1031163759 wait complete. 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe31928640 1 Processor -- start 2024-09-15T23:57:32.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe31928640 1 -- start start 2024-09-15T23:57:32.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe31928640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe31928640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c0a5220 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.755 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe2affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe2affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47424/0 (socket says 172.21.15.121:47424) 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.752+0000 7fbe2affd640 1 -- 172.21.15.121:0/1812102438 learned_addr learned my addr 172.21.15.121:0/1812102438 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe2affd640 1 -- 172.21.15.121:0/1812102438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c0713c0 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe2affd640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c380 tx=0x7fbe1c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe1c005c10 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c005db0 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c072050 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe1c004930 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.753+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c133920 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fbe1c01a020 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe23fff640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 0x7fbe0c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c070590 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.756 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7fbe1c04a900 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe2a7fc640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 0x7fbe0c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:32.757 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.754+0000 7fbe2a7fc640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 0x7fbe0c03a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009720 tx=0x7fbe1402e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:32.759 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.759+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe1c0127f0 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.925 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.924+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbe2c0a4020 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.927 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.927+0000 7fbe23fff640 1 -- 172.21.15.121:0/1812102438 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7fbe1c012a50 con 0x7fbe2c0a37b0 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 msgr2=0x7fbe0c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 0x7fbe0c03a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009720 tx=0x7fbe1402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 msgr2=0x7fbe2c071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c380 tx=0x7fbe1c00c840 comp rx=0 tx=0).stop 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 shutdown_connections 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbe0c0382a0 0x7fbe0c03a760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 --2- 172.21.15.121:0/1812102438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe2c0a37b0 0x7fbe2c071b10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:32.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 >> 172.21.15.121:0/1812102438 conn(0x7fbe2c0a8430 msgr2=0x7fbe2c1372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 shutdown_connections 2024-09-15T23:57:32.931 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:32.929+0000 7fbe31928640 1 -- 172.21.15.121:0/1812102438 wait complete. 2024-09-15T23:57:32.940 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:32.941 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:32.981 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:32.981 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:32.981 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:33.038 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:33.038 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:33.038 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:33.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:33.094 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-09-15T23:57:33.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.233+0000 7f3fe576d640 1 Processor -- start 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.233+0000 7f3fe576d640 1 -- start start 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.233+0000 7f3fe576d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3fe0135f30 0x7f3fe013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.233+0000 7f3fe576d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe00a08c0 con 0x7f3fe0135b50 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fe576d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe009b310 con 0x7f3fe0135f30 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fde7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3fe0135f30 0x7f3fe013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fdeffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3fe0135b50 0x7f3fe009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33788/0 (socket says 172.21.15.121:33788) 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fdeffd640 1 -- 172.21.15.121:0/3012418670 learned_addr learned my addr 172.21.15.121:0/3012418670 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:33.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fde7fc640 1 -- 172.21.15.121:0/3012418670 >> v1:172.21.15.121:6789/0 conn(0x7f3fe0135b50 legacy=0x7f3fe009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fde7fc640 1 -- 172.21.15.121:0/3012418670 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00a2270 con 0x7f3fe0135f30 2024-09-15T23:57:33.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.234+0000 7f3fddffb640 1 -- 172.21.15.121:0/3012418670 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529732916 0 0) 0x7f3fe00a08c0 con 0x7f3fe0135b50 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fde7fc640 1 --2- 172.21.15.121:0/3012418670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135f30 0x7f3fe013bb80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009720 tx=0x7f3fc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eefe0157103912a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fddffb640 1 -- 172.21.15.121:0/3012418670 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8037070 con 0x7f3fe0135f30 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fddffb640 1 -- 172.21.15.121:0/3012418670 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc802ae20 con 0x7f3fe0135f30 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fddffb640 1 -- 172.21.15.121:0/3012418670 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc8032590 con 0x7f3fe0135f30 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 -- 172.21.15.121:0/3012418670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135f30 msgr2=0x7f3fe013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3012418670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135f30 0x7f3fe013bb80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009720 tx=0x7f3fc802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.237 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 -- 172.21.15.121:0/3012418670 shutdown_connections 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3012418670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135f30 0x7f3fe013bb80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 -- 172.21.15.121:0/3012418670 >> 172.21.15.121:0/3012418670 conn(0x7f3fe00a85e0 msgr2=0x7f3fe00a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 -- 172.21.15.121:0/3012418670 shutdown_connections 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.235+0000 7f3fe576d640 1 -- 172.21.15.121:0/3012418670 wait complete. 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.236+0000 7f3fe576d640 1 Processor -- start 2024-09-15T23:57:33.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.236+0000 7f3fe576d640 1 -- start start 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fe576d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fe576d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0136350 con 0x7f3fe0135b50 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fdeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fdeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47438/0 (socket says 172.21.15.121:47438) 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fdeffd640 1 -- 172.21.15.121:0/3465334445 learned_addr learned my addr 172.21.15.121:0/3465334445 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fdeffd640 1 -- 172.21.15.121:0/3465334445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe0126240 con 0x7f3fe0135b50 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fdeffd640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c840 tx=0x7f3fd800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd8018070 con 0x7f3fe0135b50 2024-09-15T23:57:33.240 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd800a660 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd800a980 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.237+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01257c0 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.238+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe0125f10 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.238+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f3fd801b070 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.238+0000 7f3fd77fe640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 0x7f3fc003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.239+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7f3fd804a880 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.239+0000 7f3fde7fc640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 0x7f3fc003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.239+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe009aae0 con 0x7f3fe0135b50 2024-09-15T23:57:33.241 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.239+0000 7f3fde7fc640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 0x7f3fc003a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8034000 tx=0x7f3fc802e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.244 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.243+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fd8011360 con 0x7f3fe0135b50 2024-09-15T23:57:33.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.443+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fe00a1f10 con 0x7f3fe0135b50 2024-09-15T23:57:33.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.443+0000 7f3fd77fe640 1 -- 172.21.15.121:0/3465334445 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+2267 (secure 0 0 0) 0x7f3fd801cda0 con 0x7f3fe0135b50 2024-09-15T23:57:33.444 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:33.444 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":32,"btime":"2024-09-15T23:57:28:113510+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4822,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/2613943053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":2613943053},{"type":"v1","addr":"172.21.15.121:6827","nonce":2613943053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":4942,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/3343589599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3343589599},{"type":"v1","addr":"172.21.15.121:6825","nonce":3343589599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-09-15T23:57:33.444 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 32 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 msgr2=0x7f3fc003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 0x7f3fc003a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8034000 tx=0x7f3fc802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 msgr2=0x7f3fe0121ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c840 tx=0x7f3fd800cd00 comp rx=0 tx=0).stop 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 shutdown_connections 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3fc00382a0 0x7f3fc003a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 --2- 172.21.15.121:0/3465334445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fe0135b50 0x7f3fe0121ce0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 >> 172.21.15.121:0/3465334445 conn(0x7f3fe00a85e0 msgr2=0x7f3fe00a2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 shutdown_connections 2024-09-15T23:57:33.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.445+0000 7f3fe576d640 1 -- 172.21.15.121:0/3465334445 wait complete. 2024-09-15T23:57:33.457 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:57:33.457 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:57:33.457 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:57:33.457 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:33.458 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:57:33.458 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:57:33.458 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:57:33.458 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:57:33.467 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:57:33.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:57:33.468 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:57:33.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:57:33.510 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:57:33.510 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:33.511 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:57:33.511 DEBUG:teuthology.parallel:result is None 2024-09-15T23:57:33.511 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:57:33.585 INFO:tasks.ceph.mds.a.smithi121.stdout:starting mds.a at 2024-09-15T23:57:33.586 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:57:33.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.613+0000 7fb183c94640 1 Processor -- start 2024-09-15T23:57:33.614 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.613+0000 7fb183c94640 1 -- start start 2024-09-15T23:57:33.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb183c94640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb17c135b50 0x7fb17c09aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb183c94640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17c09b020 con 0x7fb17c135f30 2024-09-15T23:57:33.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb183c94640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c09b310 con 0x7fb17c135b50 2024-09-15T23:57:33.618 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb181a30640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb17c135b50 0x7fb17c09aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb18122f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb17c135f30 0x7fb17c0a39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33812/0 (socket says 172.21.15.121:33812) 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb18122f640 1 -- 172.21.15.121:0/920142582 learned_addr learned my addr 172.21.15.121:0/920142582 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb181a30640 1 -- 172.21.15.121:0/920142582 >> v1:172.21.15.121:6789/0 conn(0x7fb17c135f30 legacy=0x7fb17c0a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.614+0000 7fb181a30640 1 -- 172.21.15.121:0/920142582 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c0a08c0 con 0x7fb17c135b50 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb181a30640 1 --2- 172.21.15.121:0/920142582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c09aae0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb178009720 tx=0x7fb17802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8157c5294d454911 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb180a2e640 1 -- 172.21.15.121:0/920142582 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb178037070 con 0x7fb17c135b50 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb180a2e640 1 -- 172.21.15.121:0/920142582 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17802ae20 con 0x7fb17c135b50 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb180a2e640 1 -- 172.21.15.121:0/920142582 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb178032590 con 0x7fb17c135b50 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 -- 172.21.15.121:0/920142582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 msgr2=0x7fb17c09aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 --2- 172.21.15.121:0/920142582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c09aae0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb178009720 tx=0x7fb17802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 -- 172.21.15.121:0/920142582 shutdown_connections 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 --2- 172.21.15.121:0/920142582 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c09aae0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:33.619 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 -- 172.21.15.121:0/920142582 >> 172.21.15.121:0/920142582 conn(0x7fb17c0a85e0 msgr2=0x7fb17c0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.615+0000 7fb183c94640 1 -- 172.21.15.121:0/920142582 shutdown_connections 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.616+0000 7fb183c94640 1 -- 172.21.15.121:0/920142582 wait complete. 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.616+0000 7fb183c94640 1 Processor -- start 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.616+0000 7fb183c94640 1 -- start start 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb183c94640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb183c94640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c0a5430 con 0x7fb17c135b50 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb181a30640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb181a30640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47472/0 (socket says 172.21.15.121:47472) 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb181a30640 1 -- 172.21.15.121:0/4249223887 learned_addr learned my addr 172.21.15.121:0/4249223887 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb181a30640 1 -- 172.21.15.121:0/4249223887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c122050 con 0x7fb17c135b50 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb181a30640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb17802adf0 tx=0x7fb1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb178041070 con 0x7fb17c135b50 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17803c590 con 0x7fb17c135b50 2024-09-15T23:57:33.620 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c11fc70 con 0x7fb17c135b50 2024-09-15T23:57:33.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.617+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb178037040 con 0x7fb17c135b50 2024-09-15T23:57:33.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.618+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c1214c0 con 0x7fb17c135b50 2024-09-15T23:57:33.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fb178044070 con 0x7fb17c135b50 2024-09-15T23:57:33.621 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17c09e4b0 con 0x7fb17c135b50 2024-09-15T23:57:33.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb1727fc640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 0x7fb16003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:33.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 3232+0+0 (secure 0 0 0) 0x7fb17806bae0 con 0x7fb17c135b50 2024-09-15T23:57:33.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb18122f640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 0x7fb16003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:33.622 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.619+0000 7fb18122f640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 0x7fb16003a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb16c007fd0 tx=0x7fb16c007ac0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:33.624 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.623+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb17c09e4b0 con 0x7fb17c135b50 2024-09-15T23:57:33.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:33.803+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb17c136350 con 0x7fb17c135b50 2024-09-15T23:57:34.642 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.641+0000 7fb1727fc640 1 -- 172.21.15.121:0/4249223887 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7fb17802ae20 con 0x7fb17c135b50 2024-09-15T23:57:34.642 INFO:teuthology.orchestra.run.smithi121.stderr: removed all blocklist entries 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 msgr2=0x7fb16003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 0x7fb16003a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb16c007fd0 tx=0x7fb16c007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 msgr2=0x7fb17c11e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb17802adf0 tx=0x7fb1780046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 shutdown_connections 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb1600382a0 0x7fb16003a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 --2- 172.21.15.121:0/4249223887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb17c135b50 0x7fb17c11e600 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 >> 172.21.15.121:0/4249223887 conn(0x7fb17c0a85e0 msgr2=0x7fb17c09dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.643+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 shutdown_connections 2024-09-15T23:57:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.644+0000 7fb183c94640 1 -- 172.21.15.121:0/4249223887 wait complete. 2024-09-15T23:57:34.658 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.760+0000 7f6829318640 1 Processor -- start 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.760+0000 7f6829318640 1 -- start start 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.760+0000 7f6829318640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68240a3080 0x7f682413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f6829318640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682413ab10 con 0x7f682413a020 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f6829318640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f68240a3de0 con 0x7f68240a3080 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f68227fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68240a3080 0x7f682413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f68227fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f68240a3080 0x7f682413ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47484/0 (socket says 172.21.15.121:47484) 2024-09-15T23:57:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f68227fc640 1 -- 172.21.15.121:0/3546406610 learned_addr learned my addr 172.21.15.121:0/3546406610 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:34.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f6822ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f682413a020 0x7f682413a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33822/0 (socket says 172.21.15.121:33822) 2024-09-15T23:57:34.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f68227fc640 1 -- 172.21.15.121:0/3546406610 >> v1:172.21.15.121:6789/0 conn(0x7f682413a020 legacy=0x7f682413a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f68227fc640 1 -- 172.21.15.121:0/3546406610 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682406c390 con 0x7f68240a3080 2024-09-15T23:57:34.763 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.761+0000 7f6821ffb640 1 -- 172.21.15.121:0/3546406610 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195973934 0 0) 0x7f682413ab10 con 0x7f682413a020 2024-09-15T23:57:34.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f68227fc640 1 --2- 172.21.15.121:0/3546406610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f682413ef80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f68180097f0 tx=0x7f681802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9838571a54de24d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6821ffb640 1 -- 172.21.15.121:0/3546406610 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6818037070 con 0x7f68240a3080 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6821ffb640 1 -- 172.21.15.121:0/3546406610 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6818032440 con 0x7f68240a3080 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6821ffb640 1 -- 172.21.15.121:0/3546406610 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f681802ae60 con 0x7f68240a3080 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 -- 172.21.15.121:0/3546406610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 msgr2=0x7f682413ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 --2- 172.21.15.121:0/3546406610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f682413ef80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f68180097f0 tx=0x7f681802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 -- 172.21.15.121:0/3546406610 shutdown_connections 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 --2- 172.21.15.121:0/3546406610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f682413ef80 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 -- 172.21.15.121:0/3546406610 >> 172.21.15.121:0/3546406610 conn(0x7f68240a90f0 msgr2=0x7f68240a9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 -- 172.21.15.121:0/3546406610 shutdown_connections 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.762+0000 7f6829318640 1 -- 172.21.15.121:0/3546406610 wait complete. 2024-09-15T23:57:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.763+0000 7f6829318640 1 Processor -- start 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.763+0000 7f6829318640 1 -- start start 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6829318640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6829318640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68240a4c10 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6822ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6822ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47486/0 (socket says 172.21.15.121:47486) 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6822ffd640 1 -- 172.21.15.121:0/1920727188 learned_addr learned my addr 172.21.15.121:0/1920727188 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6822ffd640 1 -- 172.21.15.121:0/1920727188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682411fe10 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.764+0000 7f6822ffd640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f681400c420 tx=0x7f681400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.765+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814018070 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.765+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68140074d0 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.765+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6824072630 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.765+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6814004950 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.765+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682411fb00 con 0x7f68240a3080 2024-09-15T23:57:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f681401b070 con 0x7f68240a3080 2024-09-15T23:57:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68240a5830 con 0x7f68240a3080 2024-09-15T23:57:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f680b7fe640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 0x7f681003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 2587+0+0 (secure 0 0 0) 0x7f681404a210 con 0x7f68240a3080 2024-09-15T23:57:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f68227fc640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 0x7f681003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:34.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:57:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.766+0000 7f68227fc640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 0x7f681003a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6818034000 tx=0x7f681802e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:34.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:34.771+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6814011980 con 0x7f68240a3080 2024-09-15T23:57:35.004 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.003+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f682406cef0 con 0x7f68240a3080 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.004+0000 7f680b7fe640 1 -- 172.21.15.121:0/1920727188 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+2534 (secure 0 0 0) 0x7f6814011be0 con 0x7f68240a3080 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout: "auth_dump": [ 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.a", 2024-09-15T23:57:35.005 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmrl0yDhAAmges61AkNVATl3fkDcJtCA==", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mds.b", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dm1c5EFRAAQjii6dloQtB9r6b+oDUlfA==", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:35.006 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.0", 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC+c+dmWS98OBAABYXXLJEiQ32Ch8sOdjmGMQ==", 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.007 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.1", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDCc+dmae/mKxAAb1MVakHG7AWyXTfjXcC5Ww==", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "osd.2", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQDGc+dm0fWaLRAAVx8jT36dFL/hVkUBD+L4uA==", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow profile osd", 2024-09-15T23:57:35.008 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile osd", 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.0", 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg==", 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow r", 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.009 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.1", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmOA9CIRAA3IDTN3uPbSBxbM2AFlMv4w==", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow r", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow rw", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow rwx" 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "client.admin", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC7c+dm1qMxNRAAha+qdHw6Albq/4FeBkKFmw==", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mgr": "allow *", 2024-09-15T23:57:35.010 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow *", 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "entity": "mgr.x", 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "key": "AQC8c+dmGfgJCxAAO99Xwfzdn6pwAplxw70kOQ==", 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": { 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": "allow *", 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "mon": "allow profile mgr", 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: "osd": "allow *" 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-15T23:57:35.011 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:35.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 msgr2=0x7f681003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 0x7f681003a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6818034000 tx=0x7f681802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:35.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 msgr2=0x7f6824120560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f681400c420 tx=0x7f681400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 shutdown_connections 2024-09-15T23:57:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f68100382a0 0x7f681003a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 --2- 172.21.15.121:0/1920727188 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68240a3080 0x7f6824120560 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 >> 172.21.15.121:0/1920727188 conn(0x7f68240a90f0 msgr2=0x7f6824136ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 shutdown_connections 2024-09-15T23:57:35.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.006+0000 7f6829318640 1 -- 172.21.15.121:0/1920727188 wait complete. 2024-09-15T23:57:35.018 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:57:35.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.114+0000 7f8f00027640 1 Processor -- start 2024-09-15T23:57:35.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.114+0000 7f8f00027640 1 -- start start 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8f00027640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ef8135f30 0x7f8ef813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8f00027640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ef80a08c0 con 0x7f8ef8135b50 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8f00027640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8ef809b310 con 0x7f8ef8135f30 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8efd5c2640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8ef8135f30 0x7f8ef813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8efddc3640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8ef8135b50 0x7f8ef809aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33836/0 (socket says 172.21.15.121:33836) 2024-09-15T23:57:35.116 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8efddc3640 1 -- 172.21.15.121:0/942224063 learned_addr learned my addr 172.21.15.121:0/942224063 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:35.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8efd5c2640 1 -- 172.21.15.121:0/942224063 >> v1:172.21.15.121:6789/0 conn(0x7f8ef8135b50 legacy=0x7f8ef809aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.117 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.115+0000 7f8efd5c2640 1 -- 172.21.15.121:0/942224063 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef80a2270 con 0x7f8ef8135f30 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8efd5c2640 1 --2- 172.21.15.121:0/942224063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135f30 0x7f8ef813bb80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009720 tx=0x7f8eec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb12cd8ab4f0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8efcdc1640 1 -- 172.21.15.121:0/942224063 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec037070 con 0x7f8ef8135f30 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8efcdc1640 1 -- 172.21.15.121:0/942224063 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eec02ae20 con 0x7f8ef8135f30 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8efcdc1640 1 -- 172.21.15.121:0/942224063 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec032590 con 0x7f8ef8135f30 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8f00027640 1 -- 172.21.15.121:0/942224063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135f30 msgr2=0x7f8ef813bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8f00027640 1 --2- 172.21.15.121:0/942224063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135f30 0x7f8ef813bb80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009720 tx=0x7f8eec02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8f00027640 1 -- 172.21.15.121:0/942224063 shutdown_connections 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8f00027640 1 --2- 172.21.15.121:0/942224063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135f30 0x7f8ef813bb80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.116+0000 7f8f00027640 1 -- 172.21.15.121:0/942224063 >> 172.21.15.121:0/942224063 conn(0x7f8ef80a85e0 msgr2=0x7f8ef80a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.117+0000 7f8f00027640 1 -- 172.21.15.121:0/942224063 shutdown_connections 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.117+0000 7f8f00027640 1 -- 172.21.15.121:0/942224063 wait complete. 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.117+0000 7f8f00027640 1 Processor -- start 2024-09-15T23:57:35.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.117+0000 7f8f00027640 1 -- start start 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8f00027640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8f00027640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef8136350 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8efddc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8efddc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47510/0 (socket says 172.21.15.121:47510) 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8efddc3640 1 -- 172.21.15.121:0/2987943770 learned_addr learned my addr 172.21.15.121:0/2987943770 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8efddc3640 1 -- 172.21.15.121:0/2987943770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef81242b0 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8efddc3640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c4a0 tx=0x7f8ee800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.118+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee8017070 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.119+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee8005c10 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.119+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef8123720 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.119+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ee8007070 con 0x7f8ef8135b50 2024-09-15T23:57:35.121 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.119+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef809ffd0 con 0x7f8ef8135b50 2024-09-15T23:57:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f8ee801a070 con 0x7f8ef8135b50 2024-09-15T23:57:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef81238f0 con 0x7f8ef8135b50 2024-09-15T23:57:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8ef67fc640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 0x7f8ee403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 2587+0+0 (secure 0 0 0) 0x7f8ee804a110 con 0x7f8ef8135b50 2024-09-15T23:57:35.122 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8efd5c2640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 0x7f8ee403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.123 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.120+0000 7f8efd5c2640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 0x7f8ee403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8eec034000 tx=0x7f8eec02e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.125 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.124+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ee801b3b0 con 0x7f8ef8135b50 2024-09-15T23:57:35.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.291+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8ef80a1f10 con 0x7f8ef8135b50 2024-09-15T23:57:35.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.291+0000 7f8ef67fc640 1 -- 172.21.15.121:0/2987943770 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7f8ee8010300 con 0x7f8ef8135b50 2024-09-15T23:57:35.292 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:35.292 INFO:teuthology.orchestra.run.smithi121.stdout:[ 2024-09-15T23:57:35.293 INFO:teuthology.orchestra.run.smithi121.stdout: { 2024-09-15T23:57:35.293 INFO:teuthology.orchestra.run.smithi121.stdout: "poolnum": 1, 2024-09-15T23:57:35.293 INFO:teuthology.orchestra.run.smithi121.stdout: "poolname": ".mgr" 2024-09-15T23:57:35.293 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:35.293 INFO:teuthology.orchestra.run.smithi121.stdout:] 2024-09-15T23:57:35.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 msgr2=0x7f8ee403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 0x7f8ee403a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8eec034000 tx=0x7f8eec02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:35.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 msgr2=0x7f8ef81cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c4a0 tx=0x7f8ee800c960 comp rx=0 tx=0).stop 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 shutdown_connections 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8ee40382a0 0x7f8ee403a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 --2- 172.21.15.121:0/2987943770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8ef8135b50 0x7f8ef81cc970 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 >> 172.21.15.121:0/2987943770 conn(0x7f8ef80a85e0 msgr2=0x7f8ef80a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 shutdown_connections 2024-09-15T23:57:35.295 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.293+0000 7f8f00027640 1 -- 172.21.15.121:0/2987943770 wait complete. 2024-09-15T23:57:35.304 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:57:35.305 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:57:35.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.406+0000 7f0afc1b0640 1 Processor -- start 2024-09-15T23:57:35.407 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.406+0000 7f0afc1b0640 1 -- start start 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.406+0000 7f0afc1b0640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0af4133020 0x7f0af40a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.406+0000 7f0afc1b0640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af409abc0 con 0x7f0af4133400 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.406+0000 7f0afc1b0640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0af40a2310 con 0x7f0af4133020 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af9f4c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0af4133020 0x7f0af40a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af974b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0af4133400 0x7f0af4135fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33838/0 (socket says 172.21.15.121:33838) 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af974b640 1 -- 172.21.15.121:0/1873129962 learned_addr learned my addr 172.21.15.121:0/1873129962 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af9f4c640 1 -- 172.21.15.121:0/1873129962 >> v1:172.21.15.121:6789/0 conn(0x7f0af4133400 legacy=0x7f0af4135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af9f4c640 1 -- 172.21.15.121:0/1873129962 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af4132bf0 con 0x7f0af4133020 2024-09-15T23:57:35.408 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af8f4a640 1 -- 172.21.15.121:0/1873129962 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684509725 0 0) 0x7f0af409abc0 con 0x7f0af4133400 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.407+0000 7f0af9f4c640 1 --2- 172.21.15.121:0/1873129962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af40a04b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009720 tx=0x7f0af002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bc76634d1083db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0af8f4a640 1 -- 172.21.15.121:0/1873129962 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0037070 con 0x7f0af4133020 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0af8f4a640 1 -- 172.21.15.121:0/1873129962 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af002ad90 con 0x7f0af4133020 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0af8f4a640 1 -- 172.21.15.121:0/1873129962 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0032590 con 0x7f0af4133020 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 -- 172.21.15.121:0/1873129962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 msgr2=0x7f0af40a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/1873129962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af40a04b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009720 tx=0x7f0af002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 -- 172.21.15.121:0/1873129962 shutdown_connections 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/1873129962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af40a04b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 -- 172.21.15.121:0/1873129962 >> 172.21.15.121:0/1873129962 conn(0x7f0af40a8430 msgr2=0x7f0af40a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.410 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 -- 172.21.15.121:0/1873129962 shutdown_connections 2024-09-15T23:57:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.408+0000 7f0afc1b0640 1 -- 172.21.15.121:0/1873129962 wait complete. 2024-09-15T23:57:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.409+0000 7f0afc1b0640 1 Processor -- start 2024-09-15T23:57:35.411 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.409+0000 7f0afc1b0640 1 -- start start 2024-09-15T23:57:35.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0afc1b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0afc1b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0af40a19c0 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0af9f4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0af9f4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47528/0 (socket says 172.21.15.121:47528) 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0af9f4c640 1 -- 172.21.15.121:0/4067607030 learned_addr learned my addr 172.21.15.121:0/4067607030 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0af9f4c640 1 -- 172.21.15.121:0/4067607030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af409e300 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0af9f4c640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009720 tx=0x7f0af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0041070 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af003c460 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af4135e50 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0037040 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.410+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af409d950 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.411+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f0af0044070 con 0x7f0af4133020 2024-09-15T23:57:35.413 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.411+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af4133830 con 0x7f0af4133020 2024-09-15T23:57:35.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.411+0000 7f0aea7fc640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 0x7f0ad803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.411+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 2587+0+0 (secure 0 0 0) 0x7f0af006b950 con 0x7f0af4133020 2024-09-15T23:57:35.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.411+0000 7f0af974b640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 0x7f0ad803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.414 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.412+0000 7f0af974b640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 0x7f0ad803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4007910 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.416+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0af003a520 con 0x7f0af4133020 2024-09-15T23:57:35.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.584+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0af406bbb0 con 0x7f0af4133020 2024-09-15T23:57:35.645 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.644+0000 7f0aea7fc640 1 -- 172.21.15.121:0/4067607030 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7f0af003bdd0 con 0x7f0af4133020 2024-09-15T23:57:35.645 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' created 2024-09-15T23:57:35.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 msgr2=0x7f0ad803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 0x7f0ad803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000c00 tx=0x7f0ae4007910 comp rx=0 tx=0).stop 2024-09-15T23:57:35.647 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 msgr2=0x7f0af4133e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009720 tx=0x7f0af00046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 shutdown_connections 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f0ad80382a0 0x7f0ad803a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 --2- 172.21.15.121:0/4067607030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0af4133020 0x7f0af4133e70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 >> 172.21.15.121:0/4067607030 conn(0x7f0af40a8430 msgr2=0x7f0af409f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 shutdown_connections 2024-09-15T23:57:35.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.646+0000 7f0afc1b0640 1 -- 172.21.15.121:0/4067607030 wait complete. 2024-09-15T23:57:35.661 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:57:35.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.765+0000 7f8c53ce4640 1 Processor -- start 2024-09-15T23:57:35.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.765+0000 7f8c53ce4640 1 -- start start 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.765+0000 7f8c53ce4640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8c4c0a37b0 0x7f8c4c09acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.765+0000 7f8c53ce4640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4c09b200 con 0x7f8c4c0a3b90 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.765+0000 7f8c53ce4640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4c09b4f0 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.766+0000 7f8c51a80640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8c4c0a37b0 0x7f8c4c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.766+0000 7f8c5127f640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8c4c0a3b90 0x7f8c4c0a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33852/0 (socket says 172.21.15.121:33852) 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.766+0000 7f8c5127f640 1 -- 172.21.15.121:0/2357550439 learned_addr learned my addr 172.21.15.121:0/2357550439 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.766+0000 7f8c51a80640 1 -- 172.21.15.121:0/2357550439 >> v1:172.21.15.121:6789/0 conn(0x7f8c4c0a3b90 legacy=0x7f8c4c0a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.767 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.766+0000 7f8c51a80640 1 -- 172.21.15.121:0/2357550439 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c0a1c90 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c51a80640 1 --2- 172.21.15.121:0/2357550439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c09acc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009720 tx=0x7f8c4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cdb974075f47c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c50a7e640 1 -- 172.21.15.121:0/2357550439 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48037070 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c50a7e640 1 -- 172.21.15.121:0/2357550439 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4802ad90 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c50a7e640 1 -- 172.21.15.121:0/2357550439 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48032590 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 -- 172.21.15.121:0/2357550439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 msgr2=0x7f8c4c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/2357550439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c09acc0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009720 tx=0x7f8c4802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 -- 172.21.15.121:0/2357550439 shutdown_connections 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/2357550439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c09acc0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 -- 172.21.15.121:0/2357550439 >> 172.21.15.121:0/2357550439 conn(0x7f8c4c0a8430 msgr2=0x7f8c4c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 -- 172.21.15.121:0/2357550439 shutdown_connections 2024-09-15T23:57:35.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.767+0000 7f8c53ce4640 1 -- 172.21.15.121:0/2357550439 wait complete. 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.768+0000 7f8c53ce4640 1 Processor -- start 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.768+0000 7f8c53ce4640 1 -- start start 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c53ce4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c53ce4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c0a5220 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c51a80640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c51a80640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47546/0 (socket says 172.21.15.121:47546) 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c51a80640 1 -- 172.21.15.121:0/1637241048 learned_addr learned my addr 172.21.15.121:0/1637241048 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c51a80640 1 -- 172.21.15.121:0/1637241048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c121e50 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c51a80640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009840 tx=0x7f8c480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48041070 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4803c460 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c120fb0 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.769+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c48037040 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.770+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c120240 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.770+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f8c48044070 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.770+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4c09acc0 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.771+0000 7f8c427fc640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 0x7f8c3003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.771+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 2957+0+0 (secure 0 0 0) 0x7f8c4806bc40 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.771+0000 7f8c5127f640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 0x7f8c3003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:35.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.771+0000 7f8c5127f640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 0x7f8c3003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005880 tx=0x7f8c3c007a80 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:35.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.775+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c4803a720 con 0x7f8c4c0a37b0 2024-09-15T23:57:35.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:35.941+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8c4c0a1f00 con 0x7f8c4c0a37b0 2024-09-15T23:57:36.646 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.645+0000 7f8c427fc640 1 -- 172.21.15.121:0/1637241048 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f8c4803d3f0 con 0x7f8c4c0a37b0 2024-09-15T23:57:36.646 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' created 2024-09-15T23:57:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 msgr2=0x7f8c3003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.648 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 0x7f8c3003a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c005880 tx=0x7f8c3c007a80 comp rx=0 tx=0).stop 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 msgr2=0x7f8c4c121700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009840 tx=0x7f8c480046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 shutdown_connections 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8c300382a0 0x7f8c3003a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 --2- 172.21.15.121:0/1637241048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8c4c0a37b0 0x7f8c4c121700 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 >> 172.21.15.121:0/1637241048 conn(0x7f8c4c0a8430 msgr2=0x7f8c4c0a70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:36.649 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 shutdown_connections 2024-09-15T23:57:36.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.648+0000 7f8c53ce4640 1 -- 172.21.15.121:0/1637241048 wait complete. 2024-09-15T23:57:36.676 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.777+0000 7f0391635640 1 Processor -- start 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.777+0000 7f0391635640 1 -- start start 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.777+0000 7f0391635640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f038c0a37b0 0x7f038c09acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.777+0000 7f0391635640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c09b200 con 0x7f038c0a3b90 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f0391635640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f038c09b4f0 con 0x7f038c0a37b0 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f038affd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f038c0a37b0 0x7f038c09acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f03827fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f038c0a3b90 0x7f038c0a4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33868/0 (socket says 172.21.15.121:33868) 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f03827fc640 1 -- 172.21.15.121:0/3310356572 learned_addr learned my addr 172.21.15.121:0/3310356572 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f038affd640 1 -- 172.21.15.121:0/3310356572 >> v1:172.21.15.121:6789/0 conn(0x7f038c0a3b90 legacy=0x7f038c0a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.778+0000 7f038affd640 1 -- 172.21.15.121:0/3310356572 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c0a1c90 con 0x7f038c0a37b0 2024-09-15T23:57:36.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f038affd640 1 --2- 172.21.15.121:0/3310356572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c09acc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f037c009720 tx=0x7f037c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd3392c2b52980 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f038a7fc640 1 -- 172.21.15.121:0/3310356572 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c037070 con 0x7f038c0a37b0 2024-09-15T23:57:36.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f038a7fc640 1 -- 172.21.15.121:0/3310356572 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c02ad90 con 0x7f038c0a37b0 2024-09-15T23:57:36.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f038a7fc640 1 -- 172.21.15.121:0/3310356572 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c032590 con 0x7f038c0a37b0 2024-09-15T23:57:36.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 -- 172.21.15.121:0/3310356572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 msgr2=0x7f038c09acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 --2- 172.21.15.121:0/3310356572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c09acc0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f037c009720 tx=0x7f037c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 -- 172.21.15.121:0/3310356572 shutdown_connections 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 --2- 172.21.15.121:0/3310356572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c09acc0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 -- 172.21.15.121:0/3310356572 >> 172.21.15.121:0/3310356572 conn(0x7f038c0a8430 msgr2=0x7f038c0a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 -- 172.21.15.121:0/3310356572 shutdown_connections 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.779+0000 7f0391635640 1 -- 172.21.15.121:0/3310356572 wait complete. 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.780+0000 7f0391635640 1 Processor -- start 2024-09-15T23:57:36.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.780+0000 7f0391635640 1 -- start start 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f0391635640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f0391635640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0a5220 con 0x7f038c0a37b0 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f038affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f038affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47556/0 (socket says 172.21.15.121:47556) 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f038affd640 1 -- 172.21.15.121:0/3698289174 learned_addr learned my addr 172.21.15.121:0/3698289174 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f038affd640 1 -- 172.21.15.121:0/3698289174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c11e460 con 0x7f038c0a37b0 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f038affd640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f037c02a150 tx=0x7f037c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c041070 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c032e30 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.781+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c073020 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.782+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f037c037040 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.782+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c11e9a0 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.782+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c09acc0 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.782+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f037c044070 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.783+0000 7f0383fff640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 0x7f036c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.783+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 3339+0+0 (secure 0 0 0) 0x7f037c06bcc0 con 0x7f038c0a37b0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.783+0000 7f03827fc640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 0x7f036c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:36.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.783+0000 7f03827fc640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 0x7f036c03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03740015c0 tx=0x7f0374007a80 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:36.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.787+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f037c03c7c0 con 0x7f038c0a37b0 2024-09-15T23:57:36.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:36.987+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f038c0a1f00 con 0x7f038c0a37b0 2024-09-15T23:57:37.657 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.656+0000 7f0383fff640 1 -- 172.21.15.121:0/3698289174 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v34) ==== 174+0+0 (secure 0 0 0) 0x7f037c03cce0 con 0x7f038c0a37b0 2024-09-15T23:57:37.659 INFO:teuthology.orchestra.run.smithi121.stderr:new fs with metadata pool 12 and data pool 13 2024-09-15T23:57:37.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.669+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 msgr2=0x7f036c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.669+0000 7f0391635640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 0x7f036c03a760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03740015c0 tx=0x7f0374007a80 comp rx=0 tx=0).stop 2024-09-15T23:57:37.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.669+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 msgr2=0x7f038c1cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.669+0000 7f0391635640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f037c02a150 tx=0x7f037c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.671+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 shutdown_connections 2024-09-15T23:57:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.671+0000 7f0391635640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f036c0382a0 0x7f036c03a760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.671+0000 7f0391635640 1 --2- 172.21.15.121:0/3698289174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f038c0a37b0 0x7f038c1cb830 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.671+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 >> 172.21.15.121:0/3698289174 conn(0x7f038c0a8430 msgr2=0x7f038c135f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.672+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 shutdown_connections 2024-09-15T23:57:37.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.673+0000 7f0391635640 1 -- 172.21.15.121:0/3698289174 wait complete. 2024-09-15T23:57:37.695 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:37.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920376f640 1 Processor -- start 2024-09-15T23:57:37.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920376f640 1 -- start start 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920376f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f91fc13a280 0x7f91fc13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920376f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc13a080 con 0x7f91fc0a4c20 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920376f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0a3d50 con 0x7f91fc13a280 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f920150b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f91fc13a280 0x7f91fc13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f9200d0a640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f91fc0a4c20 0x7f91fc0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33874/0 (socket says 172.21.15.121:33874) 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.793+0000 7f9200d0a640 1 -- 172.21.15.121:0/1152314928 learned_addr learned my addr 172.21.15.121:0/1152314928 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.794+0000 7f920150b640 1 -- 172.21.15.121:0/1152314928 >> v1:172.21.15.121:6789/0 conn(0x7f91fc0a4c20 legacy=0x7f91fc0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.794+0000 7f920150b640 1 -- 172.21.15.121:0/1152314928 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0a3f80 con 0x7f91fc13a280 2024-09-15T23:57:37.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.794+0000 7f91fbfff640 1 -- 172.21.15.121:0/1152314928 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256336848 0 0) 0x7f91fc13a080 con 0x7f91fc0a4c20 2024-09-15T23:57:37.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.794+0000 7f920150b640 1 --2- 172.21.15.121:0/1152314928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc13a280 0x7f91fc13a660 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009720 tx=0x7f91f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4633cb96cc54058 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.798 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.794+0000 7f91fbfff640 1 -- 172.21.15.121:0/1152314928 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4037070 con 0x7f91fc13a280 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f91fbfff640 1 -- 172.21.15.121:0/1152314928 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f402ad90 con 0x7f91fc13a280 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f91fbfff640 1 -- 172.21.15.121:0/1152314928 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4032590 con 0x7f91fc13a280 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 -- 172.21.15.121:0/1152314928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc13a280 msgr2=0x7f91fc13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 --2- 172.21.15.121:0/1152314928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc13a280 0x7f91fc13a660 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009720 tx=0x7f91f402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 -- 172.21.15.121:0/1152314928 shutdown_connections 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 --2- 172.21.15.121:0/1152314928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc13a280 0x7f91fc13a660 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 -- 172.21.15.121:0/1152314928 >> 172.21.15.121:0/1152314928 conn(0x7f91fc0ac3e0 msgr2=0x7f91fc0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 -- 172.21.15.121:0/1152314928 shutdown_connections 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.795+0000 7f920376f640 1 -- 172.21.15.121:0/1152314928 wait complete. 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.796+0000 7f920376f640 1 Processor -- start 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.796+0000 7f920376f640 1 -- start start 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.796+0000 7f920376f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.796+0000 7f920376f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc139d40 con 0x7f91fc0a4c20 2024-09-15T23:57:37.799 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920150b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920150b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47566/0 (socket says 172.21.15.121:47566) 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920150b640 1 -- 172.21.15.121:0/4049151929 learned_addr learned my addr 172.21.15.121:0/4049151929 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920150b640 1 -- 172.21.15.121:0/4049151929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc124fa0 con 0x7f91fc0a4c20 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920150b640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009720 tx=0x7f91f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4041070 con 0x7f91fc0a4c20 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f403c460 con 0x7f91fc0a4c20 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc137fd0 con 0x7f91fc0a4c20 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f4037040 con 0x7f91fc0a4c20 2024-09-15T23:57:37.800 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.797+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc1228e0 con 0x7f91fc0a4c20 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.798+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f91f4044070 con 0x7f91fc0a4c20 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.798+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc06dab0 con 0x7f91fc0a4c20 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.798+0000 7f91f9ffb640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 0x7f91e803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.798+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3439+0+0 (secure 0 0 0) 0x7f91f406bca0 con 0x7f91fc0a4c20 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.798+0000 7f9200d0a640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 0x7f91e803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:37.801 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.799+0000 7f9200d0a640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 0x7f91e803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000c00 tx=0x7f91f0007a40 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:37.804 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.803+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91f403a520 con 0x7f91fc0a4c20 2024-09-15T23:57:37.970 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.969+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91fc0a2f50 con 0x7f91fc0a4c20 2024-09-15T23:57:37.971 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.970+0000 7f91f9ffb640 1 -- 172.21.15.121:0/4049151929 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+10691 (secure 0 0 0) 0x7f91f403a780 con 0x7f91fc0a4c20 2024-09-15T23:57:37.971 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:37.971 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:36.988228+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:35.603216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:35.960235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 msgr2=0x7f91e803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 0x7f91e803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000c00 tx=0x7f91f0007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 msgr2=0x7f91fc0a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009720 tx=0x7f91f40046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 shutdown_connections 2024-09-15T23:57:37.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91e80382a0 0x7f91e803a760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 --2- 172.21.15.121:0/4049151929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91fc0a4c20 0x7f91fc0a1020 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:37.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 >> 172.21.15.121:0/4049151929 conn(0x7f91fc0ac3e0 msgr2=0x7f91fc0aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:37.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 shutdown_connections 2024-09-15T23:57:37.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:37.972+0000 7f920376f640 1 -- 172.21.15.121:0/4049151929 wait complete. 2024-09-15T23:57:37.983 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.079+0000 7f05470f8640 1 Processor -- start 2024-09-15T23:57:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.079+0000 7f05470f8640 1 -- start start 2024-09-15T23:57:38.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f05470f8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0540135f30 0x7f054013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f05470f8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05400a08c0 con 0x7f0540135b50 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f05470f8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f054009b310 con 0x7f0540135f30 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f053ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0540135f30 0x7f054013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f0544e94640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f0540135b50 0x7f054009aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33886/0 (socket says 172.21.15.121:33886) 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f0544e94640 1 -- 172.21.15.121:0/599721047 learned_addr learned my addr 172.21.15.121:0/599721047 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f053ffff640 1 -- 172.21.15.121:0/599721047 >> v1:172.21.15.121:6789/0 conn(0x7f0540135b50 legacy=0x7f054009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f053ffff640 1 -- 172.21.15.121:0/599721047 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05400a2270 con 0x7f0540135f30 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.080+0000 7f053f7fe640 1 -- 172.21.15.121:0/599721047 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041196862 0 0) 0x7f05400a08c0 con 0x7f0540135b50 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f053ffff640 1 --2- 172.21.15.121:0/599721047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135f30 0x7f054013bb80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0534009720 tx=0x7f053402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318d24d38ca595c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f053f7fe640 1 -- 172.21.15.121:0/599721047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0534037070 con 0x7f0540135f30 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f053f7fe640 1 -- 172.21.15.121:0/599721047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053402ae20 con 0x7f0540135f30 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f053f7fe640 1 -- 172.21.15.121:0/599721047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0534032590 con 0x7f0540135f30 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f05470f8640 1 -- 172.21.15.121:0/599721047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135f30 msgr2=0x7f054013bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f05470f8640 1 --2- 172.21.15.121:0/599721047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135f30 0x7f054013bb80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0534009720 tx=0x7f053402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f05470f8640 1 -- 172.21.15.121:0/599721047 shutdown_connections 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f05470f8640 1 --2- 172.21.15.121:0/599721047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135f30 0x7f054013bb80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.081+0000 7f05470f8640 1 -- 172.21.15.121:0/599721047 >> 172.21.15.121:0/599721047 conn(0x7f05400a85e0 msgr2=0x7f05400a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.082+0000 7f05470f8640 1 -- 172.21.15.121:0/599721047 shutdown_connections 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.082+0000 7f05470f8640 1 -- 172.21.15.121:0/599721047 wait complete. 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.082+0000 7f05470f8640 1 Processor -- start 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.082+0000 7f05470f8640 1 -- start start 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f05470f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f05470f8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0540136350 con 0x7f0540135b50 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f0544e94640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f0544e94640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47580/0 (socket says 172.21.15.121:47580) 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f0544e94640 1 -- 172.21.15.121:0/2935831678 learned_addr learned my addr 172.21.15.121:0/2935831678 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.083+0000 7f0544e94640 1 -- 172.21.15.121:0/2935831678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0540072310 con 0x7f0540135b50 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f0544e94640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f053000c420 tx=0x7f053000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0530018070 con 0x7f0540135b50 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05300074d0 con 0x7f0540135b50 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054009d460 con 0x7f0540135b50 2024-09-15T23:57:38.090 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0530004950 con 0x7f0540135b50 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.084+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054009d180 con 0x7f0540135b50 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f053001b070 con 0x7f0540135b50 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054009aae0 con 0x7f0540135b50 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f053d7fa640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 0x7f052c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3439+0+0 (secure 0 0 0) 0x7f053004a560 con 0x7f0540135b50 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f053ffff640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 0x7f052c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.085+0000 7f053ffff640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 0x7f052c03a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0534034000 tx=0x7f053402e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.090+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0530011980 con 0x7f0540135b50 2024-09-15T23:57:38.256 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.255+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05400a1f10 con 0x7f0540135b50 2024-09-15T23:57:38.257 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.256+0000 7f053d7fa640 1 -- 172.21.15.121:0/2935831678 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+10691 (secure 0 0 0) 0x7f0530011be0 con 0x7f0540135b50 2024-09-15T23:57:38.257 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:38.257 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":68,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:36.988228+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:35.603216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:35.960235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:38.259 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.258+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 msgr2=0x7f052c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.258+0000 7f05470f8640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 0x7f052c03a760 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0534034000 tx=0x7f053402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.258+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 msgr2=0x7f0540072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.258+0000 7f05470f8640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f053000c420 tx=0x7f053000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 shutdown_connections 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f052c0382a0 0x7f052c03a760 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 --2- 172.21.15.121:0/2935831678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0540135b50 0x7f0540072e40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 >> 172.21.15.121:0/2935831678 conn(0x7f05400a85e0 msgr2=0x7f054009f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 shutdown_connections 2024-09-15T23:57:38.260 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.259+0000 7f05470f8640 1 -- 172.21.15.121:0/2935831678 wait complete. 2024-09-15T23:57:38.271 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:57:38.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.371+0000 7fbcb07bd640 1 Processor -- start 2024-09-15T23:57:38.372 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.371+0000 7fbcb07bd640 1 -- start start 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.371+0000 7fbcb07bd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbca80a3b90 0x7fbca80a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcb07bd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca80a4560 con 0x7fbca80a37b0 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcb07bd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbca809b4f0 con 0x7fbca80a3b90 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcadd58640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbca80a3b90 0x7fbca80a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcae559640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbca80a37b0 0x7fbca809acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33892/0 (socket says 172.21.15.121:33892) 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcae559640 1 -- 172.21.15.121:0/3973569841 learned_addr learned my addr 172.21.15.121:0/3973569841 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcadd58640 1 -- 172.21.15.121:0/3973569841 >> v1:172.21.15.121:6789/0 conn(0x7fbca80a37b0 legacy=0x7fbca809acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcadd58640 1 -- 172.21.15.121:0/3973569841 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80a1c90 con 0x7fbca80a3b90 2024-09-15T23:57:38.373 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.372+0000 7fbcad557640 1 -- 172.21.15.121:0/3973569841 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249453561 0 0) 0x7fbca80a4560 con 0x7fbca80a37b0 2024-09-15T23:57:38.374 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcadd58640 1 --2- 172.21.15.121:0/3973569841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a3b90 0x7fbca80a4020 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009720 tx=0x7fbc9802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86849c21be3c9bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcad557640 1 -- 172.21.15.121:0/3973569841 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc98037070 con 0x7fbca80a3b90 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcad557640 1 -- 172.21.15.121:0/3973569841 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9802ad90 con 0x7fbca80a3b90 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcad557640 1 -- 172.21.15.121:0/3973569841 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc98032590 con 0x7fbca80a3b90 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 -- 172.21.15.121:0/3973569841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a3b90 msgr2=0x7fbca80a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/3973569841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a3b90 0x7fbca80a4020 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009720 tx=0x7fbc9802a110 comp rx=0 tx=0).stop 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 -- 172.21.15.121:0/3973569841 shutdown_connections 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/3973569841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a3b90 0x7fbca80a4020 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 -- 172.21.15.121:0/3973569841 >> 172.21.15.121:0/3973569841 conn(0x7fbca80a8430 msgr2=0x7fbca80a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 -- 172.21.15.121:0/3973569841 shutdown_connections 2024-09-15T23:57:38.375 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.373+0000 7fbcb07bd640 1 -- 172.21.15.121:0/3973569841 wait complete. 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.374+0000 7fbcb07bd640 1 Processor -- start 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.374+0000 7fbcb07bd640 1 -- start start 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcb07bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcb07bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80a5220 con 0x7fbca80a37b0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcae559640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcae559640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47608/0 (socket says 172.21.15.121:47608) 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcae559640 1 -- 172.21.15.121:0/1897488210 learned_addr learned my addr 172.21.15.121:0/1897488210 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcae559640 1 -- 172.21.15.121:0/1897488210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca8071bb0 con 0x7fbca80a37b0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcae559640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c420 tx=0x7fbca400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca4018070 con 0x7fbca80a37b0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca40074d0 con 0x7fbca80a37b0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbca4004950 con 0x7fbca80a37b0 2024-09-15T23:57:38.378 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca8072180 con 0x7fbca80a37b0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.375+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca8073490 con 0x7fbca80a37b0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.376+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fbca401b070 con 0x7fbca80a37b0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.376+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca80a4020 con 0x7fbca80a37b0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.376+0000 7fbc9effd640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 0x7fbc8c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.376+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 3439+0+0 (secure 0 0 0) 0x7fbca404a560 con 0x7fbca80a37b0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.377+0000 7fbcadd58640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 0x7fbc8c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.379 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.377+0000 7fbcadd58640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 0x7fbc8c03a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009720 tx=0x7fbc9802e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.382 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.381+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbca4011980 con 0x7fbca80a37b0 2024-09-15T23:57:38.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.580+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbca80a1f00 con 0x7fbca80a37b0 2024-09-15T23:57:38.660 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.659+0000 7fbc9effd640 1 -- 172.21.15.121:0/1897488210 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7fbca4011be0 con 0x7fbca80a37b0 2024-09-15T23:57:38.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.661+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 msgr2=0x7fbc8c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.661+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 0x7fbc8c03a760 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009720 tx=0x7fbc9802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.661+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 msgr2=0x7fbca8132a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.661+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c420 tx=0x7fbca400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 shutdown_connections 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fbc8c0382a0 0x7fbc8c03a760 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 --2- 172.21.15.121:0/1897488210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbca80a37b0 0x7fbca8132a80 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 >> 172.21.15.121:0/1897488210 conn(0x7fbca80a8430 msgr2=0x7fbca8133cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 shutdown_connections 2024-09-15T23:57:38.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.662+0000 7fbcb07bd640 1 -- 172.21.15.121:0/1897488210 wait complete. 2024-09-15T23:57:38.674 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:57:38.674 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:57:38.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a99fd640 1 Processor -- start 2024-09-15T23:57:38.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a99fd640 1 -- start start 2024-09-15T23:57:38.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a99fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7a40a7140 0x7fb7a40a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a99fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a40a6d10 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a99fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a406e230 con 0x7fb7a40a7140 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb7a2ffd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fb7a40a7140 0x7fb7a40a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb79a7fc640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fb7a40a4ab0 0x7fb7a4139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33908/0 (socket says 172.21.15.121:33908) 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.774+0000 7fb79a7fc640 1 -- 172.21.15.121:0/1030017475 learned_addr learned my addr 172.21.15.121:0/1030017475 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a2ffd640 1 -- 172.21.15.121:0/1030017475 >> v1:172.21.15.121:6789/0 conn(0x7fb7a40a4ab0 legacy=0x7fb7a4139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a27fc640 1 -- 172.21.15.121:0/1030017475 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927923360 0 0) 0x7fb7a40a6d10 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a2ffd640 1 -- 172.21.15.121:0/1030017475 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a40a3ae0 con 0x7fb7a40a7140 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a2ffd640 1 --2- 172.21.15.121:0/1030017475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a7140 0x7fb7a40a7520 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb794009720 tx=0x7fb79402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2770863dfbb6dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a27fc640 1 -- 172.21.15.121:0/1030017475 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb794037070 con 0x7fb7a40a7140 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a27fc640 1 -- 172.21.15.121:0/1030017475 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79402ad90 con 0x7fb7a40a7140 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.775+0000 7fb7a27fc640 1 -- 172.21.15.121:0/1030017475 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb794032590 con 0x7fb7a40a7140 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 -- 172.21.15.121:0/1030017475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a7140 msgr2=0x7fb7a40a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:38.777 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/1030017475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a7140 0x7fb7a40a7520 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fb794009720 tx=0x7fb79402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:38.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 -- 172.21.15.121:0/1030017475 shutdown_connections 2024-09-15T23:57:38.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/1030017475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a7140 0x7fb7a40a7520 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:38.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 -- 172.21.15.121:0/1030017475 >> 172.21.15.121:0/1030017475 conn(0x7fb7a40ac370 msgr2=0x7fb7a40ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:38.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 -- 172.21.15.121:0/1030017475 shutdown_connections 2024-09-15T23:57:38.778 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.776+0000 7fb7a99fd640 1 -- 172.21.15.121:0/1030017475 wait complete. 2024-09-15T23:57:38.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.777+0000 7fb7a99fd640 1 Processor -- start 2024-09-15T23:57:38.779 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.777+0000 7fb7a99fd640 1 -- start start 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a99fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a99fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a40a7fc0 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47628/0 (socket says 172.21.15.121:47628) 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a2ffd640 1 -- 172.21.15.121:0/3859186204 learned_addr learned my addr 172.21.15.121:0/3859186204 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a2ffd640 1 -- 172.21.15.121:0/3859186204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a41ce480 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a2ffd640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb794009840 tx=0x7fb7940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb794041020 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79403d550 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb794037040 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a40a2930 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.780 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.778+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a40a16b0 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.779+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fb794044020 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.779+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a40a2620 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.779+0000 7fb7a0ff9640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 0x7fb78403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:38.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.779+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fb79406b8b0 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.779+0000 7fb79a7fc640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 0x7fb78403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:38.782 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.780+0000 7fb79a7fc640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 0x7fb78403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0011e0 tx=0x7fb78c007930 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:38.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.784+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb79404b030 con 0x7fb7a40a4ab0 2024-09-15T23:57:38.933 INFO:tasks.ceph.mds.b.smithi121.stderr:2024-09-15T23:57:38.933+0000 7f2524a90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:38.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:38.981+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb7a40a0af0 con 0x7fb7a40a4ab0 2024-09-15T23:57:39.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.661+0000 7fb7a0ff9640 1 -- 172.21.15.121:0/3859186204 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fb79403d870 con 0x7fb7a40a4ab0 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 msgr2=0x7fb78403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 0x7fb78403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0011e0 tx=0x7fb78c007930 comp rx=0 tx=0).stop 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 msgr2=0x7fb7a41ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fb794009840 tx=0x7fb7940046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 shutdown_connections 2024-09-15T23:57:39.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fb7840382a0 0x7fb78403a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 --2- 172.21.15.121:0/3859186204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7a40a4ab0 0x7fb7a41ceb70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 >> 172.21.15.121:0/3859186204 conn(0x7fb7a40ac370 msgr2=0x7fb7a4136190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 shutdown_connections 2024-09-15T23:57:39.667 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.664+0000 7fb7a99fd640 1 -- 172.21.15.121:0/3859186204 wait complete. 2024-09-15T23:57:39.678 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:57:39.678 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:39.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.780+0000 7f32ea503640 1 Processor -- start 2024-09-15T23:57:39.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.780+0000 7f32ea503640 1 -- start start 2024-09-15T23:57:39.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32ea503640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f32e413a280 0x7f32e413a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32ea503640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e413a080 con 0x7f32e40a4c20 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32ea503640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f32e40a3d50 con 0x7f32e413a280 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f32e413a280 0x7f32e413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e37fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f32e40a4c20 0x7f32e40a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33918/0 (socket says 172.21.15.121:33918) 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e3fff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f32e413a280 0x7f32e413a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47632/0 (socket says 172.21.15.121:47632) 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e37fe640 1 -- 172.21.15.121:0/1805757389 learned_addr learned my addr 172.21.15.121:0/1805757389 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e3fff640 1 -- 172.21.15.121:0/1805757389 >> v1:172.21.15.121:6789/0 conn(0x7f32e40a4c20 legacy=0x7f32e40a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e3fff640 1 -- 172.21.15.121:0/1805757389 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e40a3f80 con 0x7f32e413a280 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.781+0000 7f32e2ffd640 1 -- 172.21.15.121:0/1805757389 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480903720 0 0) 0x7f32e413a080 con 0x7f32e40a4c20 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.782+0000 7f32e3fff640 1 --2- 172.21.15.121:0/1805757389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e413a280 0x7f32e413a660 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009720 tx=0x7f32d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e9d76426f88ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.782+0000 7f32e2ffd640 1 -- 172.21.15.121:0/1805757389 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4037070 con 0x7f32e413a280 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.782+0000 7f32e2ffd640 1 -- 172.21.15.121:0/1805757389 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d402ad90 con 0x7f32e413a280 2024-09-15T23:57:39.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.782+0000 7f32e2ffd640 1 -- 172.21.15.121:0/1805757389 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4032590 con 0x7f32e413a280 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 -- 172.21.15.121:0/1805757389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e413a280 msgr2=0x7f32e413a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 --2- 172.21.15.121:0/1805757389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e413a280 0x7f32e413a660 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009720 tx=0x7f32d402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 -- 172.21.15.121:0/1805757389 shutdown_connections 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 --2- 172.21.15.121:0/1805757389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e413a280 0x7f32e413a660 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 -- 172.21.15.121:0/1805757389 >> 172.21.15.121:0/1805757389 conn(0x7f32e40ac3e0 msgr2=0x7f32e40ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 -- 172.21.15.121:0/1805757389 shutdown_connections 2024-09-15T23:57:39.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.783+0000 7f32ea503640 1 -- 172.21.15.121:0/1805757389 wait complete. 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32ea503640 1 Processor -- start 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32ea503640 1 -- start start 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32ea503640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32ea503640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4139d40 con 0x7f32e40a4c20 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47640/0 (socket says 172.21.15.121:47640) 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.784+0000 7f32e3fff640 1 -- 172.21.15.121:0/3075561012 learned_addr learned my addr 172.21.15.121:0/3075561012 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32e3fff640 1 -- 172.21.15.121:0/3075561012 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e4124770 con 0x7f32e40a4c20 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32e3fff640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009720 tx=0x7f32d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4041070 con 0x7f32e40a4c20 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d403c460 con 0x7f32e40a4c20 2024-09-15T23:57:39.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e4122bc0 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4037040 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.785+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e4124ec0 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.786+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f32d4044070 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.786+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e413ab20 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.786+0000 7f32e0ff9640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 0x7f32d003a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.786+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f32d406bd00 con 0x7f32e40a4c20 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.786+0000 7f32e37fe640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 0x7f32d003a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:39.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.787+0000 7f32e37fe640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 0x7f32d003a740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32d80015a0 tx=0x7f32d80079e0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:39.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.791+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32d403bdd0 con 0x7f32e40a4c20 2024-09-15T23:57:39.988 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.987+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32e406dab0 con 0x7f32e40a4c20 2024-09-15T23:57:39.989 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.988+0000 7f32e0ff9640 1 -- 172.21.15.121:0/3075561012 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7f32d403a520 con 0x7f32e40a4c20 2024-09-15T23:57:39.989 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:39.989 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:39.989 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:39.990 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.989+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 msgr2=0x7f32d003a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.989+0000 7f32ea503640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 0x7f32d003a740 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32d80015a0 tx=0x7f32d80079e0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.989+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 msgr2=0x7f32e40a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.989+0000 7f32ea503640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009720 tx=0x7f32d40046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 shutdown_connections 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f32d0038280 0x7f32d003a740 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 --2- 172.21.15.121:0/3075561012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32e40a4c20 0x7f32e40a1270 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 >> 172.21.15.121:0/3075561012 conn(0x7f32e40ac3e0 msgr2=0x7f32e4139620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 shutdown_connections 2024-09-15T23:57:39.991 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:39.990+0000 7f32ea503640 1 -- 172.21.15.121:0/3075561012 wait complete. 2024-09-15T23:57:40.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.100+0000 7f1a8ccf1640 1 Processor -- start 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.100+0000 7f1a8ccf1640 1 -- start start 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8ccf1640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a8813a280 0x7f1a8813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8ccf1640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8813a080 con 0x7f1a880a4c20 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8ccf1640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f1a880a3d50 con 0x7f1a8813a280 2024-09-15T23:57:40.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8659c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1a8813a280 0x7f1a8813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a85d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1a880a4c20 0x7f1a880a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33934/0 (socket says 172.21.15.121:33934) 2024-09-15T23:57:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a85d9b640 1 -- 172.21.15.121:0/7337808 learned_addr learned my addr 172.21.15.121:0/7337808 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8659c640 1 -- 172.21.15.121:0/7337808 >> v1:172.21.15.121:6789/0 conn(0x7f1a880a4c20 legacy=0x7f1a880a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8559a640 1 -- 172.21.15.121:0/7337808 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293748611 0 0) 0x7f1a8813a080 con 0x7f1a880a4c20 2024-09-15T23:57:40.103 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.101+0000 7f1a8659c640 1 -- 172.21.15.121:0/7337808 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a880a3f80 con 0x7f1a8813a280 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.102+0000 7f1a8659c640 1 --2- 172.21.15.121:0/7337808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a8813a280 0x7f1a8813a660 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b197862b5f77ce6e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.102+0000 7f1a8559a640 1 -- 172.21.15.121:0/7337808 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78007670 con 0x7f1a8813a280 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.102+0000 7f1a8559a640 1 -- 172.21.15.121:0/7337808 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78007810 con 0x7f1a8813a280 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.102+0000 7f1a8559a640 1 -- 172.21.15.121:0/7337808 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78007b10 con 0x7f1a8813a280 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/7337808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a8813a280 msgr2=0x7f1a8813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/7337808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a8813a280 0x7f1a8813a660 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a7802a660 comp rx=0 tx=0).stop 2024-09-15T23:57:40.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/7337808 shutdown_connections 2024-09-15T23:57:40.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/7337808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a8813a280 0x7f1a8813a660 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/7337808 >> 172.21.15.121:0/7337808 conn(0x7f1a880ac3e0 msgr2=0x7f1a880ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/7337808 shutdown_connections 2024-09-15T23:57:40.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.103+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/7337808 wait complete. 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8ccf1640 1 Processor -- start 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8ccf1640 1 -- start start 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8ccf1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8ccf1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88139d40 con 0x7f1a880a4c20 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.104+0000 7f1a8659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47652/0 (socket says 172.21.15.121:47652) 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a8659c640 1 -- 172.21.15.121:0/2099374428 learned_addr learned my addr 172.21.15.121:0/2099374428 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a8659c640 1 -- 172.21.15.121:0/2099374428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a88124770 con 0x7f1a880a4c20 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a8659c640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78040070 con 0x7f1a880a4c20 2024-09-15T23:57:40.107 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78031b10 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a78031e30 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a88122bc0 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.105+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a88124ec0 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.106+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f1a78039040 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.106+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8813ab20 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.106+0000 7f1a7effd640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 0x7f1a6803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.106+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f1a7802ae00 con 0x7f1a880a4c20 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.106+0000 7f1a85d9b640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 0x7f1a6803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.107+0000 7f1a85d9b640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 0x7f1a6803a790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a70007a40 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.111+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a7804ddf0 con 0x7f1a880a4c20 2024-09-15T23:57:40.278 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.277+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a8806dab0 con 0x7f1a880a4c20 2024-09-15T23:57:40.279 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.278+0000 7f1a7effd640 1 -- 172.21.15.121:0/2099374428 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+10678 (secure 0 0 0) 0x7f1a7803a570 con 0x7f1a880a4c20 2024-09-15T23:57:40.280 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:40.280 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":69,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:38.656845+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:35.603216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:35.960235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:40.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 msgr2=0x7f1a6803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.282 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 0x7f1a6803a790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a70000c00 tx=0x7f1a70007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 msgr2=0x7f1a880a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009d90 tx=0x7f1a78004a40 comp rx=0 tx=0).stop 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 shutdown_connections 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f1a680382d0 0x7f1a6803a790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 --2- 172.21.15.121:0/2099374428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a880a4c20 0x7f1a880a1270 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.283 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 >> 172.21.15.121:0/2099374428 conn(0x7f1a880ac3e0 msgr2=0x7f1a88139620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 shutdown_connections 2024-09-15T23:57:40.284 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.280+0000 7f1a8ccf1640 1 -- 172.21.15.121:0/2099374428 wait complete. 2024-09-15T23:57:40.293 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:57:40.294 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:40.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.391+0000 7f53e0bcd640 1 Processor -- start 2024-09-15T23:57:40.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.391+0000 7f53e0bcd640 1 -- start start 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53e0bcd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f53dc13a280 0x7f53dc13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53e0bcd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53dc13a080 con 0x7f53dc0a4c20 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53e0bcd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f53dc0a3d50 con 0x7f53dc13a280 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53da59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f53dc13a280 0x7f53dc13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53d9d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f53dc0a4c20 0x7f53dc0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33938/0 (socket says 172.21.15.121:33938) 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53d9d9b640 1 -- 172.21.15.121:0/687642364 learned_addr learned my addr 172.21.15.121:0/687642364 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:40.394 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53da59c640 1 -- 172.21.15.121:0/687642364 >> v1:172.21.15.121:6789/0 conn(0x7f53dc0a4c20 legacy=0x7f53dc0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53d959a640 1 -- 172.21.15.121:0/687642364 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655897560 0 0) 0x7f53dc13a080 con 0x7f53dc0a4c20 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.392+0000 7f53da59c640 1 -- 172.21.15.121:0/687642364 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc0a3f80 con 0x7f53dc13a280 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.393+0000 7f53da59c640 1 --2- 172.21.15.121:0/687642364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc13a280 0x7f53dc13a660 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009720 tx=0x7f53cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839a28186d163178 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.393+0000 7f53d959a640 1 -- 172.21.15.121:0/687642364 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc037070 con 0x7f53dc13a280 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.393+0000 7f53d959a640 1 -- 172.21.15.121:0/687642364 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc02ad90 con 0x7f53dc13a280 2024-09-15T23:57:40.395 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.393+0000 7f53d959a640 1 -- 172.21.15.121:0/687642364 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc032590 con 0x7f53dc13a280 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 -- 172.21.15.121:0/687642364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc13a280 msgr2=0x7f53dc13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/687642364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc13a280 0x7f53dc13a660 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009720 tx=0x7f53cc02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 -- 172.21.15.121:0/687642364 shutdown_connections 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/687642364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc13a280 0x7f53dc13a660 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 -- 172.21.15.121:0/687642364 >> 172.21.15.121:0/687642364 conn(0x7f53dc0ac3e0 msgr2=0x7f53dc0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 -- 172.21.15.121:0/687642364 shutdown_connections 2024-09-15T23:57:40.397 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.394+0000 7f53e0bcd640 1 -- 172.21.15.121:0/687642364 wait complete. 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53e0bcd640 1 Processor -- start 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53e0bcd640 1 -- start start 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53e0bcd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53e0bcd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc139d40 con 0x7f53dc0a4c20 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53da59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53da59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47678/0 (socket says 172.21.15.121:47678) 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.395+0000 7f53da59c640 1 -- 172.21.15.121:0/3378479991 learned_addr learned my addr 172.21.15.121:0/3378479991 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53da59c640 1 -- 172.21.15.121:0/3378479991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc124fa0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53da59c640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009720 tx=0x7f53cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc041070 con 0x7f53dc0a4c20 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc03c460 con 0x7f53dc0a4c20 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc037040 con 0x7f53dc0a4c20 2024-09-15T23:57:40.398 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc137fd0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.396+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1228e0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f53cc044070 con 0x7f53dc0a4c20 2024-09-15T23:57:40.399 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc06dab0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53caffd640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 0x7f53bc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f53cc06bca0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53d9d9b640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 0x7f53bc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.400 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.397+0000 7f53d9d9b640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 0x7f53bc03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0007a40 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.402 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.402+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53cc03bdd0 con 0x7f53dc0a4c20 2024-09-15T23:57:40.565 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.565+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 --> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53dc138520 con 0x7f53bc0382a0 2024-09-15T23:57:40.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.571+0000 7f53caffd640 1 -- 172.21.15.121:0/3378479991 <== mgr.4913 v2:172.21.15.121:6828/229629035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246019 (secure 0 0 0) 0x7f53d00070d0 con 0x7f53bc0382a0 2024-09-15T23:57:40.574 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:40.576 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 msgr2=0x7f53bc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 0x7f53bc03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53d0000c00 tx=0x7f53d0007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 msgr2=0x7f53dc0a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009720 tx=0x7f53cc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 shutdown_connections 2024-09-15T23:57:40.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f53bc0382a0 0x7f53bc03a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 --2- 172.21.15.121:0/3378479991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53dc0a4c20 0x7f53dc0a1020 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 >> 172.21.15.121:0/3378479991 conn(0x7f53dc0ac3e0 msgr2=0x7f53dc0aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 shutdown_connections 2024-09-15T23:57:40.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.574+0000 7f53e0bcd640 1 -- 172.21.15.121:0/3378479991 wait complete. 2024-09-15T23:57:40.585 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-15T23:57:39.197853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":281,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":96580,"kb_used_data":3004,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018940,"statfs":{"total":289910292480,"available":289811394560,"internally_reserved":0,"allocated":3076096,"data_stored":1925574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000677"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678692+0000","last_change":"2024-09-15T23:57:37.675049+0000","last_active":"2024-09-15T23:57:37.678692+0000","last_peered":"2024-09-15T23:57:37.678692+0000","last_clean":"2024-09-15T23:57:37.678692+0000","last_became_active":"2024-09-15T23:57:37.674772+0000","last_became_peered":"2024-09-15T23:57:37.674772+0000","last_unstale":"2024-09-15T23:57:37.678692+0000","last_undegraded":"2024-09-15T23:57:37.678692+0000","last_fullsized":"2024-09-15T23:57:37.678692+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:49.770951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678512+0000","last_change":"2024-09-15T23:57:37.673353+0000","last_active":"2024-09-15T23:57:37.678512+0000","last_peered":"2024-09-15T23:57:37.678512+0000","last_clean":"2024-09-15T23:57:37.678512+0000","last_became_active":"2024-09-15T23:57:37.673038+0000","last_became_peered":"2024-09-15T23:57:37.673038+0000","last_unstale":"2024-09-15T23:57:37.678512+0000","last_undegraded":"2024-09-15T23:57:37.678512+0000","last_fullsized":"2024-09-15T23:57:37.678512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:17.824311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686560+0000","last_change":"2024-09-15T23:57:37.684703+0000","last_active":"2024-09-15T23:57:37.686560+0000","last_peered":"2024-09-15T23:57:37.686560+0000","last_clean":"2024-09-15T23:57:37.686560+0000","last_became_active":"2024-09-15T23:57:37.684443+0000","last_became_peered":"2024-09-15T23:57:37.684443+0000","last_unstale":"2024-09-15T23:57:37.686560+0000","last_undegraded":"2024-09-15T23:57:37.686560+0000","last_fullsized":"2024-09-15T23:57:37.686560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:15.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686243+0000","last_change":"2024-09-15T23:57:37.683290+0000","last_active":"2024-09-15T23:57:37.686243+0000","last_peered":"2024-09-15T23:57:37.686243+0000","last_clean":"2024-09-15T23:57:37.686243+0000","last_became_active":"2024-09-15T23:57:37.683031+0000","last_became_peered":"2024-09-15T23:57:37.683031+0000","last_unstale":"2024-09-15T23:57:37.686243+0000","last_undegraded":"2024-09-15T23:57:37.686243+0000","last_fullsized":"2024-09-15T23:57:37.686243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:03.016860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.677813+0000","last_change":"2024-09-15T23:57:37.674517+0000","last_active":"2024-09-15T23:57:37.677813+0000","last_peered":"2024-09-15T23:57:37.677813+0000","last_clean":"2024-09-15T23:57:37.677813+0000","last_became_active":"2024-09-15T23:57:37.674235+0000","last_became_peered":"2024-09-15T23:57:37.674235+0000","last_unstale":"2024-09-15T23:57:37.677813+0000","last_undegraded":"2024-09-15T23:57:37.677813+0000","last_fullsized":"2024-09-15T23:57:37.677813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:36.797653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694412+0000","last_change":"2024-09-15T23:57:37.691334+0000","last_active":"2024-09-15T23:57:37.694412+0000","last_peered":"2024-09-15T23:57:37.694412+0000","last_clean":"2024-09-15T23:57:37.694412+0000","last_became_active":"2024-09-15T23:57:37.691068+0000","last_became_peered":"2024-09-15T23:57:37.691068+0000","last_unstale":"2024-09-15T23:57:37.694412+0000","last_undegraded":"2024-09-15T23:57:37.694412+0000","last_fullsized":"2024-09-15T23:57:37.694412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:45.183502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686391+0000","last_change":"2024-09-15T23:57:37.682695+0000","last_active":"2024-09-15T23:57:37.686391+0000","last_peered":"2024-09-15T23:57:37.686391+0000","last_clean":"2024-09-15T23:57:37.686391+0000","last_became_active":"2024-09-15T23:57:37.682107+0000","last_became_peered":"2024-09-15T23:57:37.682107+0000","last_unstale":"2024-09-15T23:57:37.686391+0000","last_undegraded":"2024-09-15T23:57:37.686391+0000","last_fullsized":"2024-09-15T23:57:37.686391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:53.520321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692413+0000","last_change":"2024-09-15T23:57:37.679275+0000","last_active":"2024-09-15T23:57:37.692413+0000","last_peered":"2024-09-15T23:57:37.692413+0000","last_clean":"2024-09-15T23:57:37.692413+0000","last_became_active":"2024-09-15T23:57:37.678974+0000","last_became_peered":"2024-09-15T23:57:37.678974+0000","last_unstale":"2024-09-15T23:57:37.692413+0000","last_undegraded":"2024-09-15T23:57:37.692413+0000","last_fullsized":"2024-09-15T23:57:37.692413+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:00.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.688747+0000","last_change":"2024-09-15T23:57:37.681497+0000","last_active":"2024-09-15T23:57:37.688747+0000","last_peered":"2024-09-15T23:57:37.688747+0000","last_clean":"2024-09-15T23:57:37.688747+0000","last_became_active":"2024-09-15T23:57:37.681093+0000","last_became_peered":"2024-09-15T23:57:37.681093+0000","last_unstale":"2024-09-15T23:57:37.688747+0000","last_undegraded":"2024-09-15T23:57:37.688747+0000","last_fullsized":"2024-09-15T23:57:37.688747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:25.547635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685500+0000","last_change":"2024-09-15T23:57:37.679974+0000","last_active":"2024-09-15T23:57:37.685500+0000","last_peered":"2024-09-15T23:57:37.685500+0000","last_clean":"2024-09-15T23:57:37.685500+0000","last_became_active":"2024-09-15T23:57:37.679697+0000","last_became_peered":"2024-09-15T23:57:37.679697+0000","last_unstale":"2024-09-15T23:57:37.685500+0000","last_undegraded":"2024-09-15T23:57:37.685500+0000","last_fullsized":"2024-09-15T23:57:37.685500+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:54.917911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678986+0000","last_change":"2024-09-15T23:57:37.675323+0000","last_active":"2024-09-15T23:57:37.678986+0000","last_peered":"2024-09-15T23:57:37.678986+0000","last_clean":"2024-09-15T23:57:37.678986+0000","last_became_active":"2024-09-15T23:57:37.673505+0000","last_became_peered":"2024-09-15T23:57:37.673505+0000","last_unstale":"2024-09-15T23:57:37.678986+0000","last_undegraded":"2024-09-15T23:57:37.678986+0000","last_fullsized":"2024-09-15T23:57:37.678986+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:46.486659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686169+0000","last_change":"2024-09-15T23:57:37.680265+0000","last_active":"2024-09-15T23:57:37.686169+0000","last_peered":"2024-09-15T23:57:37.686169+0000","last_clean":"2024-09-15T23:57:37.686169+0000","last_became_active":"2024-09-15T23:57:37.679584+0000","last_became_peered":"2024-09-15T23:57:37.679584+0000","last_unstale":"2024-09-15T23:57:37.686169+0000","last_undegraded":"2024-09-15T23:57:37.686169+0000","last_fullsized":"2024-09-15T23:57:37.686169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:33.110761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.680832+0000","last_change":"2024-09-15T23:57:37.676879+0000","last_active":"2024-09-15T23:57:37.680832+0000","last_peered":"2024-09-15T23:57:37.680832+0000","last_clean":"2024-09-15T23:57:37.680832+0000","last_became_active":"2024-09-15T23:57:37.676612+0000","last_became_peered":"2024-09-15T23:57:37.676612+0000","last_unstale":"2024-09-15T23:57:37.680832+0000","last_undegraded":"2024-09-15T23:57:37.680832+0000","last_fullsized":"2024-09-15T23:57:37.680832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:23.989024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686443+0000","last_change":"2024-09-15T23:57:37.684893+0000","last_active":"2024-09-15T23:57:37.686443+0000","last_peered":"2024-09-15T23:57:37.686443+0000","last_clean":"2024-09-15T23:57:37.686443+0000","last_became_active":"2024-09-15T23:57:37.683616+0000","last_became_peered":"2024-09-15T23:57:37.683616+0000","last_unstale":"2024-09-15T23:57:37.686443+0000","last_undegraded":"2024-09-15T23:57:37.686443+0000","last_fullsized":"2024-09-15T23:57:37.686443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:07.257234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686562+0000","last_change":"2024-09-15T23:57:37.681205+0000","last_active":"2024-09-15T23:57:37.686562+0000","last_peered":"2024-09-15T23:57:37.686562+0000","last_clean":"2024-09-15T23:57:37.686562+0000","last_became_active":"2024-09-15T23:57:37.680639+0000","last_became_peered":"2024-09-15T23:57:37.680639+0000","last_unstale":"2024-09-15T23:57:37.686562+0000","last_undegraded":"2024-09-15T23:57:37.686562+0000","last_fullsized":"2024-09-15T23:57:37.686562+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:27.354962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692273+0000","last_change":"2024-09-15T23:57:37.687348+0000","last_active":"2024-09-15T23:57:37.692273+0000","last_peered":"2024-09-15T23:57:37.692273+0000","last_clean":"2024-09-15T23:57:37.692273+0000","last_became_active":"2024-09-15T23:57:37.686879+0000","last_became_peered":"2024-09-15T23:57:37.686879+0000","last_unstale":"2024-09-15T23:57:37.692273+0000","last_undegraded":"2024-09-15T23:57:37.692273+0000","last_fullsized":"2024-09-15T23:57:37.692273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:07.885927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686498+0000","last_change":"2024-09-15T23:57:37.678104+0000","last_active":"2024-09-15T23:57:37.686498+0000","last_peered":"2024-09-15T23:57:37.686498+0000","last_clean":"2024-09-15T23:57:37.686498+0000","last_became_active":"2024-09-15T23:57:37.675742+0000","last_became_peered":"2024-09-15T23:57:37.675742+0000","last_unstale":"2024-09-15T23:57:37.686498+0000","last_undegraded":"2024-09-15T23:57:37.686498+0000","last_fullsized":"2024-09-15T23:57:37.686498+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:28.122756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686355+0000","last_change":"2024-09-15T23:57:37.683369+0000","last_active":"2024-09-15T23:57:37.686355+0000","last_peered":"2024-09-15T23:57:37.686355+0000","last_clean":"2024-09-15T23:57:37.686355+0000","last_became_active":"2024-09-15T23:57:37.683097+0000","last_became_peered":"2024-09-15T23:57:37.683097+0000","last_unstale":"2024-09-15T23:57:37.686355+0000","last_undegraded":"2024-09-15T23:57:37.686355+0000","last_fullsized":"2024-09-15T23:57:37.686355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:52.477477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670029+0000","last_change":"2024-09-15T23:57:37.667773+0000","last_active":"2024-09-15T23:57:37.670029+0000","last_peered":"2024-09-15T23:57:37.670029+0000","last_clean":"2024-09-15T23:57:37.670029+0000","last_became_active":"2024-09-15T23:57:37.667321+0000","last_became_peered":"2024-09-15T23:57:37.667321+0000","last_unstale":"2024-09-15T23:57:37.670029+0000","last_undegraded":"2024-09-15T23:57:37.670029+0000","last_fullsized":"2024-09-15T23:57:37.670029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:49.612938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694363+0000","last_change":"2024-09-15T23:57:37.691321+0000","last_active":"2024-09-15T23:57:37.694363+0000","last_peered":"2024-09-15T23:57:37.694363+0000","last_clean":"2024-09-15T23:57:37.694363+0000","last_became_active":"2024-09-15T23:57:37.691053+0000","last_became_peered":"2024-09-15T23:57:37.691053+0000","last_unstale":"2024-09-15T23:57:37.694363+0000","last_undegraded":"2024-09-15T23:57:37.694363+0000","last_fullsized":"2024-09-15T23:57:37.694363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:57.503139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686408+0000","last_change":"2024-09-15T23:57:37.682579+0000","last_active":"2024-09-15T23:57:37.686408+0000","last_peered":"2024-09-15T23:57:37.686408+0000","last_clean":"2024-09-15T23:57:37.686408+0000","last_became_active":"2024-09-15T23:57:37.682321+0000","last_became_peered":"2024-09-15T23:57:37.682321+0000","last_unstale":"2024-09-15T23:57:37.686408+0000","last_undegraded":"2024-09-15T23:57:37.686408+0000","last_fullsized":"2024-09-15T23:57:37.686408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.227921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669470+0000","last_change":"2024-09-15T23:57:37.667440+0000","last_active":"2024-09-15T23:57:37.669470+0000","last_peered":"2024-09-15T23:57:37.669470+0000","last_clean":"2024-09-15T23:57:37.669470+0000","last_became_active":"2024-09-15T23:57:37.667187+0000","last_became_peered":"2024-09-15T23:57:37.667187+0000","last_unstale":"2024-09-15T23:57:37.669470+0000","last_undegraded":"2024-09-15T23:57:37.669470+0000","last_fullsized":"2024-09-15T23:57:37.669470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:57.529659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685954+0000","last_change":"2024-09-15T23:57:37.678434+0000","last_active":"2024-09-15T23:57:37.685954+0000","last_peered":"2024-09-15T23:57:37.685954+0000","last_clean":"2024-09-15T23:57:37.685954+0000","last_became_active":"2024-09-15T23:57:37.678162+0000","last_became_peered":"2024-09-15T23:57:37.678162+0000","last_unstale":"2024-09-15T23:57:37.685954+0000","last_undegraded":"2024-09-15T23:57:37.685954+0000","last_fullsized":"2024-09-15T23:57:37.685954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:12.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692252+0000","last_change":"2024-09-15T23:57:37.687148+0000","last_active":"2024-09-15T23:57:37.692252+0000","last_peered":"2024-09-15T23:57:37.692252+0000","last_clean":"2024-09-15T23:57:37.692252+0000","last_became_active":"2024-09-15T23:57:37.686870+0000","last_became_peered":"2024-09-15T23:57:37.686870+0000","last_unstale":"2024-09-15T23:57:37.692252+0000","last_undegraded":"2024-09-15T23:57:37.692252+0000","last_fullsized":"2024-09-15T23:57:37.692252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:16.733596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.688082+0000","last_change":"2024-09-15T23:57:37.682184+0000","last_active":"2024-09-15T23:57:37.688082+0000","last_peered":"2024-09-15T23:57:37.688082+0000","last_clean":"2024-09-15T23:57:37.688082+0000","last_became_active":"2024-09-15T23:57:37.681934+0000","last_became_peered":"2024-09-15T23:57:37.681934+0000","last_unstale":"2024-09-15T23:57:37.688082+0000","last_undegraded":"2024-09-15T23:57:37.688082+0000","last_fullsized":"2024-09-15T23:57:37.688082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:43.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669575+0000","last_change":"2024-09-15T23:57:37.666789+0000","last_active":"2024-09-15T23:57:37.669575+0000","last_peered":"2024-09-15T23:57:37.669575+0000","last_clean":"2024-09-15T23:57:37.669575+0000","last_became_active":"2024-09-15T23:57:37.666505+0000","last_became_peered":"2024-09-15T23:57:37.666505+0000","last_unstale":"2024-09-15T23:57:37.669575+0000","last_undegraded":"2024-09-15T23:57:37.669575+0000","last_fullsized":"2024-09-15T23:57:37.669575+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:52.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695165+0000","last_change":"2024-09-15T23:57:37.691974+0000","last_active":"2024-09-15T23:57:37.695165+0000","last_peered":"2024-09-15T23:57:37.695165+0000","last_clean":"2024-09-15T23:57:37.695165+0000","last_became_active":"2024-09-15T23:57:37.691716+0000","last_became_peered":"2024-09-15T23:57:37.691716+0000","last_unstale":"2024-09-15T23:57:37.695165+0000","last_undegraded":"2024-09-15T23:57:37.695165+0000","last_fullsized":"2024-09-15T23:57:37.695165+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:41.143930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678634+0000","last_change":"2024-09-15T23:57:37.674511+0000","last_active":"2024-09-15T23:57:37.678634+0000","last_peered":"2024-09-15T23:57:37.678634+0000","last_clean":"2024-09-15T23:57:37.678634+0000","last_became_active":"2024-09-15T23:57:37.674231+0000","last_became_peered":"2024-09-15T23:57:37.674231+0000","last_unstale":"2024-09-15T23:57:37.678634+0000","last_undegraded":"2024-09-15T23:57:37.678634+0000","last_fullsized":"2024-09-15T23:57:37.678634+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:08.770005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686613+0000","last_change":"2024-09-15T23:57:37.681022+0000","last_active":"2024-09-15T23:57:37.686613+0000","last_peered":"2024-09-15T23:57:37.686613+0000","last_clean":"2024-09-15T23:57:37.686613+0000","last_became_active":"2024-09-15T23:57:37.680574+0000","last_became_peered":"2024-09-15T23:57:37.680574+0000","last_unstale":"2024-09-15T23:57:37.686613+0000","last_undegraded":"2024-09-15T23:57:37.686613+0000","last_fullsized":"2024-09-15T23:57:37.686613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:00.868857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679825+0000","last_change":"2024-09-15T23:57:37.673995+0000","last_active":"2024-09-15T23:57:37.679825+0000","last_peered":"2024-09-15T23:57:37.679825+0000","last_clean":"2024-09-15T23:57:37.679825+0000","last_became_active":"2024-09-15T23:57:37.673709+0000","last_became_peered":"2024-09-15T23:57:37.673709+0000","last_unstale":"2024-09-15T23:57:37.679825+0000","last_undegraded":"2024-09-15T23:57:37.679825+0000","last_fullsized":"2024-09-15T23:57:37.679825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:59.950688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686410+0000","last_change":"2024-09-15T23:57:37.682932+0000","last_active":"2024-09-15T23:57:37.686410+0000","last_peered":"2024-09-15T23:57:37.686410+0000","last_clean":"2024-09-15T23:57:37.686410+0000","last_became_active":"2024-09-15T23:57:37.682438+0000","last_became_peered":"2024-09-15T23:57:37.682438+0000","last_unstale":"2024-09-15T23:57:37.686410+0000","last_undegraded":"2024-09-15T23:57:37.686410+0000","last_fullsized":"2024-09-15T23:57:37.686410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.322039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686316+0000","last_change":"2024-09-15T23:57:37.684092+0000","last_active":"2024-09-15T23:57:37.686316+0000","last_peered":"2024-09-15T23:57:37.686316+0000","last_clean":"2024-09-15T23:57:37.686316+0000","last_became_active":"2024-09-15T23:57:37.683842+0000","last_became_peered":"2024-09-15T23:57:37.683842+0000","last_unstale":"2024-09-15T23:57:37.686316+0000","last_undegraded":"2024-09-15T23:57:37.686316+0000","last_fullsized":"2024-09-15T23:57:37.686316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:35.413092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.681634+0000","last_change":"2024-09-15T23:57:37.676646+0000","last_active":"2024-09-15T23:57:37.681634+0000","last_peered":"2024-09-15T23:57:37.681634+0000","last_clean":"2024-09-15T23:57:37.681634+0000","last_became_active":"2024-09-15T23:57:37.676385+0000","last_became_peered":"2024-09-15T23:57:37.676385+0000","last_unstale":"2024-09-15T23:57:37.681634+0000","last_undegraded":"2024-09-15T23:57:37.681634+0000","last_fullsized":"2024-09-15T23:57:37.681634+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.362036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695856+0000","last_change":"2024-09-15T23:57:36.664173+0000","last_active":"2024-09-15T23:57:37.695856+0000","last_peered":"2024-09-15T23:57:37.695856+0000","last_clean":"2024-09-15T23:57:37.695856+0000","last_became_active":"2024-09-15T23:57:36.663920+0000","last_became_peered":"2024-09-15T23:57:36.663920+0000","last_unstale":"2024-09-15T23:57:37.695856+0000","last_undegraded":"2024-09-15T23:57:37.695856+0000","last_fullsized":"2024-09-15T23:57:37.695856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:07.880018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678673+0000","last_change":"2024-09-15T23:57:37.674684+0000","last_active":"2024-09-15T23:57:37.678673+0000","last_peered":"2024-09-15T23:57:37.678673+0000","last_clean":"2024-09-15T23:57:37.678673+0000","last_became_active":"2024-09-15T23:57:37.673776+0000","last_became_peered":"2024-09-15T23:57:37.673776+0000","last_unstale":"2024-09-15T23:57:37.678673+0000","last_undegraded":"2024-09-15T23:57:37.678673+0000","last_fullsized":"2024-09-15T23:57:37.678673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:40.953582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.683037+0000","last_change":"2024-09-15T23:57:36.666293+0000","last_active":"2024-09-15T23:57:37.683037+0000","last_peered":"2024-09-15T23:57:37.683037+0000","last_clean":"2024-09-15T23:57:37.683037+0000","last_became_active":"2024-09-15T23:57:36.666024+0000","last_became_peered":"2024-09-15T23:57:36.666024+0000","last_unstale":"2024-09-15T23:57:37.683037+0000","last_undegraded":"2024-09-15T23:57:37.683037+0000","last_fullsized":"2024-09-15T23:57:37.683037+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:43.016883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686150+0000","last_change":"2024-09-15T23:57:37.680060+0000","last_active":"2024-09-15T23:57:37.686150+0000","last_peered":"2024-09-15T23:57:37.686150+0000","last_clean":"2024-09-15T23:57:37.686150+0000","last_became_active":"2024-09-15T23:57:37.679238+0000","last_became_peered":"2024-09-15T23:57:37.679238+0000","last_unstale":"2024-09-15T23:57:37.686150+0000","last_undegraded":"2024-09-15T23:57:37.686150+0000","last_fullsized":"2024-09-15T23:57:37.686150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:59.095376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695618+0000","last_change":"2024-09-15T23:57:36.672075+0000","last_active":"2024-09-15T23:57:37.695618+0000","last_peered":"2024-09-15T23:57:37.695618+0000","last_clean":"2024-09-15T23:57:37.695618+0000","last_became_active":"2024-09-15T23:57:36.671830+0000","last_became_peered":"2024-09-15T23:57:36.671830+0000","last_unstale":"2024-09-15T23:57:37.695618+0000","last_undegraded":"2024-09-15T23:57:37.695618+0000","last_fullsized":"2024-09-15T23:57:37.695618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:00.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678577+0000","last_change":"2024-09-15T23:57:37.673978+0000","last_active":"2024-09-15T23:57:37.678577+0000","last_peered":"2024-09-15T23:57:37.678577+0000","last_clean":"2024-09-15T23:57:37.678577+0000","last_became_active":"2024-09-15T23:57:37.673681+0000","last_became_peered":"2024-09-15T23:57:37.673681+0000","last_unstale":"2024-09-15T23:57:37.678577+0000","last_undegraded":"2024-09-15T23:57:37.678577+0000","last_fullsized":"2024-09-15T23:57:37.678577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:25.733040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695573+0000","last_change":"2024-09-15T23:57:36.671969+0000","last_active":"2024-09-15T23:57:37.695573+0000","last_peered":"2024-09-15T23:57:37.695573+0000","last_clean":"2024-09-15T23:57:37.695573+0000","last_became_active":"2024-09-15T23:57:36.670902+0000","last_became_peered":"2024-09-15T23:57:36.670902+0000","last_unstale":"2024-09-15T23:57:37.695573+0000","last_undegraded":"2024-09-15T23:57:37.695573+0000","last_fullsized":"2024-09-15T23:57:37.695573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:03.527190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679796+0000","last_change":"2024-09-15T23:57:37.673729+0000","last_active":"2024-09-15T23:57:37.679796+0000","last_peered":"2024-09-15T23:57:37.679796+0000","last_clean":"2024-09-15T23:57:37.679796+0000","last_became_active":"2024-09-15T23:57:37.673437+0000","last_became_peered":"2024-09-15T23:57:37.673437+0000","last_unstale":"2024-09-15T23:57:37.679796+0000","last_undegraded":"2024-09-15T23:57:37.679796+0000","last_fullsized":"2024-09-15T23:57:37.679796+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:14.859034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694894+0000","last_change":"2024-09-15T23:57:36.669877+0000","last_active":"2024-09-15T23:57:37.694894+0000","last_peered":"2024-09-15T23:57:37.694894+0000","last_clean":"2024-09-15T23:57:37.694894+0000","last_became_active":"2024-09-15T23:57:36.669618+0000","last_became_peered":"2024-09-15T23:57:36.669618+0000","last_unstale":"2024-09-15T23:57:37.694894+0000","last_undegraded":"2024-09-15T23:57:37.694894+0000","last_fullsized":"2024-09-15T23:57:37.694894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:49.837179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692234+0000","last_change":"2024-09-15T23:57:37.687174+0000","last_active":"2024-09-15T23:57:37.692234+0000","last_peered":"2024-09-15T23:57:37.692234+0000","last_clean":"2024-09-15T23:57:37.692234+0000","last_became_active":"2024-09-15T23:57:37.686841+0000","last_became_peered":"2024-09-15T23:57:37.686841+0000","last_unstale":"2024-09-15T23:57:37.692234+0000","last_undegraded":"2024-09-15T23:57:37.692234+0000","last_fullsized":"2024-09-15T23:57:37.692234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:44.939545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.691984+0000","last_change":"2024-09-15T23:57:36.673943+0000","last_active":"2024-09-15T23:57:37.691984+0000","last_peered":"2024-09-15T23:57:37.691984+0000","last_clean":"2024-09-15T23:57:37.691984+0000","last_became_active":"2024-09-15T23:57:36.673521+0000","last_became_peered":"2024-09-15T23:57:36.673521+0000","last_unstale":"2024-09-15T23:57:37.691984+0000","last_undegraded":"2024-09-15T23:57:37.691984+0000","last_fullsized":"2024-09-15T23:57:37.691984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:17.037082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.687910+0000","last_change":"2024-09-15T23:57:37.682389+0000","last_active":"2024-09-15T23:57:37.687910+0000","last_peered":"2024-09-15T23:57:37.687910+0000","last_clean":"2024-09-15T23:57:37.687910+0000","last_became_active":"2024-09-15T23:57:37.681750+0000","last_became_peered":"2024-09-15T23:57:37.681750+0000","last_unstale":"2024-09-15T23:57:37.687910+0000","last_undegraded":"2024-09-15T23:57:37.687910+0000","last_fullsized":"2024-09-15T23:57:37.687910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:57.119121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.663821+0000","last_change":"2024-09-15T23:57:36.671769+0000","last_active":"2024-09-15T23:57:37.663821+0000","last_peered":"2024-09-15T23:57:37.663821+0000","last_clean":"2024-09-15T23:57:37.663821+0000","last_became_active":"2024-09-15T23:57:36.671493+0000","last_became_peered":"2024-09-15T23:57:36.671493+0000","last_unstale":"2024-09-15T23:57:37.663821+0000","last_undegraded":"2024-09-15T23:57:37.663821+0000","last_fullsized":"2024-09-15T23:57:37.663821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:21.391036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.683512+0000","last_change":"2024-09-15T23:57:37.674738+0000","last_active":"2024-09-15T23:57:37.683512+0000","last_peered":"2024-09-15T23:57:37.683512+0000","last_clean":"2024-09-15T23:57:37.683512+0000","last_became_active":"2024-09-15T23:57:37.674476+0000","last_became_peered":"2024-09-15T23:57:37.674476+0000","last_unstale":"2024-09-15T23:57:37.683512+0000","last_undegraded":"2024-09-15T23:57:37.683512+0000","last_fullsized":"2024-09-15T23:57:37.683512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:04.178390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.653718+0000","last_change":"2024-09-15T23:57:36.666589+0000","last_active":"2024-09-15T23:57:37.653718+0000","last_peered":"2024-09-15T23:57:37.653718+0000","last_clean":"2024-09-15T23:57:37.653718+0000","last_became_active":"2024-09-15T23:57:36.664502+0000","last_became_peered":"2024-09-15T23:57:36.664502+0000","last_unstale":"2024-09-15T23:57:37.653718+0000","last_undegraded":"2024-09-15T23:57:37.653718+0000","last_fullsized":"2024-09-15T23:57:37.653718+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:16.305549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685807+0000","last_change":"2024-09-15T23:57:37.679510+0000","last_active":"2024-09-15T23:57:37.685807+0000","last_peered":"2024-09-15T23:57:37.685807+0000","last_clean":"2024-09-15T23:57:37.685807+0000","last_became_active":"2024-09-15T23:57:37.679096+0000","last_became_peered":"2024-09-15T23:57:37.679096+0000","last_unstale":"2024-09-15T23:57:37.685807+0000","last_undegraded":"2024-09-15T23:57:37.685807+0000","last_fullsized":"2024-09-15T23:57:37.685807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:22.349136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.655941+0000","last_change":"2024-09-15T23:57:36.667078+0000","last_active":"2024-09-15T23:57:37.655941+0000","last_peered":"2024-09-15T23:57:37.655941+0000","last_clean":"2024-09-15T23:57:37.655941+0000","last_became_active":"2024-09-15T23:57:36.666364+0000","last_became_peered":"2024-09-15T23:57:36.666364+0000","last_unstale":"2024-09-15T23:57:37.655941+0000","last_undegraded":"2024-09-15T23:57:37.655941+0000","last_fullsized":"2024-09-15T23:57:37.655941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:01.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678653+0000","last_change":"2024-09-15T23:57:37.674439+0000","last_active":"2024-09-15T23:57:37.678653+0000","last_peered":"2024-09-15T23:57:37.678653+0000","last_clean":"2024-09-15T23:57:37.678653+0000","last_became_active":"2024-09-15T23:57:37.673615+0000","last_became_peered":"2024-09-15T23:57:37.673615+0000","last_unstale":"2024-09-15T23:57:37.678653+0000","last_undegraded":"2024-09-15T23:57:37.678653+0000","last_fullsized":"2024-09-15T23:57:37.678653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:43.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665237+0000","last_change":"2024-09-15T23:57:36.673818+0000","last_active":"2024-09-15T23:57:37.665237+0000","last_peered":"2024-09-15T23:57:37.665237+0000","last_clean":"2024-09-15T23:57:37.665237+0000","last_became_active":"2024-09-15T23:57:36.673510+0000","last_became_peered":"2024-09-15T23:57:36.673510+0000","last_unstale":"2024-09-15T23:57:37.665237+0000","last_undegraded":"2024-09-15T23:57:37.665237+0000","last_fullsized":"2024-09-15T23:57:37.665237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:28.698279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690654+0000","last_change":"2024-09-15T23:57:37.680902+0000","last_active":"2024-09-15T23:57:37.690654+0000","last_peered":"2024-09-15T23:57:37.690654+0000","last_clean":"2024-09-15T23:57:37.690654+0000","last_became_active":"2024-09-15T23:57:37.679061+0000","last_became_peered":"2024-09-15T23:57:37.679061+0000","last_unstale":"2024-09-15T23:57:37.690654+0000","last_undegraded":"2024-09-15T23:57:37.690654+0000","last_fullsized":"2024-09-15T23:57:37.690654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:46.000532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690136+0000","last_change":"2024-09-15T23:57:36.665589+0000","last_active":"2024-09-15T23:57:37.690136+0000","last_peered":"2024-09-15T23:57:37.690136+0000","last_clean":"2024-09-15T23:57:37.690136+0000","last_became_active":"2024-09-15T23:57:36.664609+0000","last_became_peered":"2024-09-15T23:57:36.664609+0000","last_unstale":"2024-09-15T23:57:37.690136+0000","last_undegraded":"2024-09-15T23:57:37.690136+0000","last_fullsized":"2024-09-15T23:57:37.690136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:23.440586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692328+0000","last_change":"2024-09-15T23:57:37.688460+0000","last_active":"2024-09-15T23:57:37.692328+0000","last_peered":"2024-09-15T23:57:37.692328+0000","last_clean":"2024-09-15T23:57:37.692328+0000","last_became_active":"2024-09-15T23:57:37.688078+0000","last_became_peered":"2024-09-15T23:57:37.688078+0000","last_unstale":"2024-09-15T23:57:37.692328+0000","last_undegraded":"2024-09-15T23:57:37.692328+0000","last_fullsized":"2024-09-15T23:57:37.692328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:21.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"68'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.701777+0000","last_change":"2024-09-15T23:57:36.671808+0000","last_active":"2024-09-15T23:57:37.701777+0000","last_peered":"2024-09-15T23:57:37.701777+0000","last_clean":"2024-09-15T23:57:37.701777+0000","last_became_active":"2024-09-15T23:57:36.670946+0000","last_became_peered":"2024-09-15T23:57:36.670946+0000","last_unstale":"2024-09-15T23:57:37.701777+0000","last_undegraded":"2024-09-15T23:57:37.701777+0000","last_fullsized":"2024-09-15T23:57:37.701777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:13.942806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669995+0000","last_change":"2024-09-15T23:57:37.668598+0000","last_active":"2024-09-15T23:57:37.669995+0000","last_peered":"2024-09-15T23:57:37.669995+0000","last_clean":"2024-09-15T23:57:37.669995+0000","last_became_active":"2024-09-15T23:57:37.668343+0000","last_became_peered":"2024-09-15T23:57:37.668343+0000","last_unstale":"2024-09-15T23:57:37.669995+0000","last_undegraded":"2024-09-15T23:57:37.669995+0000","last_fullsized":"2024-09-15T23:57:37.669995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:00.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690535+0000","last_change":"2024-09-15T23:57:36.663780+0000","last_active":"2024-09-15T23:57:37.690535+0000","last_peered":"2024-09-15T23:57:37.690535+0000","last_clean":"2024-09-15T23:57:37.690535+0000","last_became_active":"2024-09-15T23:57:36.663517+0000","last_became_peered":"2024-09-15T23:57:36.663517+0000","last_unstale":"2024-09-15T23:57:37.690535+0000","last_undegraded":"2024-09-15T23:57:37.690535+0000","last_fullsized":"2024-09-15T23:57:37.690535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:22.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686592+0000","last_change":"2024-09-15T23:57:37.680896+0000","last_active":"2024-09-15T23:57:37.686592+0000","last_peered":"2024-09-15T23:57:37.686592+0000","last_clean":"2024-09-15T23:57:37.686592+0000","last_became_active":"2024-09-15T23:57:37.680622+0000","last_became_peered":"2024-09-15T23:57:37.680622+0000","last_unstale":"2024-09-15T23:57:37.686592+0000","last_undegraded":"2024-09-15T23:57:37.686592+0000","last_fullsized":"2024-09-15T23:57:37.686592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:50.779635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662518+0000","last_change":"2024-09-15T23:57:36.667866+0000","last_active":"2024-09-15T23:57:37.662518+0000","last_peered":"2024-09-15T23:57:37.662518+0000","last_clean":"2024-09-15T23:57:37.662518+0000","last_became_active":"2024-09-15T23:57:36.667547+0000","last_became_peered":"2024-09-15T23:57:36.667547+0000","last_unstale":"2024-09-15T23:57:37.662518+0000","last_undegraded":"2024-09-15T23:57:37.662518+0000","last_fullsized":"2024-09-15T23:57:37.662518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:54.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678442+0000","last_change":"2024-09-15T23:57:37.674206+0000","last_active":"2024-09-15T23:57:37.678442+0000","last_peered":"2024-09-15T23:57:37.678442+0000","last_clean":"2024-09-15T23:57:37.678442+0000","last_became_active":"2024-09-15T23:57:37.673776+0000","last_became_peered":"2024-09-15T23:57:37.673776+0000","last_unstale":"2024-09-15T23:57:37.678442+0000","last_undegraded":"2024-09-15T23:57:37.678442+0000","last_fullsized":"2024-09-15T23:57:37.678442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:44.580922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665228+0000","last_change":"2024-09-15T23:57:36.667440+0000","last_active":"2024-09-15T23:57:37.665228+0000","last_peered":"2024-09-15T23:57:37.665228+0000","last_clean":"2024-09-15T23:57:37.665228+0000","last_became_active":"2024-09-15T23:57:36.667192+0000","last_became_peered":"2024-09-15T23:57:36.667192+0000","last_unstale":"2024-09-15T23:57:37.665228+0000","last_undegraded":"2024-09-15T23:57:37.665228+0000","last_fullsized":"2024-09-15T23:57:37.665228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:52.965694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669506+0000","last_change":"2024-09-15T23:57:37.668057+0000","last_active":"2024-09-15T23:57:37.669506+0000","last_peered":"2024-09-15T23:57:37.669506+0000","last_clean":"2024-09-15T23:57:37.669506+0000","last_became_active":"2024-09-15T23:57:37.667797+0000","last_became_peered":"2024-09-15T23:57:37.667797+0000","last_unstale":"2024-09-15T23:57:37.669506+0000","last_undegraded":"2024-09-15T23:57:37.669506+0000","last_fullsized":"2024-09-15T23:57:37.669506+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:18.894764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.697079+0000","last_change":"2024-09-15T23:57:36.668844+0000","last_active":"2024-09-15T23:57:37.697079+0000","last_peered":"2024-09-15T23:57:37.697079+0000","last_clean":"2024-09-15T23:57:37.697079+0000","last_became_active":"2024-09-15T23:57:36.668580+0000","last_became_peered":"2024-09-15T23:57:36.668580+0000","last_unstale":"2024-09-15T23:57:37.697079+0000","last_undegraded":"2024-09-15T23:57:37.697079+0000","last_fullsized":"2024-09-15T23:57:37.697079+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:28.036924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670024+0000","last_change":"2024-09-15T23:57:37.667851+0000","last_active":"2024-09-15T23:57:37.670024+0000","last_peered":"2024-09-15T23:57:37.670024+0000","last_clean":"2024-09-15T23:57:37.670024+0000","last_became_active":"2024-09-15T23:57:37.667358+0000","last_became_peered":"2024-09-15T23:57:37.667358+0000","last_unstale":"2024-09-15T23:57:37.670024+0000","last_undegraded":"2024-09-15T23:57:37.670024+0000","last_fullsized":"2024-09-15T23:57:37.670024+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:37.291613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695521+0000","last_change":"2024-09-15T23:57:36.663449+0000","last_active":"2024-09-15T23:57:37.695521+0000","last_peered":"2024-09-15T23:57:37.695521+0000","last_clean":"2024-09-15T23:57:37.695521+0000","last_became_active":"2024-09-15T23:57:36.663020+0000","last_became_peered":"2024-09-15T23:57:36.663020+0000","last_unstale":"2024-09-15T23:57:37.695521+0000","last_undegraded":"2024-09-15T23:57:37.695521+0000","last_fullsized":"2024-09-15T23:57:37.695521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:10.200753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690069+0000","last_change":"2024-09-15T23:57:37.686302+0000","last_active":"2024-09-15T23:57:37.690069+0000","last_peered":"2024-09-15T23:57:37.690069+0000","last_clean":"2024-09-15T23:57:37.690069+0000","last_became_active":"2024-09-15T23:57:37.685309+0000","last_became_peered":"2024-09-15T23:57:37.685309+0000","last_unstale":"2024-09-15T23:57:37.690069+0000","last_undegraded":"2024-09-15T23:57:37.690069+0000","last_fullsized":"2024-09-15T23:57:37.690069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:01.745112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695333+0000","last_change":"2024-09-15T23:57:36.669956+0000","last_active":"2024-09-15T23:57:37.695333+0000","last_peered":"2024-09-15T23:57:37.695333+0000","last_clean":"2024-09-15T23:57:37.695333+0000","last_became_active":"2024-09-15T23:57:36.669648+0000","last_became_peered":"2024-09-15T23:57:36.669648+0000","last_unstale":"2024-09-15T23:57:37.695333+0000","last_undegraded":"2024-09-15T23:57:37.695333+0000","last_fullsized":"2024-09-15T23:57:37.695333+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:38.729274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670010+0000","last_change":"2024-09-15T23:57:37.667565+0000","last_active":"2024-09-15T23:57:37.670010+0000","last_peered":"2024-09-15T23:57:37.670010+0000","last_clean":"2024-09-15T23:57:37.670010+0000","last_became_active":"2024-09-15T23:57:37.666997+0000","last_became_peered":"2024-09-15T23:57:37.666997+0000","last_unstale":"2024-09-15T23:57:37.670010+0000","last_undegraded":"2024-09-15T23:57:37.670010+0000","last_fullsized":"2024-09-15T23:57:37.670010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:26.459308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.666478+0000","last_change":"2024-09-15T23:57:36.669990+0000","last_active":"2024-09-15T23:57:37.666478+0000","last_peered":"2024-09-15T23:57:37.666478+0000","last_clean":"2024-09-15T23:57:37.666478+0000","last_became_active":"2024-09-15T23:57:36.669698+0000","last_became_peered":"2024-09-15T23:57:36.669698+0000","last_unstale":"2024-09-15T23:57:37.666478+0000","last_undegraded":"2024-09-15T23:57:37.666478+0000","last_fullsized":"2024-09-15T23:57:37.666478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:54.763616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686461+0000","last_change":"2024-09-15T23:57:37.684924+0000","last_active":"2024-09-15T23:57:37.686461+0000","last_peered":"2024-09-15T23:57:37.686461+0000","last_clean":"2024-09-15T23:57:37.686461+0000","last_became_active":"2024-09-15T23:57:37.684638+0000","last_became_peered":"2024-09-15T23:57:37.684638+0000","last_unstale":"2024-09-15T23:57:37.686461+0000","last_undegraded":"2024-09-15T23:57:37.686461+0000","last_fullsized":"2024-09-15T23:57:37.686461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:55.527185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695836+0000","last_change":"2024-09-15T23:57:36.671443+0000","last_active":"2024-09-15T23:57:37.695836+0000","last_peered":"2024-09-15T23:57:37.695836+0000","last_clean":"2024-09-15T23:57:37.695836+0000","last_became_active":"2024-09-15T23:57:36.671150+0000","last_became_peered":"2024-09-15T23:57:36.671150+0000","last_unstale":"2024-09-15T23:57:37.695836+0000","last_undegraded":"2024-09-15T23:57:37.695836+0000","last_fullsized":"2024-09-15T23:57:37.695836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:38.728544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692252+0000","last_change":"2024-09-15T23:57:37.687561+0000","last_active":"2024-09-15T23:57:37.692252+0000","last_peered":"2024-09-15T23:57:37.692252+0000","last_clean":"2024-09-15T23:57:37.692252+0000","last_became_active":"2024-09-15T23:57:37.687311+0000","last_became_peered":"2024-09-15T23:57:37.687311+0000","last_unstale":"2024-09-15T23:57:37.692252+0000","last_undegraded":"2024-09-15T23:57:37.692252+0000","last_fullsized":"2024-09-15T23:57:37.692252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:02.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669719+0000","last_change":"2024-09-15T23:57:36.674175+0000","last_active":"2024-09-15T23:57:37.669719+0000","last_peered":"2024-09-15T23:57:37.669719+0000","last_clean":"2024-09-15T23:57:37.669719+0000","last_became_active":"2024-09-15T23:57:36.673894+0000","last_became_peered":"2024-09-15T23:57:36.673894+0000","last_unstale":"2024-09-15T23:57:37.669719+0000","last_undegraded":"2024-09-15T23:57:37.669719+0000","last_fullsized":"2024-09-15T23:57:37.669719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:25.064385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692290+0000","last_change":"2024-09-15T23:57:37.687449+0000","last_active":"2024-09-15T23:57:37.692290+0000","last_peered":"2024-09-15T23:57:37.692290+0000","last_clean":"2024-09-15T23:57:37.692290+0000","last_became_active":"2024-09-15T23:57:37.687213+0000","last_became_peered":"2024-09-15T23:57:37.687213+0000","last_unstale":"2024-09-15T23:57:37.692290+0000","last_undegraded":"2024-09-15T23:57:37.692290+0000","last_fullsized":"2024-09-15T23:57:37.692290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:08.445713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665373+0000","last_change":"2024-09-15T23:57:36.667900+0000","last_active":"2024-09-15T23:57:37.665373+0000","last_peered":"2024-09-15T23:57:37.665373+0000","last_clean":"2024-09-15T23:57:37.665373+0000","last_became_active":"2024-09-15T23:57:36.667651+0000","last_became_peered":"2024-09-15T23:57:36.667651+0000","last_unstale":"2024-09-15T23:57:37.665373+0000","last_undegraded":"2024-09-15T23:57:37.665373+0000","last_fullsized":"2024-09-15T23:57:37.665373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:25.642492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685735+0000","last_change":"2024-09-15T23:57:37.677848+0000","last_active":"2024-09-15T23:57:37.685735+0000","last_peered":"2024-09-15T23:57:37.685735+0000","last_clean":"2024-09-15T23:57:37.685735+0000","last_became_active":"2024-09-15T23:57:37.677466+0000","last_became_peered":"2024-09-15T23:57:37.677466+0000","last_unstale":"2024-09-15T23:57:37.685735+0000","last_undegraded":"2024-09-15T23:57:37.685735+0000","last_fullsized":"2024-09-15T23:57:37.685735+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:16.609848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.666403+0000","last_change":"2024-09-15T23:57:36.662789+0000","last_active":"2024-09-15T23:57:37.666403+0000","last_peered":"2024-09-15T23:57:37.666403+0000","last_clean":"2024-09-15T23:57:37.666403+0000","last_became_active":"2024-09-15T23:57:36.662414+0000","last_became_peered":"2024-09-15T23:57:36.662414+0000","last_unstale":"2024-09-15T23:57:37.666403+0000","last_undegraded":"2024-09-15T23:57:37.666403+0000","last_fullsized":"2024-09-15T23:57:37.666403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:59.230885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669979+0000","last_change":"2024-09-15T23:57:37.667622+0000","last_active":"2024-09-15T23:57:37.669979+0000","last_peered":"2024-09-15T23:57:37.669979+0000","last_clean":"2024-09-15T23:57:37.669979+0000","last_became_active":"2024-09-15T23:57:37.667022+0000","last_became_peered":"2024-09-15T23:57:37.667022+0000","last_unstale":"2024-09-15T23:57:37.669979+0000","last_undegraded":"2024-09-15T23:57:37.669979+0000","last_fullsized":"2024-09-15T23:57:37.669979+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:16.048305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.689962+0000","last_change":"2024-09-15T23:57:36.666865+0000","last_active":"2024-09-15T23:57:37.689962+0000","last_peered":"2024-09-15T23:57:37.689962+0000","last_clean":"2024-09-15T23:57:37.689962+0000","last_became_active":"2024-09-15T23:57:36.664974+0000","last_became_peered":"2024-09-15T23:57:36.664974+0000","last_unstale":"2024-09-15T23:57:37.689962+0000","last_undegraded":"2024-09-15T23:57:37.689962+0000","last_fullsized":"2024-09-15T23:57:37.689962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.947340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686610+0000","last_change":"2024-09-15T23:57:37.681301+0000","last_active":"2024-09-15T23:57:37.686610+0000","last_peered":"2024-09-15T23:57:37.686610+0000","last_clean":"2024-09-15T23:57:37.686610+0000","last_became_active":"2024-09-15T23:57:37.680704+0000","last_became_peered":"2024-09-15T23:57:37.680704+0000","last_unstale":"2024-09-15T23:57:37.686610+0000","last_undegraded":"2024-09-15T23:57:37.686610+0000","last_fullsized":"2024-09-15T23:57:37.686610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.884426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.654683+0000","last_change":"2024-09-15T23:57:36.665511+0000","last_active":"2024-09-15T23:57:37.654683+0000","last_peered":"2024-09-15T23:57:37.654683+0000","last_clean":"2024-09-15T23:57:37.654683+0000","last_became_active":"2024-09-15T23:57:36.665197+0000","last_became_peered":"2024-09-15T23:57:36.665197+0000","last_unstale":"2024-09-15T23:57:37.654683+0000","last_undegraded":"2024-09-15T23:57:37.654683+0000","last_fullsized":"2024-09-15T23:57:37.654683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:12.581058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686129+0000","last_change":"2024-09-15T23:57:37.679838+0000","last_active":"2024-09-15T23:57:37.686129+0000","last_peered":"2024-09-15T23:57:37.686129+0000","last_clean":"2024-09-15T23:57:37.686129+0000","last_became_active":"2024-09-15T23:57:37.678737+0000","last_became_peered":"2024-09-15T23:57:37.678737+0000","last_unstale":"2024-09-15T23:57:37.686129+0000","last_undegraded":"2024-09-15T23:57:37.686129+0000","last_fullsized":"2024-09-15T23:57:37.686129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:53.605947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662820+0000","last_change":"2024-09-15T23:57:36.671675+0000","last_active":"2024-09-15T23:57:37.662820+0000","last_peered":"2024-09-15T23:57:37.662820+0000","last_clean":"2024-09-15T23:57:37.662820+0000","last_became_active":"2024-09-15T23:57:36.671419+0000","last_became_peered":"2024-09-15T23:57:36.671419+0000","last_unstale":"2024-09-15T23:57:37.662820+0000","last_undegraded":"2024-09-15T23:57:37.662820+0000","last_fullsized":"2024-09-15T23:57:37.662820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:58.141472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692347+0000","last_change":"2024-09-15T23:57:37.688850+0000","last_active":"2024-09-15T23:57:37.692347+0000","last_peered":"2024-09-15T23:57:37.692347+0000","last_clean":"2024-09-15T23:57:37.692347+0000","last_became_active":"2024-09-15T23:57:37.688591+0000","last_became_peered":"2024-09-15T23:57:37.688591+0000","last_unstale":"2024-09-15T23:57:37.692347+0000","last_undegraded":"2024-09-15T23:57:37.692347+0000","last_fullsized":"2024-09-15T23:57:37.692347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:33.769386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.668704+0000","last_change":"2024-09-15T23:57:36.670811+0000","last_active":"2024-09-15T23:57:37.668704+0000","last_peered":"2024-09-15T23:57:37.668704+0000","last_clean":"2024-09-15T23:57:37.668704+0000","last_became_active":"2024-09-15T23:57:36.670535+0000","last_became_peered":"2024-09-15T23:57:36.670535+0000","last_unstale":"2024-09-15T23:57:37.668704+0000","last_undegraded":"2024-09-15T23:57:37.668704+0000","last_fullsized":"2024-09-15T23:57:37.668704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:51.984554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679843+0000","last_change":"2024-09-15T23:57:37.674428+0000","last_active":"2024-09-15T23:57:37.679843+0000","last_peered":"2024-09-15T23:57:37.679843+0000","last_clean":"2024-09-15T23:57:37.679843+0000","last_became_active":"2024-09-15T23:57:37.674118+0000","last_became_peered":"2024-09-15T23:57:37.674118+0000","last_unstale":"2024-09-15T23:57:37.679843+0000","last_undegraded":"2024-09-15T23:57:37.679843+0000","last_fullsized":"2024-09-15T23:57:37.679843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:21.943015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.663643+0000","last_change":"2024-09-15T23:57:36.671194+0000","last_active":"2024-09-15T23:57:37.663643+0000","last_peered":"2024-09-15T23:57:37.663643+0000","last_clean":"2024-09-15T23:57:37.663643+0000","last_became_active":"2024-09-15T23:57:36.670975+0000","last_became_peered":"2024-09-15T23:57:36.670975+0000","last_unstale":"2024-09-15T23:57:37.663643+0000","last_undegraded":"2024-09-15T23:57:37.663643+0000","last_fullsized":"2024-09-15T23:57:37.663643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:19.420294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.687578+0000","last_change":"2024-09-15T23:57:37.679444+0000","last_active":"2024-09-15T23:57:37.687578+0000","last_peered":"2024-09-15T23:57:37.687578+0000","last_clean":"2024-09-15T23:57:37.687578+0000","last_became_active":"2024-09-15T23:57:37.678592+0000","last_became_peered":"2024-09-15T23:57:37.678592+0000","last_unstale":"2024-09-15T23:57:37.687578+0000","last_undegraded":"2024-09-15T23:57:37.687578+0000","last_fullsized":"2024-09-15T23:57:37.687578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:34.640710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669617+0000","last_change":"2024-09-15T23:57:36.674148+0000","last_active":"2024-09-15T23:57:37.669617+0000","last_peered":"2024-09-15T23:57:37.669617+0000","last_clean":"2024-09-15T23:57:37.669617+0000","last_became_active":"2024-09-15T23:57:36.673617+0000","last_became_peered":"2024-09-15T23:57:36.673617+0000","last_unstale":"2024-09-15T23:57:37.669617+0000","last_undegraded":"2024-09-15T23:57:37.669617+0000","last_fullsized":"2024-09-15T23:57:37.669617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:40.682828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678721+0000","last_change":"2024-09-15T23:57:37.674310+0000","last_active":"2024-09-15T23:57:37.678721+0000","last_peered":"2024-09-15T23:57:37.678721+0000","last_clean":"2024-09-15T23:57:37.678721+0000","last_became_active":"2024-09-15T23:57:37.673414+0000","last_became_peered":"2024-09-15T23:57:37.673414+0000","last_unstale":"2024-09-15T23:57:37.678721+0000","last_undegraded":"2024-09-15T23:57:37.678721+0000","last_fullsized":"2024-09-15T23:57:37.678721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:07.789009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.654590+0000","last_change":"2024-09-15T23:57:36.663753+0000","last_active":"2024-09-15T23:57:37.654590+0000","last_peered":"2024-09-15T23:57:37.654590+0000","last_clean":"2024-09-15T23:57:37.654590+0000","last_became_active":"2024-09-15T23:57:36.663466+0000","last_became_peered":"2024-09-15T23:57:36.663466+0000","last_unstale":"2024-09-15T23:57:37.654590+0000","last_undegraded":"2024-09-15T23:57:37.654590+0000","last_fullsized":"2024-09-15T23:57:37.654590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.070424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679291+0000","last_change":"2024-09-15T23:57:37.675325+0000","last_active":"2024-09-15T23:57:37.679291+0000","last_peered":"2024-09-15T23:57:37.679291+0000","last_clean":"2024-09-15T23:57:37.679291+0000","last_became_active":"2024-09-15T23:57:37.675044+0000","last_became_peered":"2024-09-15T23:57:37.675044+0000","last_unstale":"2024-09-15T23:57:37.679291+0000","last_undegraded":"2024-09-15T23:57:37.679291+0000","last_fullsized":"2024-09-15T23:57:37.679291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:23.881324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662498+0000","last_change":"2024-09-15T23:57:36.672146+0000","last_active":"2024-09-15T23:57:37.662498+0000","last_peered":"2024-09-15T23:57:37.662498+0000","last_clean":"2024-09-15T23:57:37.662498+0000","last_became_active":"2024-09-15T23:57:36.671502+0000","last_became_peered":"2024-09-15T23:57:36.671502+0000","last_unstale":"2024-09-15T23:57:37.662498+0000","last_undegraded":"2024-09-15T23:57:37.662498+0000","last_fullsized":"2024-09-15T23:57:37.662498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:41.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686332+0000","last_change":"2024-09-15T23:57:37.681083+0000","last_active":"2024-09-15T23:57:37.686332+0000","last_peered":"2024-09-15T23:57:37.686332+0000","last_clean":"2024-09-15T23:57:37.686332+0000","last_became_active":"2024-09-15T23:57:37.680648+0000","last_became_peered":"2024-09-15T23:57:37.680648+0000","last_unstale":"2024-09-15T23:57:37.686332+0000","last_undegraded":"2024-09-15T23:57:37.686332+0000","last_fullsized":"2024-09-15T23:57:37.686332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:50.476385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690004+0000","last_change":"2024-09-15T23:57:36.665518+0000","last_active":"2024-09-15T23:57:37.690004+0000","last_peered":"2024-09-15T23:57:37.690004+0000","last_clean":"2024-09-15T23:57:37.690004+0000","last_became_active":"2024-09-15T23:57:36.664275+0000","last_became_peered":"2024-09-15T23:57:36.664275+0000","last_unstale":"2024-09-15T23:57:37.690004+0000","last_undegraded":"2024-09-15T23:57:37.690004+0000","last_fullsized":"2024-09-15T23:57:37.690004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:41.751650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"61'152","reported_seq":439,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.653789+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:37.653789+0000","last_peered":"2024-09-15T23:57:37.653789+0000","last_clean":"2024-09-15T23:57:37.653789+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:37.653789+0000","last_undegraded":"2024-09-15T23:57:37.653789+0000","last_fullsized":"2024-09-15T23:57:37.653789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":626688,"data_stored":246791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":841624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1220608,"data_stored":837159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:40.589 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:40.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.723+0000 7f55cf2d7640 1 Processor -- start 2024-09-15T23:57:40.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.723+0000 7f55cf2d7640 1 -- start start 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cf2d7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55c80a4c20 0x7f55c813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cf2d7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c813a080 con 0x7f55c813a280 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cf2d7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f55c80a3d50 con 0x7f55c80a4c20 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cc872640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f55c80a4c20 0x7f55c813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cd073640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f55c813a280 0x7f55c813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33950/0 (socket says 172.21.15.121:33950) 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cd073640 1 -- 172.21.15.121:0/2899457735 learned_addr learned my addr 172.21.15.121:0/2899457735 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:40.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cc872640 1 -- 172.21.15.121:0/2899457735 >> v1:172.21.15.121:6789/0 conn(0x7f55c813a280 legacy=0x7f55c813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55cc872640 1 -- 172.21.15.121:0/2899457735 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c80a3f80 con 0x7f55c80a4c20 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.724+0000 7f55bbfff640 1 -- 172.21.15.121:0/2899457735 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742401908 0 0) 0x7f55c813a080 con 0x7f55c813a280 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.725+0000 7f55cc872640 1 --2- 172.21.15.121:0/2899457735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c813f060 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009720 tx=0x7f55c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8829e599cc9c4215 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.725+0000 7f55bbfff640 1 -- 172.21.15.121:0/2899457735 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4037070 con 0x7f55c80a4c20 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.725+0000 7f55bbfff640 1 -- 172.21.15.121:0/2899457735 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c402ad90 con 0x7f55c80a4c20 2024-09-15T23:57:40.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.725+0000 7f55bbfff640 1 -- 172.21.15.121:0/2899457735 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55c4032590 con 0x7f55c80a4c20 2024-09-15T23:57:40.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 -- 172.21.15.121:0/2899457735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 msgr2=0x7f55c813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/2899457735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c813f060 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f55c4009720 tx=0x7f55c402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:40.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 -- 172.21.15.121:0/2899457735 shutdown_connections 2024-09-15T23:57:40.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/2899457735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c813f060 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 -- 172.21.15.121:0/2899457735 >> 172.21.15.121:0/2899457735 conn(0x7f55c80ac3e0 msgr2=0x7f55c80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 -- 172.21.15.121:0/2899457735 shutdown_connections 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.726+0000 7f55cf2d7640 1 -- 172.21.15.121:0/2899457735 wait complete. 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cf2d7640 1 Processor -- start 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cf2d7640 1 -- start start 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cf2d7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cf2d7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55c80a7ec0 con 0x7f55c80a4c20 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cd073640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cd073640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47700/0 (socket says 172.21.15.121:47700) 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cd073640 1 -- 172.21.15.121:0/3294982140 learned_addr learned my addr 172.21.15.121:0/3294982140 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.727+0000 7f55cd073640 1 -- 172.21.15.121:0/3294982140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c8124f10 con 0x7f55c80a4c20 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55cd073640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c420 tx=0x7f55bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.731 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc018070 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc0074d0 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c8124690 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55bc004950 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.728+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c81238a0 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.729+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f55bc01b070 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.729+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c8122b30 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.729+0000 7f55b9ffb640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 0x7f55ac03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.729+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f55bc04a560 con 0x7f55c80a4c20 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.729+0000 7f55cc872640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 0x7f55ac03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:40.732 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.730+0000 7f55cc872640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 0x7f55ac03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f55c4034000 tx=0x7f55c402e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:40.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.734+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55bc011960 con 0x7f55c80a4c20 2024-09-15T23:57:40.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.897+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 --> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55c80ab920 con 0x7f55ac0382a0 2024-09-15T23:57:40.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.903+0000 7f55b9ffb640 1 -- 172.21.15.121:0/3294982140 <== mgr.4913 v2:172.21.15.121:6828/229629035 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246019 (secure 0 0 0) 0x7f55c40326f0 con 0x7f55ac0382a0 2024-09-15T23:57:40.906 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:40.908 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 msgr2=0x7f55ac03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 0x7f55ac03a760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f55c4034000 tx=0x7f55c402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 msgr2=0x7f55c80a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c420 tx=0x7f55bc00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 shutdown_connections 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f55ac0382a0 0x7f55ac03a760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 --2- 172.21.15.121:0/3294982140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55c80a4c20 0x7f55c80a1080 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 >> 172.21.15.121:0/3294982140 conn(0x7f55c80ac3e0 msgr2=0x7f55c8139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:40.909 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 shutdown_connections 2024-09-15T23:57:40.910 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:40.906+0000 7f55cf2d7640 1 -- 172.21.15.121:0/3294982140 wait complete. 2024-09-15T23:57:40.918 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-15T23:57:39.197853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":281,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":96580,"kb_used_data":3004,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018940,"statfs":{"total":289910292480,"available":289811394560,"internally_reserved":0,"allocated":3076096,"data_stored":1925574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000677"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678692+0000","last_change":"2024-09-15T23:57:37.675049+0000","last_active":"2024-09-15T23:57:37.678692+0000","last_peered":"2024-09-15T23:57:37.678692+0000","last_clean":"2024-09-15T23:57:37.678692+0000","last_became_active":"2024-09-15T23:57:37.674772+0000","last_became_peered":"2024-09-15T23:57:37.674772+0000","last_unstale":"2024-09-15T23:57:37.678692+0000","last_undegraded":"2024-09-15T23:57:37.678692+0000","last_fullsized":"2024-09-15T23:57:37.678692+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:49.770951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678512+0000","last_change":"2024-09-15T23:57:37.673353+0000","last_active":"2024-09-15T23:57:37.678512+0000","last_peered":"2024-09-15T23:57:37.678512+0000","last_clean":"2024-09-15T23:57:37.678512+0000","last_became_active":"2024-09-15T23:57:37.673038+0000","last_became_peered":"2024-09-15T23:57:37.673038+0000","last_unstale":"2024-09-15T23:57:37.678512+0000","last_undegraded":"2024-09-15T23:57:37.678512+0000","last_fullsized":"2024-09-15T23:57:37.678512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:17.824311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686560+0000","last_change":"2024-09-15T23:57:37.684703+0000","last_active":"2024-09-15T23:57:37.686560+0000","last_peered":"2024-09-15T23:57:37.686560+0000","last_clean":"2024-09-15T23:57:37.686560+0000","last_became_active":"2024-09-15T23:57:37.684443+0000","last_became_peered":"2024-09-15T23:57:37.684443+0000","last_unstale":"2024-09-15T23:57:37.686560+0000","last_undegraded":"2024-09-15T23:57:37.686560+0000","last_fullsized":"2024-09-15T23:57:37.686560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:15.258107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686243+0000","last_change":"2024-09-15T23:57:37.683290+0000","last_active":"2024-09-15T23:57:37.686243+0000","last_peered":"2024-09-15T23:57:37.686243+0000","last_clean":"2024-09-15T23:57:37.686243+0000","last_became_active":"2024-09-15T23:57:37.683031+0000","last_became_peered":"2024-09-15T23:57:37.683031+0000","last_unstale":"2024-09-15T23:57:37.686243+0000","last_undegraded":"2024-09-15T23:57:37.686243+0000","last_fullsized":"2024-09-15T23:57:37.686243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:03.016860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.677813+0000","last_change":"2024-09-15T23:57:37.674517+0000","last_active":"2024-09-15T23:57:37.677813+0000","last_peered":"2024-09-15T23:57:37.677813+0000","last_clean":"2024-09-15T23:57:37.677813+0000","last_became_active":"2024-09-15T23:57:37.674235+0000","last_became_peered":"2024-09-15T23:57:37.674235+0000","last_unstale":"2024-09-15T23:57:37.677813+0000","last_undegraded":"2024-09-15T23:57:37.677813+0000","last_fullsized":"2024-09-15T23:57:37.677813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:36.797653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694412+0000","last_change":"2024-09-15T23:57:37.691334+0000","last_active":"2024-09-15T23:57:37.694412+0000","last_peered":"2024-09-15T23:57:37.694412+0000","last_clean":"2024-09-15T23:57:37.694412+0000","last_became_active":"2024-09-15T23:57:37.691068+0000","last_became_peered":"2024-09-15T23:57:37.691068+0000","last_unstale":"2024-09-15T23:57:37.694412+0000","last_undegraded":"2024-09-15T23:57:37.694412+0000","last_fullsized":"2024-09-15T23:57:37.694412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:45.183502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686391+0000","last_change":"2024-09-15T23:57:37.682695+0000","last_active":"2024-09-15T23:57:37.686391+0000","last_peered":"2024-09-15T23:57:37.686391+0000","last_clean":"2024-09-15T23:57:37.686391+0000","last_became_active":"2024-09-15T23:57:37.682107+0000","last_became_peered":"2024-09-15T23:57:37.682107+0000","last_unstale":"2024-09-15T23:57:37.686391+0000","last_undegraded":"2024-09-15T23:57:37.686391+0000","last_fullsized":"2024-09-15T23:57:37.686391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:53.520321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692413+0000","last_change":"2024-09-15T23:57:37.679275+0000","last_active":"2024-09-15T23:57:37.692413+0000","last_peered":"2024-09-15T23:57:37.692413+0000","last_clean":"2024-09-15T23:57:37.692413+0000","last_became_active":"2024-09-15T23:57:37.678974+0000","last_became_peered":"2024-09-15T23:57:37.678974+0000","last_unstale":"2024-09-15T23:57:37.692413+0000","last_undegraded":"2024-09-15T23:57:37.692413+0000","last_fullsized":"2024-09-15T23:57:37.692413+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:00.171754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.688747+0000","last_change":"2024-09-15T23:57:37.681497+0000","last_active":"2024-09-15T23:57:37.688747+0000","last_peered":"2024-09-15T23:57:37.688747+0000","last_clean":"2024-09-15T23:57:37.688747+0000","last_became_active":"2024-09-15T23:57:37.681093+0000","last_became_peered":"2024-09-15T23:57:37.681093+0000","last_unstale":"2024-09-15T23:57:37.688747+0000","last_undegraded":"2024-09-15T23:57:37.688747+0000","last_fullsized":"2024-09-15T23:57:37.688747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:25.547635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685500+0000","last_change":"2024-09-15T23:57:37.679974+0000","last_active":"2024-09-15T23:57:37.685500+0000","last_peered":"2024-09-15T23:57:37.685500+0000","last_clean":"2024-09-15T23:57:37.685500+0000","last_became_active":"2024-09-15T23:57:37.679697+0000","last_became_peered":"2024-09-15T23:57:37.679697+0000","last_unstale":"2024-09-15T23:57:37.685500+0000","last_undegraded":"2024-09-15T23:57:37.685500+0000","last_fullsized":"2024-09-15T23:57:37.685500+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:54.917911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678986+0000","last_change":"2024-09-15T23:57:37.675323+0000","last_active":"2024-09-15T23:57:37.678986+0000","last_peered":"2024-09-15T23:57:37.678986+0000","last_clean":"2024-09-15T23:57:37.678986+0000","last_became_active":"2024-09-15T23:57:37.673505+0000","last_became_peered":"2024-09-15T23:57:37.673505+0000","last_unstale":"2024-09-15T23:57:37.678986+0000","last_undegraded":"2024-09-15T23:57:37.678986+0000","last_fullsized":"2024-09-15T23:57:37.678986+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:46.486659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686169+0000","last_change":"2024-09-15T23:57:37.680265+0000","last_active":"2024-09-15T23:57:37.686169+0000","last_peered":"2024-09-15T23:57:37.686169+0000","last_clean":"2024-09-15T23:57:37.686169+0000","last_became_active":"2024-09-15T23:57:37.679584+0000","last_became_peered":"2024-09-15T23:57:37.679584+0000","last_unstale":"2024-09-15T23:57:37.686169+0000","last_undegraded":"2024-09-15T23:57:37.686169+0000","last_fullsized":"2024-09-15T23:57:37.686169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:33.110761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.680832+0000","last_change":"2024-09-15T23:57:37.676879+0000","last_active":"2024-09-15T23:57:37.680832+0000","last_peered":"2024-09-15T23:57:37.680832+0000","last_clean":"2024-09-15T23:57:37.680832+0000","last_became_active":"2024-09-15T23:57:37.676612+0000","last_became_peered":"2024-09-15T23:57:37.676612+0000","last_unstale":"2024-09-15T23:57:37.680832+0000","last_undegraded":"2024-09-15T23:57:37.680832+0000","last_fullsized":"2024-09-15T23:57:37.680832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:23.989024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686443+0000","last_change":"2024-09-15T23:57:37.684893+0000","last_active":"2024-09-15T23:57:37.686443+0000","last_peered":"2024-09-15T23:57:37.686443+0000","last_clean":"2024-09-15T23:57:37.686443+0000","last_became_active":"2024-09-15T23:57:37.683616+0000","last_became_peered":"2024-09-15T23:57:37.683616+0000","last_unstale":"2024-09-15T23:57:37.686443+0000","last_undegraded":"2024-09-15T23:57:37.686443+0000","last_fullsized":"2024-09-15T23:57:37.686443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:07.257234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686562+0000","last_change":"2024-09-15T23:57:37.681205+0000","last_active":"2024-09-15T23:57:37.686562+0000","last_peered":"2024-09-15T23:57:37.686562+0000","last_clean":"2024-09-15T23:57:37.686562+0000","last_became_active":"2024-09-15T23:57:37.680639+0000","last_became_peered":"2024-09-15T23:57:37.680639+0000","last_unstale":"2024-09-15T23:57:37.686562+0000","last_undegraded":"2024-09-15T23:57:37.686562+0000","last_fullsized":"2024-09-15T23:57:37.686562+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:27.354962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692273+0000","last_change":"2024-09-15T23:57:37.687348+0000","last_active":"2024-09-15T23:57:37.692273+0000","last_peered":"2024-09-15T23:57:37.692273+0000","last_clean":"2024-09-15T23:57:37.692273+0000","last_became_active":"2024-09-15T23:57:37.686879+0000","last_became_peered":"2024-09-15T23:57:37.686879+0000","last_unstale":"2024-09-15T23:57:37.692273+0000","last_undegraded":"2024-09-15T23:57:37.692273+0000","last_fullsized":"2024-09-15T23:57:37.692273+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:07.885927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686498+0000","last_change":"2024-09-15T23:57:37.678104+0000","last_active":"2024-09-15T23:57:37.686498+0000","last_peered":"2024-09-15T23:57:37.686498+0000","last_clean":"2024-09-15T23:57:37.686498+0000","last_became_active":"2024-09-15T23:57:37.675742+0000","last_became_peered":"2024-09-15T23:57:37.675742+0000","last_unstale":"2024-09-15T23:57:37.686498+0000","last_undegraded":"2024-09-15T23:57:37.686498+0000","last_fullsized":"2024-09-15T23:57:37.686498+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:28.122756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686355+0000","last_change":"2024-09-15T23:57:37.683369+0000","last_active":"2024-09-15T23:57:37.686355+0000","last_peered":"2024-09-15T23:57:37.686355+0000","last_clean":"2024-09-15T23:57:37.686355+0000","last_became_active":"2024-09-15T23:57:37.683097+0000","last_became_peered":"2024-09-15T23:57:37.683097+0000","last_unstale":"2024-09-15T23:57:37.686355+0000","last_undegraded":"2024-09-15T23:57:37.686355+0000","last_fullsized":"2024-09-15T23:57:37.686355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:52.477477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670029+0000","last_change":"2024-09-15T23:57:37.667773+0000","last_active":"2024-09-15T23:57:37.670029+0000","last_peered":"2024-09-15T23:57:37.670029+0000","last_clean":"2024-09-15T23:57:37.670029+0000","last_became_active":"2024-09-15T23:57:37.667321+0000","last_became_peered":"2024-09-15T23:57:37.667321+0000","last_unstale":"2024-09-15T23:57:37.670029+0000","last_undegraded":"2024-09-15T23:57:37.670029+0000","last_fullsized":"2024-09-15T23:57:37.670029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:49.612938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694363+0000","last_change":"2024-09-15T23:57:37.691321+0000","last_active":"2024-09-15T23:57:37.694363+0000","last_peered":"2024-09-15T23:57:37.694363+0000","last_clean":"2024-09-15T23:57:37.694363+0000","last_became_active":"2024-09-15T23:57:37.691053+0000","last_became_peered":"2024-09-15T23:57:37.691053+0000","last_unstale":"2024-09-15T23:57:37.694363+0000","last_undegraded":"2024-09-15T23:57:37.694363+0000","last_fullsized":"2024-09-15T23:57:37.694363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:57.503139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686408+0000","last_change":"2024-09-15T23:57:37.682579+0000","last_active":"2024-09-15T23:57:37.686408+0000","last_peered":"2024-09-15T23:57:37.686408+0000","last_clean":"2024-09-15T23:57:37.686408+0000","last_became_active":"2024-09-15T23:57:37.682321+0000","last_became_peered":"2024-09-15T23:57:37.682321+0000","last_unstale":"2024-09-15T23:57:37.686408+0000","last_undegraded":"2024-09-15T23:57:37.686408+0000","last_fullsized":"2024-09-15T23:57:37.686408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.227921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669470+0000","last_change":"2024-09-15T23:57:37.667440+0000","last_active":"2024-09-15T23:57:37.669470+0000","last_peered":"2024-09-15T23:57:37.669470+0000","last_clean":"2024-09-15T23:57:37.669470+0000","last_became_active":"2024-09-15T23:57:37.667187+0000","last_became_peered":"2024-09-15T23:57:37.667187+0000","last_unstale":"2024-09-15T23:57:37.669470+0000","last_undegraded":"2024-09-15T23:57:37.669470+0000","last_fullsized":"2024-09-15T23:57:37.669470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:57.529659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685954+0000","last_change":"2024-09-15T23:57:37.678434+0000","last_active":"2024-09-15T23:57:37.685954+0000","last_peered":"2024-09-15T23:57:37.685954+0000","last_clean":"2024-09-15T23:57:37.685954+0000","last_became_active":"2024-09-15T23:57:37.678162+0000","last_became_peered":"2024-09-15T23:57:37.678162+0000","last_unstale":"2024-09-15T23:57:37.685954+0000","last_undegraded":"2024-09-15T23:57:37.685954+0000","last_fullsized":"2024-09-15T23:57:37.685954+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:29:12.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692252+0000","last_change":"2024-09-15T23:57:37.687148+0000","last_active":"2024-09-15T23:57:37.692252+0000","last_peered":"2024-09-15T23:57:37.692252+0000","last_clean":"2024-09-15T23:57:37.692252+0000","last_became_active":"2024-09-15T23:57:37.686870+0000","last_became_peered":"2024-09-15T23:57:37.686870+0000","last_unstale":"2024-09-15T23:57:37.692252+0000","last_undegraded":"2024-09-15T23:57:37.692252+0000","last_fullsized":"2024-09-15T23:57:37.692252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:16.733596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.688082+0000","last_change":"2024-09-15T23:57:37.682184+0000","last_active":"2024-09-15T23:57:37.688082+0000","last_peered":"2024-09-15T23:57:37.688082+0000","last_clean":"2024-09-15T23:57:37.688082+0000","last_became_active":"2024-09-15T23:57:37.681934+0000","last_became_peered":"2024-09-15T23:57:37.681934+0000","last_unstale":"2024-09-15T23:57:37.688082+0000","last_undegraded":"2024-09-15T23:57:37.688082+0000","last_fullsized":"2024-09-15T23:57:37.688082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:43.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669575+0000","last_change":"2024-09-15T23:57:37.666789+0000","last_active":"2024-09-15T23:57:37.669575+0000","last_peered":"2024-09-15T23:57:37.669575+0000","last_clean":"2024-09-15T23:57:37.669575+0000","last_became_active":"2024-09-15T23:57:37.666505+0000","last_became_peered":"2024-09-15T23:57:37.666505+0000","last_unstale":"2024-09-15T23:57:37.669575+0000","last_undegraded":"2024-09-15T23:57:37.669575+0000","last_fullsized":"2024-09-15T23:57:37.669575+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:52.390527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695165+0000","last_change":"2024-09-15T23:57:37.691974+0000","last_active":"2024-09-15T23:57:37.695165+0000","last_peered":"2024-09-15T23:57:37.695165+0000","last_clean":"2024-09-15T23:57:37.695165+0000","last_became_active":"2024-09-15T23:57:37.691716+0000","last_became_peered":"2024-09-15T23:57:37.691716+0000","last_unstale":"2024-09-15T23:57:37.695165+0000","last_undegraded":"2024-09-15T23:57:37.695165+0000","last_fullsized":"2024-09-15T23:57:37.695165+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:41.143930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678634+0000","last_change":"2024-09-15T23:57:37.674511+0000","last_active":"2024-09-15T23:57:37.678634+0000","last_peered":"2024-09-15T23:57:37.678634+0000","last_clean":"2024-09-15T23:57:37.678634+0000","last_became_active":"2024-09-15T23:57:37.674231+0000","last_became_peered":"2024-09-15T23:57:37.674231+0000","last_unstale":"2024-09-15T23:57:37.678634+0000","last_undegraded":"2024-09-15T23:57:37.678634+0000","last_fullsized":"2024-09-15T23:57:37.678634+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:08.770005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686613+0000","last_change":"2024-09-15T23:57:37.681022+0000","last_active":"2024-09-15T23:57:37.686613+0000","last_peered":"2024-09-15T23:57:37.686613+0000","last_clean":"2024-09-15T23:57:37.686613+0000","last_became_active":"2024-09-15T23:57:37.680574+0000","last_became_peered":"2024-09-15T23:57:37.680574+0000","last_unstale":"2024-09-15T23:57:37.686613+0000","last_undegraded":"2024-09-15T23:57:37.686613+0000","last_fullsized":"2024-09-15T23:57:37.686613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:00.868857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679825+0000","last_change":"2024-09-15T23:57:37.673995+0000","last_active":"2024-09-15T23:57:37.679825+0000","last_peered":"2024-09-15T23:57:37.679825+0000","last_clean":"2024-09-15T23:57:37.679825+0000","last_became_active":"2024-09-15T23:57:37.673709+0000","last_became_peered":"2024-09-15T23:57:37.673709+0000","last_unstale":"2024-09-15T23:57:37.679825+0000","last_undegraded":"2024-09-15T23:57:37.679825+0000","last_fullsized":"2024-09-15T23:57:37.679825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:59.950688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686410+0000","last_change":"2024-09-15T23:57:37.682932+0000","last_active":"2024-09-15T23:57:37.686410+0000","last_peered":"2024-09-15T23:57:37.686410+0000","last_clean":"2024-09-15T23:57:37.686410+0000","last_became_active":"2024-09-15T23:57:37.682438+0000","last_became_peered":"2024-09-15T23:57:37.682438+0000","last_unstale":"2024-09-15T23:57:37.686410+0000","last_undegraded":"2024-09-15T23:57:37.686410+0000","last_fullsized":"2024-09-15T23:57:37.686410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:26:16.322039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686316+0000","last_change":"2024-09-15T23:57:37.684092+0000","last_active":"2024-09-15T23:57:37.686316+0000","last_peered":"2024-09-15T23:57:37.686316+0000","last_clean":"2024-09-15T23:57:37.686316+0000","last_became_active":"2024-09-15T23:57:37.683842+0000","last_became_peered":"2024-09-15T23:57:37.683842+0000","last_unstale":"2024-09-15T23:57:37.686316+0000","last_undegraded":"2024-09-15T23:57:37.686316+0000","last_fullsized":"2024-09-15T23:57:37.686316+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:35.413092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.681634+0000","last_change":"2024-09-15T23:57:37.676646+0000","last_active":"2024-09-15T23:57:37.681634+0000","last_peered":"2024-09-15T23:57:37.681634+0000","last_clean":"2024-09-15T23:57:37.681634+0000","last_became_active":"2024-09-15T23:57:37.676385+0000","last_became_peered":"2024-09-15T23:57:37.676385+0000","last_unstale":"2024-09-15T23:57:37.681634+0000","last_undegraded":"2024-09-15T23:57:37.681634+0000","last_fullsized":"2024-09-15T23:57:37.681634+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:58.362036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695856+0000","last_change":"2024-09-15T23:57:36.664173+0000","last_active":"2024-09-15T23:57:37.695856+0000","last_peered":"2024-09-15T23:57:37.695856+0000","last_clean":"2024-09-15T23:57:37.695856+0000","last_became_active":"2024-09-15T23:57:36.663920+0000","last_became_peered":"2024-09-15T23:57:36.663920+0000","last_unstale":"2024-09-15T23:57:37.695856+0000","last_undegraded":"2024-09-15T23:57:37.695856+0000","last_fullsized":"2024-09-15T23:57:37.695856+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:07.880018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678673+0000","last_change":"2024-09-15T23:57:37.674684+0000","last_active":"2024-09-15T23:57:37.678673+0000","last_peered":"2024-09-15T23:57:37.678673+0000","last_clean":"2024-09-15T23:57:37.678673+0000","last_became_active":"2024-09-15T23:57:37.673776+0000","last_became_peered":"2024-09-15T23:57:37.673776+0000","last_unstale":"2024-09-15T23:57:37.678673+0000","last_undegraded":"2024-09-15T23:57:37.678673+0000","last_fullsized":"2024-09-15T23:57:37.678673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:40.953582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.683037+0000","last_change":"2024-09-15T23:57:36.666293+0000","last_active":"2024-09-15T23:57:37.683037+0000","last_peered":"2024-09-15T23:57:37.683037+0000","last_clean":"2024-09-15T23:57:37.683037+0000","last_became_active":"2024-09-15T23:57:36.666024+0000","last_became_peered":"2024-09-15T23:57:36.666024+0000","last_unstale":"2024-09-15T23:57:37.683037+0000","last_undegraded":"2024-09-15T23:57:37.683037+0000","last_fullsized":"2024-09-15T23:57:37.683037+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:43.016883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686150+0000","last_change":"2024-09-15T23:57:37.680060+0000","last_active":"2024-09-15T23:57:37.686150+0000","last_peered":"2024-09-15T23:57:37.686150+0000","last_clean":"2024-09-15T23:57:37.686150+0000","last_became_active":"2024-09-15T23:57:37.679238+0000","last_became_peered":"2024-09-15T23:57:37.679238+0000","last_unstale":"2024-09-15T23:57:37.686150+0000","last_undegraded":"2024-09-15T23:57:37.686150+0000","last_fullsized":"2024-09-15T23:57:37.686150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:59.095376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695618+0000","last_change":"2024-09-15T23:57:36.672075+0000","last_active":"2024-09-15T23:57:37.695618+0000","last_peered":"2024-09-15T23:57:37.695618+0000","last_clean":"2024-09-15T23:57:37.695618+0000","last_became_active":"2024-09-15T23:57:36.671830+0000","last_became_peered":"2024-09-15T23:57:36.671830+0000","last_unstale":"2024-09-15T23:57:37.695618+0000","last_undegraded":"2024-09-15T23:57:37.695618+0000","last_fullsized":"2024-09-15T23:57:37.695618+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:00.371110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678577+0000","last_change":"2024-09-15T23:57:37.673978+0000","last_active":"2024-09-15T23:57:37.678577+0000","last_peered":"2024-09-15T23:57:37.678577+0000","last_clean":"2024-09-15T23:57:37.678577+0000","last_became_active":"2024-09-15T23:57:37.673681+0000","last_became_peered":"2024-09-15T23:57:37.673681+0000","last_unstale":"2024-09-15T23:57:37.678577+0000","last_undegraded":"2024-09-15T23:57:37.678577+0000","last_fullsized":"2024-09-15T23:57:37.678577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:25.733040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695573+0000","last_change":"2024-09-15T23:57:36.671969+0000","last_active":"2024-09-15T23:57:37.695573+0000","last_peered":"2024-09-15T23:57:37.695573+0000","last_clean":"2024-09-15T23:57:37.695573+0000","last_became_active":"2024-09-15T23:57:36.670902+0000","last_became_peered":"2024-09-15T23:57:36.670902+0000","last_unstale":"2024-09-15T23:57:37.695573+0000","last_undegraded":"2024-09-15T23:57:37.695573+0000","last_fullsized":"2024-09-15T23:57:37.695573+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:03.527190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679796+0000","last_change":"2024-09-15T23:57:37.673729+0000","last_active":"2024-09-15T23:57:37.679796+0000","last_peered":"2024-09-15T23:57:37.679796+0000","last_clean":"2024-09-15T23:57:37.679796+0000","last_became_active":"2024-09-15T23:57:37.673437+0000","last_became_peered":"2024-09-15T23:57:37.673437+0000","last_unstale":"2024-09-15T23:57:37.679796+0000","last_undegraded":"2024-09-15T23:57:37.679796+0000","last_fullsized":"2024-09-15T23:57:37.679796+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:14.859034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.694894+0000","last_change":"2024-09-15T23:57:36.669877+0000","last_active":"2024-09-15T23:57:37.694894+0000","last_peered":"2024-09-15T23:57:37.694894+0000","last_clean":"2024-09-15T23:57:37.694894+0000","last_became_active":"2024-09-15T23:57:36.669618+0000","last_became_peered":"2024-09-15T23:57:36.669618+0000","last_unstale":"2024-09-15T23:57:37.694894+0000","last_undegraded":"2024-09-15T23:57:37.694894+0000","last_fullsized":"2024-09-15T23:57:37.694894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:49.837179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692234+0000","last_change":"2024-09-15T23:57:37.687174+0000","last_active":"2024-09-15T23:57:37.692234+0000","last_peered":"2024-09-15T23:57:37.692234+0000","last_clean":"2024-09-15T23:57:37.692234+0000","last_became_active":"2024-09-15T23:57:37.686841+0000","last_became_peered":"2024-09-15T23:57:37.686841+0000","last_unstale":"2024-09-15T23:57:37.692234+0000","last_undegraded":"2024-09-15T23:57:37.692234+0000","last_fullsized":"2024-09-15T23:57:37.692234+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:44.939545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.691984+0000","last_change":"2024-09-15T23:57:36.673943+0000","last_active":"2024-09-15T23:57:37.691984+0000","last_peered":"2024-09-15T23:57:37.691984+0000","last_clean":"2024-09-15T23:57:37.691984+0000","last_became_active":"2024-09-15T23:57:36.673521+0000","last_became_peered":"2024-09-15T23:57:36.673521+0000","last_unstale":"2024-09-15T23:57:37.691984+0000","last_undegraded":"2024-09-15T23:57:37.691984+0000","last_fullsized":"2024-09-15T23:57:37.691984+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:17.037082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.687910+0000","last_change":"2024-09-15T23:57:37.682389+0000","last_active":"2024-09-15T23:57:37.687910+0000","last_peered":"2024-09-15T23:57:37.687910+0000","last_clean":"2024-09-15T23:57:37.687910+0000","last_became_active":"2024-09-15T23:57:37.681750+0000","last_became_peered":"2024-09-15T23:57:37.681750+0000","last_unstale":"2024-09-15T23:57:37.687910+0000","last_undegraded":"2024-09-15T23:57:37.687910+0000","last_fullsized":"2024-09-15T23:57:37.687910+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:57.119121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.663821+0000","last_change":"2024-09-15T23:57:36.671769+0000","last_active":"2024-09-15T23:57:37.663821+0000","last_peered":"2024-09-15T23:57:37.663821+0000","last_clean":"2024-09-15T23:57:37.663821+0000","last_became_active":"2024-09-15T23:57:36.671493+0000","last_became_peered":"2024-09-15T23:57:36.671493+0000","last_unstale":"2024-09-15T23:57:37.663821+0000","last_undegraded":"2024-09-15T23:57:37.663821+0000","last_fullsized":"2024-09-15T23:57:37.663821+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:21.391036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.683512+0000","last_change":"2024-09-15T23:57:37.674738+0000","last_active":"2024-09-15T23:57:37.683512+0000","last_peered":"2024-09-15T23:57:37.683512+0000","last_clean":"2024-09-15T23:57:37.683512+0000","last_became_active":"2024-09-15T23:57:37.674476+0000","last_became_peered":"2024-09-15T23:57:37.674476+0000","last_unstale":"2024-09-15T23:57:37.683512+0000","last_undegraded":"2024-09-15T23:57:37.683512+0000","last_fullsized":"2024-09-15T23:57:37.683512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:04.178390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.653718+0000","last_change":"2024-09-15T23:57:36.666589+0000","last_active":"2024-09-15T23:57:37.653718+0000","last_peered":"2024-09-15T23:57:37.653718+0000","last_clean":"2024-09-15T23:57:37.653718+0000","last_became_active":"2024-09-15T23:57:36.664502+0000","last_became_peered":"2024-09-15T23:57:36.664502+0000","last_unstale":"2024-09-15T23:57:37.653718+0000","last_undegraded":"2024-09-15T23:57:37.653718+0000","last_fullsized":"2024-09-15T23:57:37.653718+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:16.305549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685807+0000","last_change":"2024-09-15T23:57:37.679510+0000","last_active":"2024-09-15T23:57:37.685807+0000","last_peered":"2024-09-15T23:57:37.685807+0000","last_clean":"2024-09-15T23:57:37.685807+0000","last_became_active":"2024-09-15T23:57:37.679096+0000","last_became_peered":"2024-09-15T23:57:37.679096+0000","last_unstale":"2024-09-15T23:57:37.685807+0000","last_undegraded":"2024-09-15T23:57:37.685807+0000","last_fullsized":"2024-09-15T23:57:37.685807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:22.349136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.655941+0000","last_change":"2024-09-15T23:57:36.667078+0000","last_active":"2024-09-15T23:57:37.655941+0000","last_peered":"2024-09-15T23:57:37.655941+0000","last_clean":"2024-09-15T23:57:37.655941+0000","last_became_active":"2024-09-15T23:57:36.666364+0000","last_became_peered":"2024-09-15T23:57:36.666364+0000","last_unstale":"2024-09-15T23:57:37.655941+0000","last_undegraded":"2024-09-15T23:57:37.655941+0000","last_fullsized":"2024-09-15T23:57:37.655941+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:01.137353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678653+0000","last_change":"2024-09-15T23:57:37.674439+0000","last_active":"2024-09-15T23:57:37.678653+0000","last_peered":"2024-09-15T23:57:37.678653+0000","last_clean":"2024-09-15T23:57:37.678653+0000","last_became_active":"2024-09-15T23:57:37.673615+0000","last_became_peered":"2024-09-15T23:57:37.673615+0000","last_unstale":"2024-09-15T23:57:37.678653+0000","last_undegraded":"2024-09-15T23:57:37.678653+0000","last_fullsized":"2024-09-15T23:57:37.678653+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:43.651533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665237+0000","last_change":"2024-09-15T23:57:36.673818+0000","last_active":"2024-09-15T23:57:37.665237+0000","last_peered":"2024-09-15T23:57:37.665237+0000","last_clean":"2024-09-15T23:57:37.665237+0000","last_became_active":"2024-09-15T23:57:36.673510+0000","last_became_peered":"2024-09-15T23:57:36.673510+0000","last_unstale":"2024-09-15T23:57:37.665237+0000","last_undegraded":"2024-09-15T23:57:37.665237+0000","last_fullsized":"2024-09-15T23:57:37.665237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:28.698279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690654+0000","last_change":"2024-09-15T23:57:37.680902+0000","last_active":"2024-09-15T23:57:37.690654+0000","last_peered":"2024-09-15T23:57:37.690654+0000","last_clean":"2024-09-15T23:57:37.690654+0000","last_became_active":"2024-09-15T23:57:37.679061+0000","last_became_peered":"2024-09-15T23:57:37.679061+0000","last_unstale":"2024-09-15T23:57:37.690654+0000","last_undegraded":"2024-09-15T23:57:37.690654+0000","last_fullsized":"2024-09-15T23:57:37.690654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:46.000532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690136+0000","last_change":"2024-09-15T23:57:36.665589+0000","last_active":"2024-09-15T23:57:37.690136+0000","last_peered":"2024-09-15T23:57:37.690136+0000","last_clean":"2024-09-15T23:57:37.690136+0000","last_became_active":"2024-09-15T23:57:36.664609+0000","last_became_peered":"2024-09-15T23:57:36.664609+0000","last_unstale":"2024-09-15T23:57:37.690136+0000","last_undegraded":"2024-09-15T23:57:37.690136+0000","last_fullsized":"2024-09-15T23:57:37.690136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:23.440586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692328+0000","last_change":"2024-09-15T23:57:37.688460+0000","last_active":"2024-09-15T23:57:37.692328+0000","last_peered":"2024-09-15T23:57:37.692328+0000","last_clean":"2024-09-15T23:57:37.692328+0000","last_became_active":"2024-09-15T23:57:37.688078+0000","last_became_peered":"2024-09-15T23:57:37.688078+0000","last_unstale":"2024-09-15T23:57:37.692328+0000","last_undegraded":"2024-09-15T23:57:37.692328+0000","last_fullsized":"2024-09-15T23:57:37.692328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:21.791774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"68'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.701777+0000","last_change":"2024-09-15T23:57:36.671808+0000","last_active":"2024-09-15T23:57:37.701777+0000","last_peered":"2024-09-15T23:57:37.701777+0000","last_clean":"2024-09-15T23:57:37.701777+0000","last_became_active":"2024-09-15T23:57:36.670946+0000","last_became_peered":"2024-09-15T23:57:36.670946+0000","last_unstale":"2024-09-15T23:57:37.701777+0000","last_undegraded":"2024-09-15T23:57:37.701777+0000","last_fullsized":"2024-09-15T23:57:37.701777+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:55:13.942806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669995+0000","last_change":"2024-09-15T23:57:37.668598+0000","last_active":"2024-09-15T23:57:37.669995+0000","last_peered":"2024-09-15T23:57:37.669995+0000","last_clean":"2024-09-15T23:57:37.669995+0000","last_became_active":"2024-09-15T23:57:37.668343+0000","last_became_peered":"2024-09-15T23:57:37.668343+0000","last_unstale":"2024-09-15T23:57:37.669995+0000","last_undegraded":"2024-09-15T23:57:37.669995+0000","last_fullsized":"2024-09-15T23:57:37.669995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:00.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690535+0000","last_change":"2024-09-15T23:57:36.663780+0000","last_active":"2024-09-15T23:57:37.690535+0000","last_peered":"2024-09-15T23:57:37.690535+0000","last_clean":"2024-09-15T23:57:37.690535+0000","last_became_active":"2024-09-15T23:57:36.663517+0000","last_became_peered":"2024-09-15T23:57:36.663517+0000","last_unstale":"2024-09-15T23:57:37.690535+0000","last_undegraded":"2024-09-15T23:57:37.690535+0000","last_fullsized":"2024-09-15T23:57:37.690535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:22.604725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686592+0000","last_change":"2024-09-15T23:57:37.680896+0000","last_active":"2024-09-15T23:57:37.686592+0000","last_peered":"2024-09-15T23:57:37.686592+0000","last_clean":"2024-09-15T23:57:37.686592+0000","last_became_active":"2024-09-15T23:57:37.680622+0000","last_became_peered":"2024-09-15T23:57:37.680622+0000","last_unstale":"2024-09-15T23:57:37.686592+0000","last_undegraded":"2024-09-15T23:57:37.686592+0000","last_fullsized":"2024-09-15T23:57:37.686592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:50.779635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662518+0000","last_change":"2024-09-15T23:57:36.667866+0000","last_active":"2024-09-15T23:57:37.662518+0000","last_peered":"2024-09-15T23:57:37.662518+0000","last_clean":"2024-09-15T23:57:37.662518+0000","last_became_active":"2024-09-15T23:57:36.667547+0000","last_became_peered":"2024-09-15T23:57:36.667547+0000","last_unstale":"2024-09-15T23:57:37.662518+0000","last_undegraded":"2024-09-15T23:57:37.662518+0000","last_fullsized":"2024-09-15T23:57:37.662518+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:54.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678442+0000","last_change":"2024-09-15T23:57:37.674206+0000","last_active":"2024-09-15T23:57:37.678442+0000","last_peered":"2024-09-15T23:57:37.678442+0000","last_clean":"2024-09-15T23:57:37.678442+0000","last_became_active":"2024-09-15T23:57:37.673776+0000","last_became_peered":"2024-09-15T23:57:37.673776+0000","last_unstale":"2024-09-15T23:57:37.678442+0000","last_undegraded":"2024-09-15T23:57:37.678442+0000","last_fullsized":"2024-09-15T23:57:37.678442+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:45:44.580922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665228+0000","last_change":"2024-09-15T23:57:36.667440+0000","last_active":"2024-09-15T23:57:37.665228+0000","last_peered":"2024-09-15T23:57:37.665228+0000","last_clean":"2024-09-15T23:57:37.665228+0000","last_became_active":"2024-09-15T23:57:36.667192+0000","last_became_peered":"2024-09-15T23:57:36.667192+0000","last_unstale":"2024-09-15T23:57:37.665228+0000","last_undegraded":"2024-09-15T23:57:37.665228+0000","last_fullsized":"2024-09-15T23:57:37.665228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:52.965694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669506+0000","last_change":"2024-09-15T23:57:37.668057+0000","last_active":"2024-09-15T23:57:37.669506+0000","last_peered":"2024-09-15T23:57:37.669506+0000","last_clean":"2024-09-15T23:57:37.669506+0000","last_became_active":"2024-09-15T23:57:37.667797+0000","last_became_peered":"2024-09-15T23:57:37.667797+0000","last_unstale":"2024-09-15T23:57:37.669506+0000","last_undegraded":"2024-09-15T23:57:37.669506+0000","last_fullsized":"2024-09-15T23:57:37.669506+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:18.894764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.697079+0000","last_change":"2024-09-15T23:57:36.668844+0000","last_active":"2024-09-15T23:57:37.697079+0000","last_peered":"2024-09-15T23:57:37.697079+0000","last_clean":"2024-09-15T23:57:37.697079+0000","last_became_active":"2024-09-15T23:57:36.668580+0000","last_became_peered":"2024-09-15T23:57:36.668580+0000","last_unstale":"2024-09-15T23:57:37.697079+0000","last_undegraded":"2024-09-15T23:57:37.697079+0000","last_fullsized":"2024-09-15T23:57:37.697079+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:28.036924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670024+0000","last_change":"2024-09-15T23:57:37.667851+0000","last_active":"2024-09-15T23:57:37.670024+0000","last_peered":"2024-09-15T23:57:37.670024+0000","last_clean":"2024-09-15T23:57:37.670024+0000","last_became_active":"2024-09-15T23:57:37.667358+0000","last_became_peered":"2024-09-15T23:57:37.667358+0000","last_unstale":"2024-09-15T23:57:37.670024+0000","last_undegraded":"2024-09-15T23:57:37.670024+0000","last_fullsized":"2024-09-15T23:57:37.670024+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:37.291613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695521+0000","last_change":"2024-09-15T23:57:36.663449+0000","last_active":"2024-09-15T23:57:37.695521+0000","last_peered":"2024-09-15T23:57:37.695521+0000","last_clean":"2024-09-15T23:57:37.695521+0000","last_became_active":"2024-09-15T23:57:36.663020+0000","last_became_peered":"2024-09-15T23:57:36.663020+0000","last_unstale":"2024-09-15T23:57:37.695521+0000","last_undegraded":"2024-09-15T23:57:37.695521+0000","last_fullsized":"2024-09-15T23:57:37.695521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:10.200753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690069+0000","last_change":"2024-09-15T23:57:37.686302+0000","last_active":"2024-09-15T23:57:37.690069+0000","last_peered":"2024-09-15T23:57:37.690069+0000","last_clean":"2024-09-15T23:57:37.690069+0000","last_became_active":"2024-09-15T23:57:37.685309+0000","last_became_peered":"2024-09-15T23:57:37.685309+0000","last_unstale":"2024-09-15T23:57:37.690069+0000","last_undegraded":"2024-09-15T23:57:37.690069+0000","last_fullsized":"2024-09-15T23:57:37.690069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:01.745112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695333+0000","last_change":"2024-09-15T23:57:36.669956+0000","last_active":"2024-09-15T23:57:37.695333+0000","last_peered":"2024-09-15T23:57:37.695333+0000","last_clean":"2024-09-15T23:57:37.695333+0000","last_became_active":"2024-09-15T23:57:36.669648+0000","last_became_peered":"2024-09-15T23:57:36.669648+0000","last_unstale":"2024-09-15T23:57:37.695333+0000","last_undegraded":"2024-09-15T23:57:37.695333+0000","last_fullsized":"2024-09-15T23:57:37.695333+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:58:38.729274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.670010+0000","last_change":"2024-09-15T23:57:37.667565+0000","last_active":"2024-09-15T23:57:37.670010+0000","last_peered":"2024-09-15T23:57:37.670010+0000","last_clean":"2024-09-15T23:57:37.670010+0000","last_became_active":"2024-09-15T23:57:37.666997+0000","last_became_peered":"2024-09-15T23:57:37.666997+0000","last_unstale":"2024-09-15T23:57:37.670010+0000","last_undegraded":"2024-09-15T23:57:37.670010+0000","last_fullsized":"2024-09-15T23:57:37.670010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:26.459308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.666478+0000","last_change":"2024-09-15T23:57:36.669990+0000","last_active":"2024-09-15T23:57:37.666478+0000","last_peered":"2024-09-15T23:57:37.666478+0000","last_clean":"2024-09-15T23:57:37.666478+0000","last_became_active":"2024-09-15T23:57:36.669698+0000","last_became_peered":"2024-09-15T23:57:36.669698+0000","last_unstale":"2024-09-15T23:57:37.666478+0000","last_undegraded":"2024-09-15T23:57:37.666478+0000","last_fullsized":"2024-09-15T23:57:37.666478+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:54.763616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686461+0000","last_change":"2024-09-15T23:57:37.684924+0000","last_active":"2024-09-15T23:57:37.686461+0000","last_peered":"2024-09-15T23:57:37.686461+0000","last_clean":"2024-09-15T23:57:37.686461+0000","last_became_active":"2024-09-15T23:57:37.684638+0000","last_became_peered":"2024-09-15T23:57:37.684638+0000","last_unstale":"2024-09-15T23:57:37.686461+0000","last_undegraded":"2024-09-15T23:57:37.686461+0000","last_fullsized":"2024-09-15T23:57:37.686461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:55.527185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.695836+0000","last_change":"2024-09-15T23:57:36.671443+0000","last_active":"2024-09-15T23:57:37.695836+0000","last_peered":"2024-09-15T23:57:37.695836+0000","last_clean":"2024-09-15T23:57:37.695836+0000","last_became_active":"2024-09-15T23:57:36.671150+0000","last_became_peered":"2024-09-15T23:57:36.671150+0000","last_unstale":"2024-09-15T23:57:37.695836+0000","last_undegraded":"2024-09-15T23:57:37.695836+0000","last_fullsized":"2024-09-15T23:57:37.695836+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:38.728544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692252+0000","last_change":"2024-09-15T23:57:37.687561+0000","last_active":"2024-09-15T23:57:37.692252+0000","last_peered":"2024-09-15T23:57:37.692252+0000","last_clean":"2024-09-15T23:57:37.692252+0000","last_became_active":"2024-09-15T23:57:37.687311+0000","last_became_peered":"2024-09-15T23:57:37.687311+0000","last_unstale":"2024-09-15T23:57:37.692252+0000","last_undegraded":"2024-09-15T23:57:37.692252+0000","last_fullsized":"2024-09-15T23:57:37.692252+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:02.938128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669719+0000","last_change":"2024-09-15T23:57:36.674175+0000","last_active":"2024-09-15T23:57:37.669719+0000","last_peered":"2024-09-15T23:57:37.669719+0000","last_clean":"2024-09-15T23:57:37.669719+0000","last_became_active":"2024-09-15T23:57:36.673894+0000","last_became_peered":"2024-09-15T23:57:36.673894+0000","last_unstale":"2024-09-15T23:57:37.669719+0000","last_undegraded":"2024-09-15T23:57:37.669719+0000","last_fullsized":"2024-09-15T23:57:37.669719+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:25.064385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692290+0000","last_change":"2024-09-15T23:57:37.687449+0000","last_active":"2024-09-15T23:57:37.692290+0000","last_peered":"2024-09-15T23:57:37.692290+0000","last_clean":"2024-09-15T23:57:37.692290+0000","last_became_active":"2024-09-15T23:57:37.687213+0000","last_became_peered":"2024-09-15T23:57:37.687213+0000","last_unstale":"2024-09-15T23:57:37.692290+0000","last_undegraded":"2024-09-15T23:57:37.692290+0000","last_fullsized":"2024-09-15T23:57:37.692290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:08.445713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.665373+0000","last_change":"2024-09-15T23:57:36.667900+0000","last_active":"2024-09-15T23:57:37.665373+0000","last_peered":"2024-09-15T23:57:37.665373+0000","last_clean":"2024-09-15T23:57:37.665373+0000","last_became_active":"2024-09-15T23:57:36.667651+0000","last_became_peered":"2024-09-15T23:57:36.667651+0000","last_unstale":"2024-09-15T23:57:37.665373+0000","last_undegraded":"2024-09-15T23:57:37.665373+0000","last_fullsized":"2024-09-15T23:57:37.665373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:25.642492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.685735+0000","last_change":"2024-09-15T23:57:37.677848+0000","last_active":"2024-09-15T23:57:37.685735+0000","last_peered":"2024-09-15T23:57:37.685735+0000","last_clean":"2024-09-15T23:57:37.685735+0000","last_became_active":"2024-09-15T23:57:37.677466+0000","last_became_peered":"2024-09-15T23:57:37.677466+0000","last_unstale":"2024-09-15T23:57:37.685735+0000","last_undegraded":"2024-09-15T23:57:37.685735+0000","last_fullsized":"2024-09-15T23:57:37.685735+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:16.609848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.666403+0000","last_change":"2024-09-15T23:57:36.662789+0000","last_active":"2024-09-15T23:57:37.666403+0000","last_peered":"2024-09-15T23:57:37.666403+0000","last_clean":"2024-09-15T23:57:37.666403+0000","last_became_active":"2024-09-15T23:57:36.662414+0000","last_became_peered":"2024-09-15T23:57:36.662414+0000","last_unstale":"2024-09-15T23:57:37.666403+0000","last_undegraded":"2024-09-15T23:57:37.666403+0000","last_fullsized":"2024-09-15T23:57:37.666403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:59.230885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669979+0000","last_change":"2024-09-15T23:57:37.667622+0000","last_active":"2024-09-15T23:57:37.669979+0000","last_peered":"2024-09-15T23:57:37.669979+0000","last_clean":"2024-09-15T23:57:37.669979+0000","last_became_active":"2024-09-15T23:57:37.667022+0000","last_became_peered":"2024-09-15T23:57:37.667022+0000","last_unstale":"2024-09-15T23:57:37.669979+0000","last_undegraded":"2024-09-15T23:57:37.669979+0000","last_fullsized":"2024-09-15T23:57:37.669979+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:23:16.048305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.689962+0000","last_change":"2024-09-15T23:57:36.666865+0000","last_active":"2024-09-15T23:57:37.689962+0000","last_peered":"2024-09-15T23:57:37.689962+0000","last_clean":"2024-09-15T23:57:37.689962+0000","last_became_active":"2024-09-15T23:57:36.664974+0000","last_became_peered":"2024-09-15T23:57:36.664974+0000","last_unstale":"2024-09-15T23:57:37.689962+0000","last_undegraded":"2024-09-15T23:57:37.689962+0000","last_fullsized":"2024-09-15T23:57:37.689962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.947340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686610+0000","last_change":"2024-09-15T23:57:37.681301+0000","last_active":"2024-09-15T23:57:37.686610+0000","last_peered":"2024-09-15T23:57:37.686610+0000","last_clean":"2024-09-15T23:57:37.686610+0000","last_became_active":"2024-09-15T23:57:37.680704+0000","last_became_peered":"2024-09-15T23:57:37.680704+0000","last_unstale":"2024-09-15T23:57:37.686610+0000","last_undegraded":"2024-09-15T23:57:37.686610+0000","last_fullsized":"2024-09-15T23:57:37.686610+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.884426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.654683+0000","last_change":"2024-09-15T23:57:36.665511+0000","last_active":"2024-09-15T23:57:37.654683+0000","last_peered":"2024-09-15T23:57:37.654683+0000","last_clean":"2024-09-15T23:57:37.654683+0000","last_became_active":"2024-09-15T23:57:36.665197+0000","last_became_peered":"2024-09-15T23:57:36.665197+0000","last_unstale":"2024-09-15T23:57:37.654683+0000","last_undegraded":"2024-09-15T23:57:37.654683+0000","last_fullsized":"2024-09-15T23:57:37.654683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:12.581058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686129+0000","last_change":"2024-09-15T23:57:37.679838+0000","last_active":"2024-09-15T23:57:37.686129+0000","last_peered":"2024-09-15T23:57:37.686129+0000","last_clean":"2024-09-15T23:57:37.686129+0000","last_became_active":"2024-09-15T23:57:37.678737+0000","last_became_peered":"2024-09-15T23:57:37.678737+0000","last_unstale":"2024-09-15T23:57:37.686129+0000","last_undegraded":"2024-09-15T23:57:37.686129+0000","last_fullsized":"2024-09-15T23:57:37.686129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:53.605947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662820+0000","last_change":"2024-09-15T23:57:36.671675+0000","last_active":"2024-09-15T23:57:37.662820+0000","last_peered":"2024-09-15T23:57:37.662820+0000","last_clean":"2024-09-15T23:57:37.662820+0000","last_became_active":"2024-09-15T23:57:36.671419+0000","last_became_peered":"2024-09-15T23:57:36.671419+0000","last_unstale":"2024-09-15T23:57:37.662820+0000","last_undegraded":"2024-09-15T23:57:37.662820+0000","last_fullsized":"2024-09-15T23:57:37.662820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:58.141472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.692347+0000","last_change":"2024-09-15T23:57:37.688850+0000","last_active":"2024-09-15T23:57:37.692347+0000","last_peered":"2024-09-15T23:57:37.692347+0000","last_clean":"2024-09-15T23:57:37.692347+0000","last_became_active":"2024-09-15T23:57:37.688591+0000","last_became_peered":"2024-09-15T23:57:37.688591+0000","last_unstale":"2024-09-15T23:57:37.692347+0000","last_undegraded":"2024-09-15T23:57:37.692347+0000","last_fullsized":"2024-09-15T23:57:37.692347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:33.769386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.668704+0000","last_change":"2024-09-15T23:57:36.670811+0000","last_active":"2024-09-15T23:57:37.668704+0000","last_peered":"2024-09-15T23:57:37.668704+0000","last_clean":"2024-09-15T23:57:37.668704+0000","last_became_active":"2024-09-15T23:57:36.670535+0000","last_became_peered":"2024-09-15T23:57:36.670535+0000","last_unstale":"2024-09-15T23:57:37.668704+0000","last_undegraded":"2024-09-15T23:57:37.668704+0000","last_fullsized":"2024-09-15T23:57:37.668704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:51.984554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679843+0000","last_change":"2024-09-15T23:57:37.674428+0000","last_active":"2024-09-15T23:57:37.679843+0000","last_peered":"2024-09-15T23:57:37.679843+0000","last_clean":"2024-09-15T23:57:37.679843+0000","last_became_active":"2024-09-15T23:57:37.674118+0000","last_became_peered":"2024-09-15T23:57:37.674118+0000","last_unstale":"2024-09-15T23:57:37.679843+0000","last_undegraded":"2024-09-15T23:57:37.679843+0000","last_fullsized":"2024-09-15T23:57:37.679843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:21.943015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.663643+0000","last_change":"2024-09-15T23:57:36.671194+0000","last_active":"2024-09-15T23:57:37.663643+0000","last_peered":"2024-09-15T23:57:37.663643+0000","last_clean":"2024-09-15T23:57:37.663643+0000","last_became_active":"2024-09-15T23:57:36.670975+0000","last_became_peered":"2024-09-15T23:57:36.670975+0000","last_unstale":"2024-09-15T23:57:37.663643+0000","last_undegraded":"2024-09-15T23:57:37.663643+0000","last_fullsized":"2024-09-15T23:57:37.663643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:19.420294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.687578+0000","last_change":"2024-09-15T23:57:37.679444+0000","last_active":"2024-09-15T23:57:37.687578+0000","last_peered":"2024-09-15T23:57:37.687578+0000","last_clean":"2024-09-15T23:57:37.687578+0000","last_became_active":"2024-09-15T23:57:37.678592+0000","last_became_peered":"2024-09-15T23:57:37.678592+0000","last_unstale":"2024-09-15T23:57:37.687578+0000","last_undegraded":"2024-09-15T23:57:37.687578+0000","last_fullsized":"2024-09-15T23:57:37.687578+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:34.640710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.669617+0000","last_change":"2024-09-15T23:57:36.674148+0000","last_active":"2024-09-15T23:57:37.669617+0000","last_peered":"2024-09-15T23:57:37.669617+0000","last_clean":"2024-09-15T23:57:37.669617+0000","last_became_active":"2024-09-15T23:57:36.673617+0000","last_became_peered":"2024-09-15T23:57:36.673617+0000","last_unstale":"2024-09-15T23:57:37.669617+0000","last_undegraded":"2024-09-15T23:57:37.669617+0000","last_fullsized":"2024-09-15T23:57:37.669617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:40.682828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.678721+0000","last_change":"2024-09-15T23:57:37.674310+0000","last_active":"2024-09-15T23:57:37.678721+0000","last_peered":"2024-09-15T23:57:37.678721+0000","last_clean":"2024-09-15T23:57:37.678721+0000","last_became_active":"2024-09-15T23:57:37.673414+0000","last_became_peered":"2024-09-15T23:57:37.673414+0000","last_unstale":"2024-09-15T23:57:37.678721+0000","last_undegraded":"2024-09-15T23:57:37.678721+0000","last_fullsized":"2024-09-15T23:57:37.678721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:07.789009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.654590+0000","last_change":"2024-09-15T23:57:36.663753+0000","last_active":"2024-09-15T23:57:37.654590+0000","last_peered":"2024-09-15T23:57:37.654590+0000","last_clean":"2024-09-15T23:57:37.654590+0000","last_became_active":"2024-09-15T23:57:36.663466+0000","last_became_peered":"2024-09-15T23:57:36.663466+0000","last_unstale":"2024-09-15T23:57:37.654590+0000","last_undegraded":"2024-09-15T23:57:37.654590+0000","last_fullsized":"2024-09-15T23:57:37.654590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.070424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.679291+0000","last_change":"2024-09-15T23:57:37.675325+0000","last_active":"2024-09-15T23:57:37.679291+0000","last_peered":"2024-09-15T23:57:37.679291+0000","last_clean":"2024-09-15T23:57:37.679291+0000","last_became_active":"2024-09-15T23:57:37.675044+0000","last_became_peered":"2024-09-15T23:57:37.675044+0000","last_unstale":"2024-09-15T23:57:37.679291+0000","last_undegraded":"2024-09-15T23:57:37.679291+0000","last_fullsized":"2024-09-15T23:57:37.679291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:23.881324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.662498+0000","last_change":"2024-09-15T23:57:36.672146+0000","last_active":"2024-09-15T23:57:37.662498+0000","last_peered":"2024-09-15T23:57:37.662498+0000","last_clean":"2024-09-15T23:57:37.662498+0000","last_became_active":"2024-09-15T23:57:36.671502+0000","last_became_peered":"2024-09-15T23:57:36.671502+0000","last_unstale":"2024-09-15T23:57:37.662498+0000","last_undegraded":"2024-09-15T23:57:37.662498+0000","last_fullsized":"2024-09-15T23:57:37.662498+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:41.339431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.686332+0000","last_change":"2024-09-15T23:57:37.681083+0000","last_active":"2024-09-15T23:57:37.686332+0000","last_peered":"2024-09-15T23:57:37.686332+0000","last_clean":"2024-09-15T23:57:37.686332+0000","last_became_active":"2024-09-15T23:57:37.680648+0000","last_became_peered":"2024-09-15T23:57:37.680648+0000","last_unstale":"2024-09-15T23:57:37.686332+0000","last_undegraded":"2024-09-15T23:57:37.686332+0000","last_fullsized":"2024-09-15T23:57:37.686332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:36.644894+0000","last_clean_scrub_stamp":"2024-09-15T23:57:36.644894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:22:50.476385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.690004+0000","last_change":"2024-09-15T23:57:36.665518+0000","last_active":"2024-09-15T23:57:37.690004+0000","last_peered":"2024-09-15T23:57:37.690004+0000","last_clean":"2024-09-15T23:57:37.690004+0000","last_became_active":"2024-09-15T23:57:36.664275+0000","last_became_peered":"2024-09-15T23:57:36.664275+0000","last_unstale":"2024-09-15T23:57:37.690004+0000","last_undegraded":"2024-09-15T23:57:37.690004+0000","last_fullsized":"2024-09-15T23:57:37.690004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:57:35.642319+0000","last_clean_scrub_stamp":"2024-09-15T23:57:35.642319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:41.751650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"61'152","reported_seq":439,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-15T23:57:37.653789+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:37.653789+0000","last_peered":"2024-09-15T23:57:37.653789+0000","last_clean":"2024-09-15T23:57:37.653789+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:37.653789+0000","last_undegraded":"2024-09-15T23:57:37.653789+0000","last_fullsized":"2024-09-15T23:57:37.653789+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":626688,"data_stored":246791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1228800,"data_stored":841624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1220608,"data_stored":837159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:40.921 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:57:40.922 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:57:41.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.063+0000 7f91c3e37640 1 Processor -- start 2024-09-15T23:57:41.064 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.063+0000 7f91c3e37640 1 -- start start 2024-09-15T23:57:41.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c3e37640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f91bc0a7140 0x7f91bc0a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c3e37640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91bc0a6d10 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.065 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c3e37640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f91bc06e230 con 0x7f91bc0a7140 2024-09-15T23:57:41.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c1bd3640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f91bc0a7140 0x7f91bc0a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c13d2640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f91bc0a4ab0 0x7f91bc139bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33962/0 (socket says 172.21.15.121:33962) 2024-09-15T23:57:41.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c13d2640 1 -- 172.21.15.121:0/2148459203 learned_addr learned my addr 172.21.15.121:0/2148459203 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:41.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c1bd3640 1 -- 172.21.15.121:0/2148459203 >> v1:172.21.15.121:6789/0 conn(0x7f91bc0a4ab0 legacy=0x7f91bc139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.064+0000 7f91c1bd3640 1 -- 172.21.15.121:0/2148459203 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc0a3ae0 con 0x7f91bc0a7140 2024-09-15T23:57:41.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.065+0000 7f91c1bd3640 1 --2- 172.21.15.121:0/2148459203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a7140 0x7f91bc0a7520 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31741a20b8f1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.065+0000 7f91c0bd1640 1 -- 172.21.15.121:0/2148459203 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ac007670 con 0x7f91bc0a7140 2024-09-15T23:57:41.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.065+0000 7f91c0bd1640 1 -- 172.21.15.121:0/2148459203 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac007810 con 0x7f91bc0a7140 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.065+0000 7f91c0bd1640 1 -- 172.21.15.121:0/2148459203 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ac007b10 con 0x7f91bc0a7140 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 -- 172.21.15.121:0/2148459203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a7140 msgr2=0x7f91bc0a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 --2- 172.21.15.121:0/2148459203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a7140 0x7f91bc0a7520 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac02a660 comp rx=0 tx=0).stop 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 -- 172.21.15.121:0/2148459203 shutdown_connections 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 --2- 172.21.15.121:0/2148459203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a7140 0x7f91bc0a7520 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 -- 172.21.15.121:0/2148459203 >> 172.21.15.121:0/2148459203 conn(0x7f91bc0ac370 msgr2=0x7f91bc0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 -- 172.21.15.121:0/2148459203 shutdown_connections 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.066+0000 7f91c3e37640 1 -- 172.21.15.121:0/2148459203 wait complete. 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c3e37640 1 Processor -- start 2024-09-15T23:57:41.068 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c3e37640 1 -- start start 2024-09-15T23:57:41.070 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c3e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c3e37640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc0a7fc0 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c1bd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c1bd3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47718/0 (socket says 172.21.15.121:47718) 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c1bd3640 1 -- 172.21.15.121:0/1658002046 learned_addr learned my addr 172.21.15.121:0/1658002046 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.067+0000 7f91c1bd3640 1 -- 172.21.15.121:0/1658002046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc124ed0 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91c1bd3640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ac040070 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac031b10 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ac031df0 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc124780 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.068+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc122c20 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f91ac039040 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc13a380 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91ba7fc640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 0x7f91a803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f91ac02ae00 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91c13d2640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 0x7f91a803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.069+0000 7f91c13d2640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 0x7f91a803a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b0007ac0 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.074+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91bc124ed0 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.304+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f91bc0abf70 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.305+0000 7f91ba7fc640 1 -- 172.21.15.121:0/1658002046 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f91ac04de10 con 0x7f91bc0a4ab0 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stdout:[client.0] 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stdout: key = AQC8c+dmNaKsGxAANggrRUnAp0Uqx9WOrGBVYg== 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stdout: caps mds = "allow" 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stdout: caps mon = "allow r" 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:57:41.306 INFO:teuthology.orchestra.run.smithi121.stderr:updated caps for client.0 2024-09-15T23:57:41.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 msgr2=0x7f91a803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 0x7f91a803a760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f91b0007fd0 tx=0x7f91b0007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 msgr2=0x7f91bc0a10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac004a40 comp rx=0 tx=0).stop 2024-09-15T23:57:41.308 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 shutdown_connections 2024-09-15T23:57:41.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f91a80382a0 0x7f91a803a760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 --2- 172.21.15.121:0/1658002046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91bc0a4ab0 0x7f91bc0a10b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 >> 172.21.15.121:0/1658002046 conn(0x7f91bc0ac370 msgr2=0x7f91bc139630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 shutdown_connections 2024-09-15T23:57:41.309 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.307+0000 7f91c3e37640 1 -- 172.21.15.121:0/1658002046 wait complete. 2024-09-15T23:57:41.319 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:41.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.416+0000 7f3be0680640 1 Processor -- start 2024-09-15T23:57:41.417 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.416+0000 7f3be0680640 1 -- start start 2024-09-15T23:57:41.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3be0680640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3bd813a220 0x7f3bd813a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3be0680640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd809f2f0 con 0x7f3bd80a1c80 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3be0680640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd80a07d0 con 0x7f3bd813a220 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bde41c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3bd813a220 0x7f3bd813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bddc1b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f3bd80a1c80 0x7f3bd8136450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33972/0 (socket says 172.21.15.121:33972) 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bddc1b640 1 -- 172.21.15.121:0/1174164540 learned_addr learned my addr 172.21.15.121:0/1174164540 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bde41c640 1 -- 172.21.15.121:0/1174164540 >> v1:172.21.15.121:6789/0 conn(0x7f3bd80a1c80 legacy=0x7f3bd8136450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bdd41a640 1 -- 172.21.15.121:0/1174164540 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251573333 0 0) 0x7f3bcc001110 con 0x7f3bd80a1c80 2024-09-15T23:57:41.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.417+0000 7f3bde41c640 1 -- 172.21.15.121:0/1174164540 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd8139dd0 con 0x7f3bd813a220 2024-09-15T23:57:41.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.418+0000 7f3bde41c640 1 --2- 172.21.15.121:0/1174164540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd813a220 0x7f3bd813a600 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009720 tx=0x7f3bd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ee250853cb7d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.418+0000 7f3bdd41a640 1 -- 172.21.15.121:0/1174164540 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd0037070 con 0x7f3bd813a220 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.418+0000 7f3bdd41a640 1 -- 172.21.15.121:0/1174164540 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd002ad90 con 0x7f3bd813a220 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.418+0000 7f3bdd41a640 1 -- 172.21.15.121:0/1174164540 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd0032590 con 0x7f3bd813a220 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 -- 172.21.15.121:0/1174164540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd813a220 msgr2=0x7f3bd813a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 --2- 172.21.15.121:0/1174164540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd813a220 0x7f3bd813a600 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009720 tx=0x7f3bd002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 -- 172.21.15.121:0/1174164540 shutdown_connections 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 --2- 172.21.15.121:0/1174164540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd813a220 0x7f3bd813a600 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 -- 172.21.15.121:0/1174164540 >> 172.21.15.121:0/1174164540 conn(0x7f3bd806d820 msgr2=0x7f3bd806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 -- 172.21.15.121:0/1174164540 shutdown_connections 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.419+0000 7f3be0680640 1 -- 172.21.15.121:0/1174164540 wait complete. 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3be0680640 1 Processor -- start 2024-09-15T23:57:41.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3be0680640 1 -- start start 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3be0680640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3be0680640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8139a20 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3bde41c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3bde41c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47736/0 (socket says 172.21.15.121:47736) 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.420+0000 7f3bde41c640 1 -- 172.21.15.121:0/3867784832 learned_addr learned my addr 172.21.15.121:0/3867784832 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3bde41c640 1 -- 172.21.15.121:0/3867784832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80aa370 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3bde41c640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0035040 tx=0x7f3bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd0037040 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd0004030 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd80a97e0 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bd0004350 con 0x7f3bd80a1c80 2024-09-15T23:57:41.424 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.421+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd80a7930 con 0x7f3bd80a1c80 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.422+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f3bd003a040 con 0x7f3bd80a1c80 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.422+0000 7f3bd6ffd640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 0x7f3bc403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.422+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f3bd006bc20 con 0x7f3bd80a1c80 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.422+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd80a0100 con 0x7f3bd80a1c80 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.422+0000 7f3bddc1b640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 0x7f3bc403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.425 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.423+0000 7f3bddc1b640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 0x7f3bc403a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc001310 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.427+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bd0042020 con 0x7f3bd80a1c80 2024-09-15T23:57:41.626 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.626+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bd80a1200 con 0x7f3bd80a1c80 2024-09-15T23:57:41.627 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.626+0000 7f3bd6ffd640 1 -- 172.21.15.121:0/3867784832 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7f3bd0003610 con 0x7f3bd80a1c80 2024-09-15T23:57:41.627 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:41.627 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:41.628 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 msgr2=0x7f3bc403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 0x7f3bc403a760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc001310 comp rx=0 tx=0).stop 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 msgr2=0x7f3bd80a6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0035040 tx=0x7f3bd00046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 shutdown_connections 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f3bc40382a0 0x7f3bc403a760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.629 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 --2- 172.21.15.121:0/3867784832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bd80a1c80 0x7f3bd80a6020 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 >> 172.21.15.121:0/3867784832 conn(0x7f3bd806d820 msgr2=0x7f3bd81345f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 shutdown_connections 2024-09-15T23:57:41.630 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.628+0000 7f3be0680640 1 -- 172.21.15.121:0/3867784832 wait complete. 2024-09-15T23:57:41.841 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:57:36.988513+0000', 'modified': '2024-09-15T23:57:38.982688+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4990}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4990': {'gid': 4990, 'name': 'b', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.121:6827/3145309006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6826', 'nonce': 3145309006}, {'type': 'v1', 'addr': '172.21.15.121:6827', 'nonce': 3145309006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4990, 'qdb_cluster': [4990]} 2024-09-15T23:57:41.841 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:57:41.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T23:57:41.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.941+0000 7fd823642640 1 Processor -- start 2024-09-15T23:57:41.942 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.941+0000 7fd823642640 1 -- start start 2024-09-15T23:57:41.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd823642640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd81c0a4c20 0x7fd81c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd823642640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81c13a080 con 0x7fd81c13a280 2024-09-15T23:57:41.943 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd823642640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd81c0a3d50 con 0x7fd81c0a4c20 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd820bdd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd81c0a4c20 0x7fd81c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd8213de640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd81c13a280 0x7fd81c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33986/0 (socket says 172.21.15.121:33986) 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd8213de640 1 -- 172.21.15.121:0/3376558662 learned_addr learned my addr 172.21.15.121:0/3376558662 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd820bdd640 1 -- 172.21.15.121:0/3376558662 >> v1:172.21.15.121:6789/0 conn(0x7fd81c13a280 legacy=0x7fd81c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd81bfff640 1 -- 172.21.15.121:0/3376558662 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275913535 0 0) 0x7fd81c13a080 con 0x7fd81c13a280 2024-09-15T23:57:41.944 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.942+0000 7fd820bdd640 1 -- 172.21.15.121:0/3376558662 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c0a3f80 con 0x7fd81c0a4c20 2024-09-15T23:57:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.943+0000 7fd820bdd640 1 --2- 172.21.15.121:0/3376558662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c13f060 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd810009720 tx=0x7fd81002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7281c959838ebe12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.943+0000 7fd81bfff640 1 -- 172.21.15.121:0/3376558662 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd810037070 con 0x7fd81c0a4c20 2024-09-15T23:57:41.945 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.943+0000 7fd81bfff640 1 -- 172.21.15.121:0/3376558662 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81002ad90 con 0x7fd81c0a4c20 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.943+0000 7fd81bfff640 1 -- 172.21.15.121:0/3376558662 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd810032590 con 0x7fd81c0a4c20 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 -- 172.21.15.121:0/3376558662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 msgr2=0x7fd81c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 --2- 172.21.15.121:0/3376558662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c13f060 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd810009720 tx=0x7fd81002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 -- 172.21.15.121:0/3376558662 shutdown_connections 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 --2- 172.21.15.121:0/3376558662 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c13f060 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 -- 172.21.15.121:0/3376558662 >> 172.21.15.121:0/3376558662 conn(0x7fd81c0ac3e0 msgr2=0x7fd81c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 -- 172.21.15.121:0/3376558662 shutdown_connections 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.944+0000 7fd823642640 1 -- 172.21.15.121:0/3376558662 wait complete. 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd823642640 1 Processor -- start 2024-09-15T23:57:41.946 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd823642640 1 -- start start 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd823642640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd823642640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c0a7ec0 con 0x7fd81c0a4c20 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47756/0 (socket says 172.21.15.121:47756) 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.945+0000 7fd8213de640 1 -- 172.21.15.121:0/3053084047 learned_addr learned my addr 172.21.15.121:0/3053084047 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd8213de640 1 -- 172.21.15.121:0/3053084047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c0a2a70 con 0x7fd81c0a4c20 2024-09-15T23:57:41.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd8213de640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd81400c420 tx=0x7fd81400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd819ffb640 1 -- 172.21.15.121:0/3053084047 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd814018070 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd819ffb640 1 -- 172.21.15.121:0/3053084047 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8140074d0 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81c09f760 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd819ffb640 1 -- 172.21.15.121:0/3053084047 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd814004950 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.946+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c09f480 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.947+0000 7fd819ffb640 1 -- 172.21.15.121:0/3053084047 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fd81401b070 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.947+0000 7fd819ffb640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 0x7fd80803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.947+0000 7fd819ffb640 1 -- 172.21.15.121:0/3053084047 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fd81404a5b0 con 0x7fd81c0a4c20 2024-09-15T23:57:41.949 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.947+0000 7fd820bdd640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 0x7fd80803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.948+0000 7fd820bdd640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 0x7fd80803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd810034000 tx=0x7fd81002e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8263d1740 1 Processor -- start 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8263d1740 1 -- start start 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8263d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8263d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a956aae520 con 0x55a956b6c4e0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47760/0 (socket says 172.21.15.121:47760) 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.949+0000 7fd8213de640 1 -- 172.21.15.121:0/2837892091 learned_addr learned my addr 172.21.15.121:0/2837892091 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8213de640 1 -- 172.21.15.121:0/2837892091 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a956a712f0 con 0x55a956b6c4e0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8213de640 1 --2- 172.21.15.121:0/2837892091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd814011fd0 tx=0x7fd81401a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e3998b355f3b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd802ffd640 1 -- 172.21.15.121:0/2837892091 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81403c070 con 0x55a956b6c4e0 2024-09-15T23:57:41.951 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd802ffd640 1 -- 172.21.15.121:0/2837892091 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd814004e00 con 0x55a956b6c4e0 2024-09-15T23:57:41.952 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd802ffd640 1 -- 172.21.15.121:0/2837892091 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81401ca20 con 0x55a956b6c4e0 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 -- 172.21.15.121:0/2837892091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 msgr2=0x55a956b66f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2837892091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd814011fd0 tx=0x7fd81401a380 comp rx=0 tx=0).stop 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 -- 172.21.15.121:0/2837892091 shutdown_connections 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2837892091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b66f10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 -- 172.21.15.121:0/2837892091 >> 172.21.15.121:0/2837892091 conn(0x55a956b491d0 msgr2=0x55a956b49f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 -- 172.21.15.121:0/2837892091 shutdown_connections 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.950+0000 7fd8263d1740 1 -- 172.21.15.121:0/2837892091 wait complete. 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.951+0000 7fd8263d1740 1 -- start start 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.951+0000 7fd8263d1740 1 Processor -- start 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.951+0000 7fd8263d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8263d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a956aaa4e0 con 0x55a956b6c4e0 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8263d1740 10 client.0 _ll_register_callbacks cb 0x55a9567c0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:41.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47762/0 (socket says 172.21.15.121:47762) 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8213de640 1 -- 172.21.15.121:0/2575500578 learned_addr learned my addr 172.21.15.121:0/2575500578 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8213de640 1 -- 172.21.15.121:0/2575500578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9567c12d0 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8213de640 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd8140483a0 tx=0x7fd814046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47877348fd5bd1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81403c050 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fd814011360 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd814004e00 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd814011560 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8263d1740 10 client.5043 fetch_fsmap learned FSMap version 36 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55a95688b6b0 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd814004e00 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.952+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 36) ==== 2292+0+0 (secure 0 0 0) 0x7fd81403ece0 con 0x55a956b6c4e0 2024-09-15T23:57:41.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 10 client.5043 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 10 client.5043 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 20 client.5043 populate_metadata read hostname 'smithi121' 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b78d50 0x55a956b7b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 4 client.5043 mds_command: new command op to 4990 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 --> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a956abbc50 con 0x55a956b78d50 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd820bdd640 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b78d50 0x55a956b7b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd820bdd640 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b78d50 0x55a956b7b560 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a97262d683ba4c3 server_cookie=d2819057a653e835 in_seq=0 out_seq=0 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.953+0000 7fd7fbfff640 10 client.5043 ms_handle_connect on v2:172.21.15.121:6826/3145309006 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd7fbfff640 1 -- 172.21.15.121:0/2575500578 <== mds.0 v2:172.21.15.121:6826/3145309006 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a956abbc50 con 0x55a956b78d50 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd7fbfff640 10 client.5043 handle_command_reply: tid=0 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 client.5043 shutdown 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 msgr2=0x55a956b71cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd8140483a0 tx=0x7fd814046000 comp rx=0 tx=0).stop 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 shutdown_connections 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b78d50 0x55a956b7b560 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 --2- 172.21.15.121:0/2575500578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b71cc0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd7fbfff640 0 client.5043 ms_handle_reset on v2:172.21.15.121:6826/3145309006 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 >> 172.21.15.121:0/2575500578 conn(0x55a956b491d0 msgr2=0x55a956b66b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 shutdown_connections 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 1 -- 172.21.15.121:0/2575500578 wait complete. 2024-09-15T23:57:41.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.954+0000 7fd8263d1740 20 client.5043 trim_cache size 0 max 16384 2024-09-15T23:57:41.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8263d1740 1 Processor -- start 2024-09-15T23:57:41.972 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8263d1740 1 -- start start 2024-09-15T23:57:41.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8263d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8263d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1cf240 con 0x55a956b6c4e0 2024-09-15T23:57:41.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47764/0 (socket says 172.21.15.121:47764) 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8213de640 1 -- 172.21.15.121:0/1688713150 learned_addr learned my addr 172.21.15.121:0/1688713150 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8213de640 1 -- 172.21.15.121:0/1688713150 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a956b726f0 con 0x55a956b6c4e0 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.972+0000 7fd8213de640 1 --2- 172.21.15.121:0/1688713150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd81401ad00 tx=0x7fd814040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1782d6cebfbe5e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8027fc640 1 -- 172.21.15.121:0/1688713150 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd814035070 con 0x55a956b6c4e0 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8027fc640 1 -- 172.21.15.121:0/1688713150 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81401a6b0 con 0x55a956b6c4e0 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8027fc640 1 -- 172.21.15.121:0/1688713150 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81403c050 con 0x55a956b6c4e0 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 -- 172.21.15.121:0/1688713150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 msgr2=0x55a956b6e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 --2- 172.21.15.121:0/1688713150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd81401ad00 tx=0x7fd814040070 comp rx=0 tx=0).stop 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 -- 172.21.15.121:0/1688713150 shutdown_connections 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 --2- 172.21.15.121:0/1688713150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956b6c4e0 0x55a956b6e870 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 -- 172.21.15.121:0/1688713150 >> 172.21.15.121:0/1688713150 conn(0x55a956b491d0 msgr2=0x55a956b42060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 -- 172.21.15.121:0/1688713150 shutdown_connections 2024-09-15T23:57:41.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.973+0000 7fd8263d1740 1 -- 172.21.15.121:0/1688713150 wait complete. 2024-09-15T23:57:41.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8263d1740 1 -- start start 2024-09-15T23:57:41.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8263d1740 1 Processor -- start 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8263d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8263d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a956a563e0 con 0x55a956be4f70 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8263d1740 10 client.0 _ll_register_callbacks cb 0x7fd81401a9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8213de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47776/0 (socket says 172.21.15.121:47776) 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.974+0000 7fd8213de640 1 -- 172.21.15.121:0/621758439 learned_addr learned my addr 172.21.15.121:0/621758439 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8213de640 1 -- 172.21.15.121:0/621758439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a956b861f0 con 0x55a956be4f70 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8213de640 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd814004b40 tx=0x7fd814039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927666acecc6553 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:41.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd81403c070 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mon.0 v2:172.21.15.121:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fd814011700 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81401a6b0 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd814050050 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 10 client.5045 fetch_fsmap learned FSMap version 36 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55a956b861f0 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mon.0 v2:172.21.15.121:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd81401a6b0 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mon.0 v2:172.21.15.121:3300/0 5 ==== fsmap(e 36) ==== 2292+0+0 (secure 0 0 0) 0x7fd81404a800 con 0x55a956be4f70 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 10 client.5045 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 10 client.5045 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 20 client.5045 populate_metadata read hostname 'smithi121' 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b82b80 0x55a956b82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:41.980 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 4 client.5045 mds_command: new command op to 4990 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 --> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] -- command(tid 0: {"prefix": "status"}) -- 0x55a956ab5fa0 con 0x55a956b82b80 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.975+0000 7fd820bdd640 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b82b80 0x55a956b82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd7fbfff640 10 client.5045 ms_handle_connect on v2:172.21.15.121:6826/3145309006 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd820bdd640 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b82b80 0x55a956b82fc0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c182db4fe6340fa server_cookie=7e00422a8df0eaec in_seq=0 out_seq=0 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd7fbfff640 1 -- 172.21.15.121:0/621758439 <== mds.0 v2:172.21.15.121:6826/3145309006 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a956ab5fa0 con 0x55a956b82b80 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd7fbfff640 10 client.5045 handle_command_reply: tid=0 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 client.5045 shutdown 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 msgr2=0x55a956b85ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd814004b40 tx=0x7fd814039000 comp rx=0 tx=0).stop 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 shutdown_connections 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:6826/3145309006,v1:172.21.15.121:6827/3145309006] conn(0x55a956b82b80 0x55a956b82fc0 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 --2- 172.21.15.121:0/621758439 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a956be4f70 0x55a956b85ba0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd7fbfff640 0 client.5045 ms_handle_reset on v2:172.21.15.121:6826/3145309006 2024-09-15T23:57:41.981 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 >> 172.21.15.121:0/621758439 conn(0x55a956b491d0 msgr2=0x55a956b65900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 shutdown_connections 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 1 -- 172.21.15.121:0/621758439 wait complete. 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.976+0000 7fd8263d1740 20 client.5045 trim_cache size 0 max 16384 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "cluster_fsid": "822f5905-71ec-4c9e-8017-14fcc3976ad1", 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "whoami": 0, 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 4990, 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "want_state": "up:active", 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "state": "up:active", 2024-09-15T23:57:41.982 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs", 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout: "rank_uptime": 4.3190956700000003, 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout: "mdsmap_epoch": 36, 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch": 69, 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_epoch_barrier": 69, 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout: "uptime": 8.3891272870000009 2024-09-15T23:57:41.983 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 msgr2=0x7fd80803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 0x7fd80803a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd810034000 tx=0x7fd81002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 msgr2=0x7fd81c0a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd81400c420 tx=0x7fd81400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 shutdown_connections 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd8080382a0 0x7fd80803a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 --2- 172.21.15.121:0/3053084047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd81c0a4c20 0x7fd81c0a1d10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 >> 172.21.15.121:0/3053084047 conn(0x7fd81c0ac3e0 msgr2=0x7fd81c0a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 shutdown_connections 2024-09-15T23:57:41.984 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:41.977+0000 7fd823642640 1 -- 172.21.15.121:0/3053084047 wait complete. 2024-09-15T23:57:41.988 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:42.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0ea111640 1 Processor -- start 2024-09-15T23:57:42.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0ea111640 1 -- start start 2024-09-15T23:57:42.086 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0ea111640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe0e40a39c0 0x7fe0e40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0ea111640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40a16c0 con 0x7fe0e4132f30 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0ea111640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e40a1490 con 0x7fe0e40a39c0 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0e37fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe0e40a39c0 0x7fe0e40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0dbfff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe0e4132f30 0x7fe0e4133330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:33994/0 (socket says 172.21.15.121:33994) 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.085+0000 7fe0dbfff640 1 -- 172.21.15.121:0/703284568 learned_addr learned my addr 172.21.15.121:0/703284568 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e37fe640 1 -- 172.21.15.121:0/703284568 >> v1:172.21.15.121:6789/0 conn(0x7fe0e4132f30 legacy=0x7fe0e4133330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e37fe640 1 -- 172.21.15.121:0/703284568 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e40a4010 con 0x7fe0e40a39c0 2024-09-15T23:57:42.087 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e2ffd640 1 -- 172.21.15.121:0/703284568 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656801265 0 0) 0x7fe0e40a16c0 con 0x7fe0e4132f30 2024-09-15T23:57:42.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e37fe640 1 --2- 172.21.15.121:0/703284568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e40a51c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009720 tx=0x7fe0d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbba3c169098b659 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e2ffd640 1 -- 172.21.15.121:0/703284568 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x7fe0e40a39c0 2024-09-15T23:57:42.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e2ffd640 1 -- 172.21.15.121:0/703284568 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d402ad90 con 0x7fe0e40a39c0 2024-09-15T23:57:42.088 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.086+0000 7fe0e2ffd640 1 -- 172.21.15.121:0/703284568 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4032590 con 0x7fe0e40a39c0 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 -- 172.21.15.121:0/703284568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 msgr2=0x7fe0e40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 --2- 172.21.15.121:0/703284568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e40a51c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009720 tx=0x7fe0d402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 -- 172.21.15.121:0/703284568 shutdown_connections 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 --2- 172.21.15.121:0/703284568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e40a51c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 -- 172.21.15.121:0/703284568 >> 172.21.15.121:0/703284568 conn(0x7fe0e40a85e0 msgr2=0x7fe0e40a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 -- 172.21.15.121:0/703284568 shutdown_connections 2024-09-15T23:57:42.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.087+0000 7fe0ea111640 1 -- 172.21.15.121:0/703284568 wait complete. 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.088+0000 7fe0ea111640 1 Processor -- start 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.088+0000 7fe0ea111640 1 -- start start 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.088+0000 7fe0ea111640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.088+0000 7fe0ea111640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e40a3da0 con 0x7fe0e40a39c0 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.088+0000 7fe0e37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47800/0 (socket says 172.21.15.121:47800) 2024-09-15T23:57:42.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e37fe640 1 -- 172.21.15.121:0/1168415919 learned_addr learned my addr 172.21.15.121:0/1168415919 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e37fe640 1 -- 172.21.15.121:0/1168415919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e4137b40 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e37fe640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4035040 tx=0x7fe0d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4037040 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d4004160 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4004440 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e4070f40 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.089+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e4071200 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.090+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7fe0d4003610 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.090+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e406fcc0 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.090+0000 7fe0e0ff9640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 0x7fe0c403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.090+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fe0d406c3e0 con 0x7fe0e40a39c0 2024-09-15T23:57:42.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.090+0000 7fe0dbfff640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 0x7fe0c403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:42.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.091+0000 7fe0dbfff640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 0x7fe0c403a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc007a40 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:42.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.095+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0d403be20 con 0x7fe0e40a39c0 2024-09-15T23:57:42.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.295+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe0e40a22d0 con 0x7fe0e40a39c0 2024-09-15T23:57:42.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.296+0000 7fe0e0ff9640 1 -- 172.21.15.121:0/1168415919 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7fe0d403ec70 con 0x7fe0e40a39c0 2024-09-15T23:57:42.297 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 msgr2=0x7fe0c403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 0x7fe0c403a760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc000c00 tx=0x7fe0cc007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 msgr2=0x7fe0e406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4035040 tx=0x7fe0d40046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 shutdown_connections 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe0c40382a0 0x7fe0c403a760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.299 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 --2- 172.21.15.121:0/1168415919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0e40a39c0 0x7fe0e406e950 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:42.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 >> 172.21.15.121:0/1168415919 conn(0x7fe0e40a85e0 msgr2=0x7fe0e40a6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:42.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 shutdown_connections 2024-09-15T23:57:42.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42.298+0000 7fe0ea111640 1 -- 172.21.15.121:0/1168415919 wait complete. 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:42.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:42.311 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:42.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.311 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:42.327 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42670sec preferred_lft 42670sec 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.328 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:42.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.329 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:42.390 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:57:42.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.391 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:57:42.448 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:57:42.448 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:42.448 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:42.448 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:42.448 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:42.449 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:57:42.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:42.568 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:42.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.575 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:57:42.590 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:57:42.590 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:42.590 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:42.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.591 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.0 up 2024-09-15T23:57:42.655 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-15T23:57:42.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:42.656 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:42.711 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:57:42.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:42.712 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:42.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:42.831 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:42.888 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:42.889 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:42.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:42.891 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:42.944 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:57:42.944 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-15T23:57:42.987 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:43.011 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:43.066 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:43.066 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:43.066 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:43.066 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:43.069 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:43.069 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:43.069 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:43.069 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:43.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:2024-09-15T23:57:43.066+0000 7f2c23511480 -1 init, newargv = 0x55660f158ab0 newargc=15 2024-09-15T23:57:43.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.070 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:43.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[57199]: starting ceph client 2024-09-15T23:57:43.071 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[57199]: starting fuse 2024-09-15T23:57:43.086 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:43.086 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-15T23:57:43.086 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:43.086 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:57:43.086 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:57:43.086 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:57:43.086 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:43.087 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.0")) 2024-09-15T23:57:43.088 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:57:43.204 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.0.57199.asok 2024-09-15T23:57:43.207 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:43.215 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57199.asok 2024-09-15T23:57:43.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.215 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57199.asok status 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "0", 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-15T23:57:43.347 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "57199", 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5051, 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 5051 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:43.348 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3001382953 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3001382953 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.5051 192.168.0.1:0/3001382953", 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.1:0/3001382953", 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 36, 2024-09-15T23:57:43.349 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 69, 2024-09-15T23:57:43.350 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:43.350 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:57:43.350 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:57:43.350 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:43.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.355 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:57:43.355 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:43.371 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:57:43.371 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:43.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:43.437 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d66703640 1 Processor -- start 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d66703640 1 -- start start 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d66703640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d6009ee30 0x7f6d6013ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d66703640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d600a2280 con 0x7f6d600a39c0 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d66703640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6009e6e0 con 0x7f6d6009ee30 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.575+0000 7f6d5f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d6009ee30 0x7f6d6013ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5ffff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f6d600a39c0 0x7f6d600a3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45466/0 (socket says 172.21.15.121:45466) 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5f7fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f6d6009ee30 0x7f6d6013ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57630/0 (socket says 172.21.15.121:57630) 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5ffff640 1 -- 172.21.15.121:0/982405587 learned_addr learned my addr 172.21.15.121:0/982405587 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5f7fe640 1 -- 172.21.15.121:0/982405587 >> v1:172.21.15.121:6789/0 conn(0x7f6d600a39c0 legacy=0x7f6d600a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5effd640 1 -- 172.21.15.121:0/982405587 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824213395 0 0) 0x7f6d600a2280 con 0x7f6d600a39c0 2024-09-15T23:57:43.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.576+0000 7f6d5f7fe640 1 -- 172.21.15.121:0/982405587 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6009e3d0 con 0x7f6d6009ee30 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d5f7fe640 1 --2- 172.21.15.121:0/982405587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d6013ced0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009720 tx=0x7f6d5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd234e713d5c971a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d5effd640 1 -- 172.21.15.121:0/982405587 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54037070 con 0x7f6d6009ee30 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d5effd640 1 -- 172.21.15.121:0/982405587 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5402ad90 con 0x7f6d6009ee30 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d5effd640 1 -- 172.21.15.121:0/982405587 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54032590 con 0x7f6d6009ee30 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 -- 172.21.15.121:0/982405587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 msgr2=0x7f6d6013ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 --2- 172.21.15.121:0/982405587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d6013ced0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009720 tx=0x7f6d5402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 -- 172.21.15.121:0/982405587 shutdown_connections 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 --2- 172.21.15.121:0/982405587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d6013ced0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 -- 172.21.15.121:0/982405587 >> 172.21.15.121:0/982405587 conn(0x7f6d600a85e0 msgr2=0x7f6d600a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:43.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 -- 172.21.15.121:0/982405587 shutdown_connections 2024-09-15T23:57:43.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.577+0000 7f6d66703640 1 -- 172.21.15.121:0/982405587 wait complete. 2024-09-15T23:57:43.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.578+0000 7f6d66703640 1 Processor -- start 2024-09-15T23:57:43.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.578+0000 7f6d66703640 1 -- start start 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d66703640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d66703640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600a1ed0 con 0x7f6d6009ee30 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57636/0 (socket says 172.21.15.121:57636) 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5ffff640 1 -- 172.21.15.121:0/1101361123 learned_addr learned my addr 172.21.15.121:0/1101361123 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5ffff640 1 -- 172.21.15.121:0/1101361123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d60070dd0 con 0x7f6d6009ee30 2024-09-15T23:57:43.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5ffff640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c420 tx=0x7f6d5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d50018070 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d500074d0 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d60071ee0 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d50004950 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.579+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6009ca20 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.580+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f6d5001b070 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.580+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60071d10 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.580+0000 7f6d5cff9640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 0x7f6d4c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.580+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f6d5004a560 con 0x7f6d6009ee30 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.581+0000 7f6d5f7fe640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 0x7f6d4c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:43.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.581+0000 7f6d5f7fe640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 0x7f6d4c03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d54034000 tx=0x7f6d5402e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:43.586 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.585+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d50011980 con 0x7f6d6009ee30 2024-09-15T23:57:43.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.785+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6d60070a00 con 0x7f6d6009ee30 2024-09-15T23:57:43.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.786+0000 7f6d5cff9640 1 -- 172.21.15.121:0/1101361123 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7f6d50011be0 con 0x7f6d6009ee30 2024-09-15T23:57:43.787 INFO:teuthology.orchestra.run.smithi121.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 msgr2=0x7f6d4c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 0x7f6d4c03a760 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d54034000 tx=0x7f6d5402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 msgr2=0x7f6d600704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c420 tx=0x7f6d5000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 shutdown_connections 2024-09-15T23:57:43.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f6d4c0382a0 0x7f6d4c03a760 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 --2- 172.21.15.121:0/1101361123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d6009ee30 0x7f6d600704c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:43.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 >> 172.21.15.121:0/1101361123 conn(0x7f6d600a85e0 msgr2=0x7f6d600a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:43.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 shutdown_connections 2024-09-15T23:57:43.790 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:43.788+0000 7f6d66703640 1 -- 172.21.15.121:0/1101361123 wait complete. 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi121.front.sepia.ceph.com 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:43.799 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:57:43.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:57:43.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:57:43.800 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:43.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.800 DEBUG:teuthology.orchestra.run.smithi121:> ip addr 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 ::1/128 scope host 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:82 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f0 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:43.816 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:d8:a4:83 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: altname enp7s0f1 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 0c:c4:7a:8f:cb:a3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: inet 172.21.15.121/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft 42668sec preferred_lft 42668sec 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::ec4:7aff:fe8f:cba3/64 scope link noprefixroute 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:57:43.817 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7440:e0ff:febb:46d4/64 scope link 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:b3:7f:a1:de:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::70b3:7fff:fea1:dec8/64 scope link 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: link/ether 72:79:19:5f:56:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: inet6 fe80::7079:19ff:fe5f:569a/64 scope link 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run.smithi121.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:57:43.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.819 DEBUG:teuthology.orchestra.run.smithi121:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:57:43.880 INFO:teuthology.orchestra.run.smithi121.stdout:1 2024-09-15T23:57:43.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:43.881 DEBUG:teuthology.orchestra.run.smithi121:> route 2024-09-15T23:57:43.938 INFO:teuthology.orchestra.run.smithi121.stdout:Kernel IP routing table 2024-09-15T23:57:43.939 INFO:teuthology.orchestra.run.smithi121.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:57:43.939 INFO:teuthology.orchestra.run.smithi121.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:57:43.939 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:57:43.939 INFO:teuthology.orchestra.run.smithi121.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> set -e 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:57:43.940 DEBUG:teuthology.orchestra.run.smithi121:> ') 2024-09-15T23:57:44.026 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:57:44.057 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:44.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.063 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:57:44.079 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:57:44.079 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:44.079 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:44.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.079 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link set brx.1 up 2024-09-15T23:57:44.143 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-15T23:57:44.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:44.143 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:44.199 INFO:teuthology.orchestra.run.smithi121.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:57:44.199 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:57:44.199 DEBUG:teuthology.orchestra.run.smithi121:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:44.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:44.320 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:44.376 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:44.376 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:44.377 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:44.378 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:44.379 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:44.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.380 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:44.436 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:44.436 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-15T23:57:44.436 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-15T23:57:44.479 DEBUG:teuthology.orchestra.run.smithi121:> sudo modprobe fuse 2024-09-15T23:57:44.503 DEBUG:teuthology.orchestra.run.smithi121:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:57:44.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:2024-09-15T23:57:44.558+0000 7f2925501480 -1 init, newargv = 0x555f5b1c2f80 newargc=15 2024-09-15T23:57:44.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[57616]: starting ceph client 2024-09-15T23:57:44.560 INFO:teuthology.orchestra.run.smithi121.stdout:/proc 2024-09-15T23:57:44.560 INFO:teuthology.orchestra.run.smithi121.stdout:/sys 2024-09-15T23:57:44.560 INFO:teuthology.orchestra.run.smithi121.stdout:/dev 2024-09-15T23:57:44.560 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/security 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/shm 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/pts 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/run 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/cgroup 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/pstore 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/bpf 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/ 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/selinux 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/mqueue 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/dev/hugepages 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/debug 2024-09-15T23:57:44.561 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/tracing 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/fs/fuse/connections 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/sys/kernel/config 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/user/1000 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns 2024-09-15T23:57:44.562 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:44.563 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:44.563 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:44.563 INFO:teuthology.orchestra.run.smithi121.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:44.563 INFO:teuthology.orchestra.run.smithi121.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:44.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.563 DEBUG:teuthology.orchestra.run.smithi121:> ls /sys/fs/fuse/connections 2024-09-15T23:57:44.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[57616]: starting fuse 2024-09-15T23:57:44.578 INFO:teuthology.orchestra.run.smithi121.stdout:41 2024-09-15T23:57:44.578 INFO:teuthology.orchestra.run.smithi121.stdout:44 2024-09-15T23:57:44.578 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> import glob 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> import re 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> import os 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> import subprocess 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:44.579 DEBUG:teuthology.orchestra.run.smithi121:> def _find_admin_socket(client_name): 2024-09-15T23:57:44.580 DEBUG:teuthology.orchestra.run.smithi121:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-15T23:57:44.580 DEBUG:teuthology.orchestra.run.smithi121:> files = glob.glob(asok_path) 2024-09-15T23:57:44.580 DEBUG:teuthology.orchestra.run.smithi121:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-15T23:57:44.580 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:44.580 DEBUG:teuthology.orchestra.run.smithi121:> # Given a non-glob path, it better be there 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> if "*" not in asok_path: 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> assert(len(files) == 1) 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> return files[0] 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> for f in files: 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> contents = proc_f.read() 2024-09-15T23:57:44.581 DEBUG:teuthology.orchestra.run.smithi121:> if mountpoint in contents: 2024-09-15T23:57:44.582 DEBUG:teuthology.orchestra.run.smithi121:> return f 2024-09-15T23:57:44.582 DEBUG:teuthology.orchestra.run.smithi121:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:57:44.582 DEBUG:teuthology.orchestra.run.smithi121:> 2024-09-15T23:57:44.582 DEBUG:teuthology.orchestra.run.smithi121:> print(_find_admin_socket("client.1")) 2024-09-15T23:57:44.582 DEBUG:teuthology.orchestra.run.smithi121:> ' 2024-09-15T23:57:44.698 INFO:teuthology.orchestra.run.smithi121.stdout:/var/run/ceph/ceph-client.1.57616.asok 2024-09-15T23:57:44.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:57:44.709 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.57616.asok 2024-09-15T23:57:44.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.57616.asok status 2024-09-15T23:57:44.841 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:44.841 INFO:teuthology.orchestra.run.smithi121.stdout: "metadata": { 2024-09-15T23:57:44.841 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:57:44.841 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:57:44.841 INFO:teuthology.orchestra.run.smithi121.stdout: "entity_id": "1", 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "hostname": "smithi121", 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "pid": "57616", 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "root": "/" 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_count": 0, 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "dentry_pinned_count": 0, 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "id": 5057, 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "inst": { 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "name": { 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "client", 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "num": 5057 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:44.842 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3160300624 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": { 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "type": "v1", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "addr": "192.168.0.2:0", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "nonce": 3160300624 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "inst_str": "client.5057 192.168.0.2:0/3160300624", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "addr_str": "192.168.0.2:0/3160300624", 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "inode_count": 1, 2024-09-15T23:57:44.843 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_epoch": 36, 2024-09-15T23:57:44.844 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch": 69, 2024-09-15T23:57:44.844 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:57:44.844 INFO:teuthology.orchestra.run.smithi121.stdout: "blocklisted": false, 2024-09-15T23:57:44.844 INFO:teuthology.orchestra.run.smithi121.stdout: "fs_name": "cephfs" 2024-09-15T23:57:44.844 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:44.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.849 DEBUG:teuthology.orchestra.run.smithi121:> stat --file-system '--printf=%T 2024-09-15T23:57:44.850 DEBUG:teuthology.orchestra.run.smithi121:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:44.865 INFO:teuthology.orchestra.run.smithi121.stdout:fuseblk 2024-09-15T23:57:44.865 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:44.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:44.865 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:44.930 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable stats 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.069+0000 7f9cf6db9640 1 Processor -- start 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.069+0000 7f9cf6db9640 1 -- start start 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.069+0000 7f9cf6db9640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9cf00a42a0 0x7f9cf009f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.069+0000 7f9cf6db9640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf009ce40 con 0x7f9cf00a37b0 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9cf6db9640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf009f960 con 0x7f9cf00a42a0 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9ceffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9cf00a42a0 0x7f9cf009f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9cf4b55640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f9cf00a37b0 0x7f9cf00a3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45476/0 (socket says 172.21.15.121:45476) 2024-09-15T23:57:45.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9cf4b55640 1 -- 172.21.15.121:0/42708353 learned_addr learned my addr 172.21.15.121:0/42708353 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:45.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9ceffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9cf00a42a0 0x7f9cf009f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57650/0 (socket says 172.21.15.121:57650) 2024-09-15T23:57:45.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9ceffff640 1 -- 172.21.15.121:0/42708353 >> v1:172.21.15.121:6789/0 conn(0x7f9cf00a37b0 legacy=0x7f9cf00a3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9cef7fe640 1 -- 172.21.15.121:0/42708353 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500527669 0 0) 0x7f9cf009ce40 con 0x7f9cf00a37b0 2024-09-15T23:57:45.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.070+0000 7f9ceffff640 1 -- 172.21.15.121:0/42708353 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf009d7a0 con 0x7f9cf00a42a0 2024-09-15T23:57:45.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9ceffff640 1 --2- 172.21.15.121:0/42708353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a42a0 0x7f9cf009f230 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009720 tx=0x7f9cdc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95df47ca9476e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cef7fe640 1 -- 172.21.15.121:0/42708353 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cdc037070 con 0x7f9cf00a42a0 2024-09-15T23:57:45.074 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cef7fe640 1 -- 172.21.15.121:0/42708353 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc02ad90 con 0x7f9cf00a42a0 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cef7fe640 1 -- 172.21.15.121:0/42708353 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cdc032590 con 0x7f9cf00a42a0 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 -- 172.21.15.121:0/42708353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a42a0 msgr2=0x7f9cf009f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/42708353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a42a0 0x7f9cf009f230 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009720 tx=0x7f9cdc02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 -- 172.21.15.121:0/42708353 shutdown_connections 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/42708353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a42a0 0x7f9cf009f230 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 -- 172.21.15.121:0/42708353 >> 172.21.15.121:0/42708353 conn(0x7f9cf00a8430 msgr2=0x7f9cf00a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 -- 172.21.15.121:0/42708353 shutdown_connections 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.071+0000 7f9cf6db9640 1 -- 172.21.15.121:0/42708353 wait complete. 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.072+0000 7f9cf6db9640 1 Processor -- start 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.072+0000 7f9cf6db9640 1 -- start start 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf6db9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf6db9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf00a5220 con 0x7f9cf00a37b0 2024-09-15T23:57:45.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf4b55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf4b55640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57664/0 (socket says 172.21.15.121:57664) 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf4b55640 1 -- 172.21.15.121:0/2733598504 learned_addr learned my addr 172.21.15.121:0/2733598504 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf4b55640 1 -- 172.21.15.121:0/2733598504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf00709f0 con 0x7f9cf00a37b0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf4b55640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c420 tx=0x7f9ce400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce4018070 con 0x7f9cf00a37b0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce40074d0 con 0x7f9cf00a37b0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf0072d40 con 0x7f9cf00a37b0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.073+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce4004950 con 0x7f9cf00a37b0 2024-09-15T23:57:45.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.074+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf0071480 con 0x7f9cf00a37b0 2024-09-15T23:57:45.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.074+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 33) ==== 45737+0+0 (secure 0 0 0) 0x7f9ce401b070 con 0x7f9cf00a37b0 2024-09-15T23:57:45.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.074+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf009f230 con 0x7f9cf00a37b0 2024-09-15T23:57:45.077 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.074+0000 7f9ced7fa640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 0x7f9cd403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.075+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f9ce404a640 con 0x7f9cf00a37b0 2024-09-15T23:57:45.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.075+0000 7f9ceffff640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 0x7f9cd403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.078 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.075+0000 7f9ceffff640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 0x7f9cd403a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc034000 tx=0x7f9cdc02e000 comp rx=0 tx=0).ready entity=mgr.4913 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.080 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.079+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ce4011980 con 0x7f9cf00a37b0 2024-09-15T23:57:45.289 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.288+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "stats"} v 0) -- 0x7f9cf009e840 con 0x7f9cf00a37b0 2024-09-15T23:57:45.669 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.668+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "stats"}]=0 v34) ==== 84+0+0 (secure 0 0 0) 0x7f9ce4011be0 con 0x7f9cf00a37b0 2024-09-15T23:57:45.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 msgr2=0x7f9cd403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 0x7f9cd403a760 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc034000 tx=0x7f9cdc02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:45.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9ced7fa640 1 -- 172.21.15.121:0/2733598504 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 34) ==== 45746+0+0 (secure 0 0 0) 0x7f9ce401c8d0 con 0x7f9cf00a37b0 2024-09-15T23:57:45.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 msgr2=0x7f9cf011e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c420 tx=0x7f9ce400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 shutdown_connections 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f9cd40382a0 0x7f9cd403a760 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 --2- 172.21.15.121:0/2733598504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9cf00a37b0 0x7f9cf011e3f0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 >> 172.21.15.121:0/2733598504 conn(0x7f9cf00a8430 msgr2=0x7f9cf00a5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 shutdown_connections 2024-09-15T23:57:45.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.671+0000 7f9cf6db9640 1 -- 172.21.15.121:0/2733598504 wait complete. 2024-09-15T23:57:45.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:45.688 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest/mnt.0 && exec cephfs-top --cluster=hpec --id=admin --selftest) 2024-09-15T23:57:45.757 INFO:teuthology.orchestra.run.smithi121.stderr:cluster hpec does not exist 2024-09-15T23:57:45.763 DEBUG:teuthology.orchestra.run:got remote process result: 255 2024-09-15T23:57:45.764 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable stats 2024-09-15T23:57:45.801 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:45.801+0000 7fb358f26040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:57:45.845 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:45.844+0000 7fb358f26040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:45.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.865+0000 7f11903f6640 1 Processor -- start 2024-09-15T23:57:45.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.865+0000 7f11903f6640 1 -- start start 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f11903f6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11880a4ab0 0x7f118813eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f11903f6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11880a6d10 con 0x7f11880a7140 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f11903f6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f118806e230 con 0x7f11880a4ab0 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f118d991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11880a4ab0 0x7f118813eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f118d991640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f11880a4ab0 0x7f118813eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57684/0 (socket says 172.21.15.121:57684) 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f118e192640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f11880a7140 0x7f11880a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45494/0 (socket says 172.21.15.121:45494) 2024-09-15T23:57:45.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.866+0000 7f118d991640 1 -- 172.21.15.121:0/2097374149 learned_addr learned my addr 172.21.15.121:0/2097374149 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.867+0000 7f118d991640 1 -- 172.21.15.121:0/2097374149 >> v1:172.21.15.121:6789/0 conn(0x7f11880a7140 legacy=0x7f11880a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.867+0000 7f118d190640 1 -- 172.21.15.121:0/2097374149 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395525985 0 0) 0x7f11880a6d10 con 0x7f11880a7140 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.867+0000 7f118d991640 1 -- 172.21.15.121:0/2097374149 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880a3ae0 con 0x7f11880a4ab0 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.867+0000 7f118d991640 1 --2- 172.21.15.121:0/2097374149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f118813eef0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f11840097f0 tx=0x7f118402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32891136bfa63a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.868+0000 7f118d190640 1 -- 172.21.15.121:0/2097374149 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1184037070 con 0x7f11880a4ab0 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.868+0000 7f118d190640 1 -- 172.21.15.121:0/2097374149 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1184032440 con 0x7f11880a4ab0 2024-09-15T23:57:45.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.868+0000 7f118d190640 1 -- 172.21.15.121:0/2097374149 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f118402ae60 con 0x7f11880a4ab0 2024-09-15T23:57:45.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 -- 172.21.15.121:0/2097374149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 msgr2=0x7f118813eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:45.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 --2- 172.21.15.121:0/2097374149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f118813eef0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f11840097f0 tx=0x7f118402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 -- 172.21.15.121:0/2097374149 shutdown_connections 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 --2- 172.21.15.121:0/2097374149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f118813eef0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 -- 172.21.15.121:0/2097374149 >> 172.21.15.121:0/2097374149 conn(0x7f11880ac370 msgr2=0x7f11880ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 -- 172.21.15.121:0/2097374149 shutdown_connections 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.869+0000 7f11903f6640 1 -- 172.21.15.121:0/2097374149 wait complete. 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f11903f6640 1 Processor -- start 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f11903f6640 1 -- start start 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f11903f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f11903f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11880a7fc0 con 0x7f11880a4ab0 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f118e192640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f118e192640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57696/0 (socket says 172.21.15.121:57696) 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f118e192640 1 -- 172.21.15.121:0/230785749 learned_addr learned my addr 172.21.15.121:0/230785749 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.870+0000 7f118e192640 1 -- 172.21.15.121:0/230785749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11880a0340 con 0x7f11880a4ab0 2024-09-15T23:57:45.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f118e192640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f117800c420 tx=0x7f117800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178018070 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11780074d0 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1178004950 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11880a11d0 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.871+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11880a0030 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 34) ==== 45746+0+0 (secure 0 0 0) 0x7f117801b070 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11880a2980 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f117effd640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f117804a5c0 con 0x7f11880a4ab0 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f118d991640 1 -- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 msgr2=0x7f116c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:45.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.872+0000 7f118d991640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:45.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:45.877+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1178011950 con 0x7f11880a4ab0 2024-09-15T23:57:45.983 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:45.982+0000 7fb358f26040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:57:46.033 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.032+0000 7fb358f26040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:57:46.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.073+0000 7f118d991640 1 -- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 msgr2=0x7f116c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:46.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.073+0000 7f118d991640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:46.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.095+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "stats"} v 0) -- 0x7f11880732e0 con 0x7f11880a4ab0 2024-09-15T23:57:46.144 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.143+0000 7fb358f26040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:46.237 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.236+0000 7fb358f26040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:57:46.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.474+0000 7f118d991640 1 -- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 msgr2=0x7f116c03a7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:46.475 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.474+0000 7f118d991640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:57:46.505 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.504+0000 7fb358f26040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:57:46.548 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.547+0000 7fb358f26040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:57:46.664 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:46.663+0000 7fb358f26040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:57:46.670 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.669+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "stats"}]=0 v35) ==== 85+0+0 (secure 0 0 0) 0x7f1178011bb0 con 0x7f11880a4ab0 2024-09-15T23:57:46.672 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.671+0000 7f117effd640 1 -- 172.21.15.121:0/230785749 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7f117801c8d0 con 0x7f11880a4ab0 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 msgr2=0x7f116c03a7b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 msgr2=0x7f11881ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f117800c420 tx=0x7f117800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 shutdown_connections 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f116c0382f0 0x7f116c03a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.673 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 --2- 172.21.15.121:0/230785749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11880a4ab0 0x7f11881ce5b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 >> 172.21.15.121:0/230785749 conn(0x7f11880ac370 msgr2=0x7f1188137180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:46.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 shutdown_connections 2024-09-15T23:57:46.674 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.672+0000 7f11903f6640 1 -- 172.21.15.121:0/230785749 wait complete. 2024-09-15T23:57:46.684 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:57:46.684 DEBUG:teuthology.orchestra.run.smithi121:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:57:46.758 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:57:46.759 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:46.759 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:46.759 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:46.815 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:46.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.955+0000 7ff8309b7640 1 Processor -- start 2024-09-15T23:57:46.956 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.955+0000 7ff8309b7640 1 -- start start 2024-09-15T23:57:46.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.955+0000 7ff8309b7640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff82c13a280 0x7ff82c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.957 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.955+0000 7ff8309b7640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff82c13a080 con 0x7ff82c0a4c20 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.955+0000 7ff8309b7640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff82c0a3d50 con 0x7ff82c13a280 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff82a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff82c13a280 0x7ff82c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff82a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff82c13a280 0x7ff82c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57708/0 (socket says 172.21.15.121:57708) 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff829d9b640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff82c0a4c20 0x7ff82c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45506/0 (socket says 172.21.15.121:45506) 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff82a59c640 1 -- 172.21.15.121:0/2015907213 learned_addr learned my addr 172.21.15.121:0/2015907213 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff82a59c640 1 -- 172.21.15.121:0/2015907213 >> v1:172.21.15.121:6789/0 conn(0x7ff82c0a4c20 legacy=0x7ff82c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.956+0000 7ff82a59c640 1 -- 172.21.15.121:0/2015907213 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c0a3f80 con 0x7ff82c13a280 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff82a59c640 1 --2- 172.21.15.121:0/2015907213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c13a280 0x7ff82c13a660 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0097f0 tx=0x7ff81c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab051dec0dcd26d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff82959a640 1 -- 172.21.15.121:0/2015907213 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c037070 con 0x7ff82c13a280 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff82959a640 1 -- 172.21.15.121:0/2015907213 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c032440 con 0x7ff82c13a280 2024-09-15T23:57:46.958 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff82959a640 1 -- 172.21.15.121:0/2015907213 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c02ae60 con 0x7ff82c13a280 2024-09-15T23:57:46.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 -- 172.21.15.121:0/2015907213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c13a280 msgr2=0x7ff82c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:46.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 --2- 172.21.15.121:0/2015907213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c13a280 0x7ff82c13a660 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0097f0 tx=0x7ff81c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 -- 172.21.15.121:0/2015907213 shutdown_connections 2024-09-15T23:57:46.959 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 --2- 172.21.15.121:0/2015907213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c13a280 0x7ff82c13a660 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:46.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 -- 172.21.15.121:0/2015907213 >> 172.21.15.121:0/2015907213 conn(0x7ff82c0ac3e0 msgr2=0x7ff82c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:46.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 -- 172.21.15.121:0/2015907213 shutdown_connections 2024-09-15T23:57:46.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.957+0000 7ff8309b7640 1 -- 172.21.15.121:0/2015907213 wait complete. 2024-09-15T23:57:46.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.958+0000 7ff8309b7640 1 Processor -- start 2024-09-15T23:57:46.960 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff8309b7640 1 -- start start 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff8309b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff8309b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff82c139d40 con 0x7ff82c0a4c20 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff82a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff82a59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57724/0 (socket says 172.21.15.121:57724) 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff82a59c640 1 -- 172.21.15.121:0/1991448581 learned_addr learned my addr 172.21.15.121:0/1991448581 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff82a59c640 1 -- 172.21.15.121:0/1991448581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82c124ff0 con 0x7ff82c0a4c20 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.959+0000 7ff82a59c640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff81c035040 tx=0x7ff81c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.960+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c041020 con 0x7ff82c0a4c20 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.960+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff81c0307f0 con 0x7ff82c0a4c20 2024-09-15T23:57:46.962 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.960+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82c125270 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.960+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff81c037040 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.960+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff82c138290 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82c06dab0 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7ff81c044020 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff81affd640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 0x7ff80c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7ff81c06bc10 con 0x7ff82c0a4c20 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff829d9b640 1 -- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 msgr2=0x7ff80c03a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:46.963 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.961+0000 7ff829d9b640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 0x7ff80c03a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:46.966 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:46.966+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff81c04b030 con 0x7ff82c0a4c20 2024-09-15T23:57:47.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.149+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff82c0a2f50 con 0x7ff82c0a4c20 2024-09-15T23:57:47.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.150+0000 7ff81affd640 1 -- 172.21.15.121:0/1991448581 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7ff82c124ff0 con 0x7ff82c0a4c20 2024-09-15T23:57:47.151 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.151+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 msgr2=0x7ff80c03a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.151+0000 7ff8309b7640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 0x7ff80c03a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.151+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 msgr2=0x7ff82c0a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.151+0000 7ff8309b7640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff81c035040 tx=0x7ff81c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 shutdown_connections 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7ff80c0382a0 0x7ff80c03a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 --2- 172.21.15.121:0/1991448581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff82c0a4c20 0x7ff82c0a1150 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 >> 172.21.15.121:0/1991448581 conn(0x7ff82c0ac3e0 msgr2=0x7ff82c0aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 shutdown_connections 2024-09-15T23:57:47.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.152+0000 7ff8309b7640 1 -- 172.21.15.121:0/1991448581 wait complete. 2024-09-15T23:57:47.164 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:57:47.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:47.164 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-15T23:57:47.188 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi121.stderr:ceph-fuse[57199]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:47.190 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:57:47.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:47.190 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:57:47.259 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:57:47.259 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:47.259 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:47.316 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:57:47.413 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:47.412+0000 7fb358f26040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:57:47.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.455+0000 7f8bc0053640 1 Processor -- start 2024-09-15T23:57:47.456 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bc0053640 1 -- start start 2024-09-15T23:57:47.457 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bc0053640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8bb80a4c20 0x7f8bb813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bc0053640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb813a080 con 0x7f8bb813a280 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bc0053640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb80a3d50 con 0x7f8bb80a4c20 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bbd5ee640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8bb80a4c20 0x7f8bb813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bbddef640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f8bb813a280 0x7f8bb813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45516/0 (socket says 172.21.15.121:45516) 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.456+0000 7f8bbddef640 1 -- 172.21.15.121:0/3938431229 learned_addr learned my addr 172.21.15.121:0/3938431229 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.457+0000 7f8bbd5ee640 1 -- 172.21.15.121:0/3938431229 >> v1:172.21.15.121:6789/0 conn(0x7f8bb813a280 legacy=0x7f8bb813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.457+0000 7f8bbd5ee640 1 -- 172.21.15.121:0/3938431229 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80a3f80 con 0x7f8bb80a4c20 2024-09-15T23:57:47.458 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.457+0000 7f8bbcded640 1 -- 172.21.15.121:0/3938431229 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440395176 0 0) 0x7f8bb813a080 con 0x7f8bb813a280 2024-09-15T23:57:47.459 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.457+0000 7f8bbd5ee640 1 --2- 172.21.15.121:0/3938431229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb813f060 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009720 tx=0x7f8bb402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad428d07236a17ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bbcded640 1 -- 172.21.15.121:0/3938431229 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb4037070 con 0x7f8bb80a4c20 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bbcded640 1 -- 172.21.15.121:0/3938431229 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb402ad90 con 0x7f8bb80a4c20 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bbcded640 1 -- 172.21.15.121:0/3938431229 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb4032590 con 0x7f8bb80a4c20 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 -- 172.21.15.121:0/3938431229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 msgr2=0x7f8bb813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3938431229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb813f060 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4009720 tx=0x7f8bb402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 -- 172.21.15.121:0/3938431229 shutdown_connections 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3938431229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb813f060 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 -- 172.21.15.121:0/3938431229 >> 172.21.15.121:0/3938431229 conn(0x7f8bb80ac3e0 msgr2=0x7f8bb80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 -- 172.21.15.121:0/3938431229 shutdown_connections 2024-09-15T23:57:47.460 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.458+0000 7f8bc0053640 1 -- 172.21.15.121:0/3938431229 wait complete. 2024-09-15T23:57:47.461 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.459+0000 7f8bc0053640 1 Processor -- start 2024-09-15T23:57:47.461 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:47.459+0000 7fb358f26040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.459+0000 7f8bc0053640 1 -- start start 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bc0053640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bc0053640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb80a7ec0 con 0x7f8bb80a4c20 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bbddef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bbddef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57746/0 (socket says 172.21.15.121:57746) 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bbddef640 1 -- 172.21.15.121:0/3097290845 learned_addr learned my addr 172.21.15.121:0/3097290845 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.460+0000 7f8bbddef640 1 -- 172.21.15.121:0/3097290845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb8124f10 con 0x7f8bb80a4c20 2024-09-15T23:57:47.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8bbddef640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c420 tx=0x7f8bac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bac018070 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bac0074d0 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb8124690 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bac004950 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.461+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb81238a0 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7f8bac01b070 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb8122b30 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8baa7fc640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 0x7f8b9c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f8bac04a5b0 con 0x7f8bb80a4c20 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8bbd5ee640 1 -- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 msgr2=0x7f8b9c03a710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:47.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.462+0000 7f8bbd5ee640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 0x7f8b9c03a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:47.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.467+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bac011950 con 0x7f8bb80a4c20 2024-09-15T23:57:47.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.649+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8bb80a2f50 con 0x7f8bb80a4c20 2024-09-15T23:57:47.651 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.650+0000 7f8baa7fc640 1 -- 172.21.15.121:0/3097290845 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f8bac011bb0 con 0x7f8bb80a4c20 2024-09-15T23:57:47.651 INFO:teuthology.orchestra.run.smithi121.stderr:listed 0 entries 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 msgr2=0x7f8b9c03a710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 0x7f8b9c03a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 msgr2=0x7f8bb80a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8bac00c420 tx=0x7f8bac00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 shutdown_connections 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f8b9c038250 0x7f8b9c03a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 --2- 172.21.15.121:0/3097290845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb80a4c20 0x7f8bb80a1080 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 >> 172.21.15.121:0/3097290845 conn(0x7f8bb80ac3e0 msgr2=0x7f8bb8139540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 shutdown_connections 2024-09-15T23:57:47.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.652+0000 7f8bc0053640 1 -- 172.21.15.121:0/3097290845 wait complete. 2024-09-15T23:57:47.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi121.front.sepia.ceph.com... 2024-09-15T23:57:47.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:47.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-15T23:57:47.686 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi121.stderr:ceph-fuse[57616]: fuse finished with error 0 and tester_r 0 2024-09-15T23:57:47.689 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:57:47.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:47.689 DEBUG:teuthology.orchestra.run.smithi121:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:57:47.753 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:47.793 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:47.792+0000 7fb358f26040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:57:47.880 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:47.880+0000 7fb358f26040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:57:47.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.891+0000 7fc83239f640 1 Processor -- start 2024-09-15T23:57:47.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.891+0000 7fc83239f640 1 -- start start 2024-09-15T23:57:47.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.891+0000 7fc83239f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc82c139c60 0x7fc82c0a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.891+0000 7fc83239f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82c09fe10 con 0x7fc82c13a040 2024-09-15T23:57:47.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.891+0000 7fc83239f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc82c0a13b0 con 0x7fc82c139c60 2024-09-15T23:57:47.893 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc83139d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc82c139c60 0x7fc82c0a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc830b9c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc82c13a040 0x7fc82c13a450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45532/0 (socket says 172.21.15.121:45532) 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc830b9c640 1 -- 172.21.15.121:0/1499923987 learned_addr learned my addr 172.21.15.121:0/1499923987 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc83139d640 1 -- 172.21.15.121:0/1499923987 >> v1:172.21.15.121:6789/0 conn(0x7fc82c13a040 legacy=0x7fc82c13a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc83139d640 1 -- 172.21.15.121:0/1499923987 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c0a2fb0 con 0x7fc82c139c60 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.892+0000 7fc823fff640 1 -- 172.21.15.121:0/1499923987 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125912489 0 0) 0x7fc82c09fe10 con 0x7fc82c13a040 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.893+0000 7fc83139d640 1 --2- 172.21.15.121:0/1499923987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a1b00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc828009720 tx=0x7fc82802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e282101e0b93e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.893+0000 7fc823fff640 1 -- 172.21.15.121:0/1499923987 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828037070 con 0x7fc82c139c60 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.893+0000 7fc823fff640 1 -- 172.21.15.121:0/1499923987 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82802ae20 con 0x7fc82c139c60 2024-09-15T23:57:47.894 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.893+0000 7fc823fff640 1 -- 172.21.15.121:0/1499923987 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828032590 con 0x7fc82c139c60 2024-09-15T23:57:47.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 -- 172.21.15.121:0/1499923987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 msgr2=0x7fc82c0a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:47.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 --2- 172.21.15.121:0/1499923987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a1b00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc828009720 tx=0x7fc82802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 -- 172.21.15.121:0/1499923987 shutdown_connections 2024-09-15T23:57:47.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 --2- 172.21.15.121:0/1499923987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a1b00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:47.895 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 -- 172.21.15.121:0/1499923987 >> 172.21.15.121:0/1499923987 conn(0x7fc82c06d5a0 msgr2=0x7fc82c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:47.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 -- 172.21.15.121:0/1499923987 shutdown_connections 2024-09-15T23:57:47.896 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.894+0000 7fc83239f640 1 -- 172.21.15.121:0/1499923987 wait complete. 2024-09-15T23:57:47.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.895+0000 7fc83239f640 1 Processor -- start 2024-09-15T23:57:47.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.895+0000 7fc83239f640 1 -- start start 2024-09-15T23:57:47.897 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83239f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83239f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c0ac970 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83139d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83139d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57764/0 (socket says 172.21.15.121:57764) 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83139d640 1 -- 172.21.15.121:0/4196146948 learned_addr learned my addr 172.21.15.121:0/4196146948 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83139d640 1 -- 172.21.15.121:0/4196146948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c1cb410 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.896+0000 7fc83139d640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc82802adf0 tx=0x7fc8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.897+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828037040 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.897+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828004160 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.897+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c1cb100 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.897+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828004440 con 0x7fc82c139c60 2024-09-15T23:57:47.898 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.897+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c0a5000 con 0x7fc82c139c60 2024-09-15T23:57:47.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82c0a1b00 con 0x7fc82c139c60 2024-09-15T23:57:47.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7fc82803a040 con 0x7fc82c139c60 2024-09-15T23:57:47.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc821ffb640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 0x7fc81003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:47.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fc82806bc00 con 0x7fc82c139c60 2024-09-15T23:57:47.899 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc830b9c640 1 -- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 msgr2=0x7fc81003a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:47.900 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.898+0000 7fc830b9c640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 0x7fc81003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:47.903 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:47.903+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc828042020 con 0x7fc82c139c60 2024-09-15T23:57:47.995 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:47.994+0000 7fb358f26040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:48.039 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.038+0000 7fb358f26040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:57:48.099 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.099+0000 7fc830b9c640 1 -- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 msgr2=0x7fc81003a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:48.100 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.099+0000 7fc830b9c640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 0x7fc81003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:48.111 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.111+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc82c09e690 con 0x7fc82c139c60 2024-09-15T23:57:48.112 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.111+0000 7fc821ffb640 1 -- 172.21.15.121:0/4196146948 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7fc82803b590 con 0x7fc82c139c60 2024-09-15T23:57:48.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:48.112 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:48.113 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:48.114 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 msgr2=0x7fc81003a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 0x7fc81003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 msgr2=0x7fc82c0a3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc82802adf0 tx=0x7fc8280046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 shutdown_connections 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fc8100382a0 0x7fc81003a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 --2- 172.21.15.121:0/4196146948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc82c139c60 0x7fc82c0a3ac0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 >> 172.21.15.121:0/4196146948 conn(0x7fc82c06d5a0 msgr2=0x7fc82c13afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 shutdown_connections 2024-09-15T23:57:48.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.113+0000 7fc83239f640 1 -- 172.21.15.121:0/4196146948 wait complete. 2024-09-15T23:57:48.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:48.155 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.155+0000 7fb358f26040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:57:48.210 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.209+0000 7fb358f26040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:57:48.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.225+0000 7fcc6fa53640 1 Processor -- start 2024-09-15T23:57:48.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.225+0000 7fcc6fa53640 1 -- start start 2024-09-15T23:57:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6fa53640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcc6813a280 0x7fcc6813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6fa53640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6813a080 con 0x7fcc680a4c20 2024-09-15T23:57:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6fa53640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fcc680a3d50 con 0x7fcc6813a280 2024-09-15T23:57:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6d7ef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcc6813a280 0x7fcc6813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.227 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6d7ef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fcc6813a280 0x7fcc6813a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57766/0 (socket says 172.21.15.121:57766) 2024-09-15T23:57:48.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6cfee640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fcc680a4c20 0x7fcc680a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45536/0 (socket says 172.21.15.121:45536) 2024-09-15T23:57:48.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6d7ef640 1 -- 172.21.15.121:0/618594905 learned_addr learned my addr 172.21.15.121:0/618594905 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:48.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6d7ef640 1 -- 172.21.15.121:0/618594905 >> v1:172.21.15.121:6789/0 conn(0x7fcc680a4c20 legacy=0x7fcc680a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.228 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.226+0000 7fcc6d7ef640 1 -- 172.21.15.121:0/618594905 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc680a3f80 con 0x7fcc6813a280 2024-09-15T23:57:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.227+0000 7fcc6d7ef640 1 --2- 172.21.15.121:0/618594905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc6813a280 0x7fcc6813a660 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcc580097f0 tx=0x7fcc5802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765e62ca03d7ae0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.227+0000 7fcc5ffff640 1 -- 172.21.15.121:0/618594905 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc58037070 con 0x7fcc6813a280 2024-09-15T23:57:48.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.227+0000 7fcc5ffff640 1 -- 172.21.15.121:0/618594905 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc58032440 con 0x7fcc6813a280 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.227+0000 7fcc5ffff640 1 -- 172.21.15.121:0/618594905 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc5802ae60 con 0x7fcc6813a280 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 -- 172.21.15.121:0/618594905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc6813a280 msgr2=0x7fcc6813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/618594905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc6813a280 0x7fcc6813a660 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcc580097f0 tx=0x7fcc5802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 -- 172.21.15.121:0/618594905 shutdown_connections 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/618594905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc6813a280 0x7fcc6813a660 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 -- 172.21.15.121:0/618594905 >> 172.21.15.121:0/618594905 conn(0x7fcc680ac3e0 msgr2=0x7fcc680ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 -- 172.21.15.121:0/618594905 shutdown_connections 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.228+0000 7fcc6fa53640 1 -- 172.21.15.121:0/618594905 wait complete. 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6fa53640 1 Processor -- start 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6fa53640 1 -- start start 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6fa53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6fa53640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc68139d40 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6d7ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6d7ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57778/0 (socket says 172.21.15.121:57778) 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.229+0000 7fcc6d7ef640 1 -- 172.21.15.121:0/2124978734 learned_addr learned my addr 172.21.15.121:0/2124978734 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc6d7ef640 1 -- 172.21.15.121:0/2124978734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc68124ff0 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc6d7ef640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcc58035040 tx=0x7fcc580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc58041020 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc580307f0 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc68125270 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc58037040 con 0x7fcc680a4c20 2024-09-15T23:57:48.233 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.230+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc68138290 con 0x7fcc680a4c20 2024-09-15T23:57:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.231+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7fcc58044020 con 0x7fcc680a4c20 2024-09-15T23:57:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.231+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6806dab0 con 0x7fcc680a4c20 2024-09-15T23:57:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.231+0000 7fcc5dffb640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 0x7fcc4c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.231+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fcc5806bc10 con 0x7fcc680a4c20 2024-09-15T23:57:48.234 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.231+0000 7fcc6cfee640 1 -- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 msgr2=0x7fcc4c03a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:48.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.232+0000 7fcc6cfee640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 0x7fcc4c03a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:48.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.236+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc5804b030 con 0x7fcc680a4c20 2024-09-15T23:57:48.255 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.254+0000 7fb358f26040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:57:48.372 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.372+0000 7fb358f26040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:57:48.422 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.422+0000 7fb358f26040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:57:48.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.433+0000 7fcc6cfee640 1 -- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 msgr2=0x7fcc4c03a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:48.433 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.433+0000 7fcc6cfee640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 0x7fcc4c03a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:48.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.443+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc680a2f50 con 0x7fcc680a4c20 2024-09-15T23:57:48.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.444+0000 7fcc5dffb640 1 -- 172.21.15.121:0/2124978734 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7fcc68124ff0 con 0x7fcc680a4c20 2024-09-15T23:57:48.445 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:48.445 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:48.445 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 msgr2=0x7fcc4c03a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 0x7fcc4c03a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 msgr2=0x7fcc680a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcc58035040 tx=0x7fcc580046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 shutdown_connections 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fcc4c0382a0 0x7fcc4c03a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 --2- 172.21.15.121:0/2124978734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc680a4c20 0x7fcc680a1150 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.446+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 >> 172.21.15.121:0/2124978734 conn(0x7fcc680ac3e0 msgr2=0x7fcc680aaef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.447+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 shutdown_connections 2024-09-15T23:57:48.448 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.447+0000 7fcc6fa53640 1 -- 172.21.15.121:0/2124978734 wait complete. 2024-09-15T23:57:48.459 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:48.473 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.473+0000 7fb358f26040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:57:48.529 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.529+0000 7fb358f26040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:48.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.572+0000 7fe9ee61e640 1 Processor -- start 2024-09-15T23:57:48.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.572+0000 7fe9ee61e640 1 -- start start 2024-09-15T23:57:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9ee61e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9e80a4c20 0x7fe9e813f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9ee61e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e813a080 con 0x7fe9e813a280 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9ee61e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e80a3d50 con 0x7fe9e80a4c20 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9e80a4c20 0x7fe9e813f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e7fff640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fe9e813a280 0x7fe9e813a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45546/0 (socket says 172.21.15.121:45546) 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e77fe640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fe9e80a4c20 0x7fe9e813f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57788/0 (socket says 172.21.15.121:57788) 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e7fff640 1 -- 172.21.15.121:0/3275934169 learned_addr learned my addr 172.21.15.121:0/3275934169 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e77fe640 1 -- 172.21.15.121:0/3275934169 >> v1:172.21.15.121:6789/0 conn(0x7fe9e813a280 legacy=0x7fe9e813a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e77fe640 1 -- 172.21.15.121:0/3275934169 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e80a3f80 con 0x7fe9e80a4c20 2024-09-15T23:57:48.575 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fe9e6ffd640 1 -- 172.21.15.121:0/3275934169 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291125558 0 0) 0x7fe9e813a080 con 0x7fe9e813a280 2024-09-15T23:57:48.575 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.573+0000 7fb358f26040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.574+0000 7fe9e77fe640 1 --2- 172.21.15.121:0/3275934169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e813f060 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009720 tx=0x7fe9d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cb4dbbf58d5d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.574+0000 7fe9e6ffd640 1 -- 172.21.15.121:0/3275934169 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d0037070 con 0x7fe9e80a4c20 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.574+0000 7fe9e6ffd640 1 -- 172.21.15.121:0/3275934169 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d002ad90 con 0x7fe9e80a4c20 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.574+0000 7fe9e6ffd640 1 -- 172.21.15.121:0/3275934169 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d0032590 con 0x7fe9e80a4c20 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 -- 172.21.15.121:0/3275934169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 msgr2=0x7fe9e813f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/3275934169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e813f060 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009720 tx=0x7fe9d002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 -- 172.21.15.121:0/3275934169 shutdown_connections 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/3275934169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e813f060 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 -- 172.21.15.121:0/3275934169 >> 172.21.15.121:0/3275934169 conn(0x7fe9e80ac3e0 msgr2=0x7fe9e80ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 -- 172.21.15.121:0/3275934169 shutdown_connections 2024-09-15T23:57:48.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.575+0000 7fe9ee61e640 1 -- 172.21.15.121:0/3275934169 wait complete. 2024-09-15T23:57:48.578 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.576+0000 7fe9ee61e640 1 Processor -- start 2024-09-15T23:57:48.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.576+0000 7fe9ee61e640 1 -- start start 2024-09-15T23:57:48.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.577+0000 7fe9ee61e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.577+0000 7fe9ee61e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80a7ec0 con 0x7fe9e80a4c20 2024-09-15T23:57:48.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.577+0000 7fe9e7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.577+0000 7fe9e7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57794/0 (socket says 172.21.15.121:57794) 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.577+0000 7fe9e7fff640 1 -- 172.21.15.121:0/4080481756 learned_addr learned my addr 172.21.15.121:0/4080481756 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9e7fff640 1 -- 172.21.15.121:0/4080481756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e80a2a70 con 0x7fe9e80a4c20 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9e7fff640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c420 tx=0x7fe9d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8018070 con 0x7fe9e80a4c20 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d80074d0 con 0x7fe9e80a4c20 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e809f760 con 0x7fe9e80a4c20 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9d8004950 con 0x7fe9e80a4c20 2024-09-15T23:57:48.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.578+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e809f480 con 0x7fe9e80a4c20 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e80a2f50 con 0x7fe9e80a4c20 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7fe9d801b070 con 0x7fe9e80a4c20 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9e4ff9640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 0x7fe9c803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9e77fe640 1 -- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 msgr2=0x7fe9c803a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fe9d804a560 con 0x7fe9e80a4c20 2024-09-15T23:57:48.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.579+0000 7fe9e77fe640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 0x7fe9c803a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:48.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.584+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9d8011980 con 0x7fe9e80a4c20 2024-09-15T23:57:48.620 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:48.619+0000 7fb358f26040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:57:48.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.757+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e80732e0 con 0x7fe9e80a4c20 2024-09-15T23:57:48.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.758+0000 7fe9e4ff9640 1 -- 172.21.15.121:0/4080481756 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+10678 (secure 0 0 0) 0x7fe9d8011be0 con 0x7fe9e80a4c20 2024-09-15T23:57:48.759 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:48.759 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":69,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:38.656845+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:35.603216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:35.960235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:48.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 msgr2=0x7fe9c803a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:48.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 0x7fe9c803a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 msgr2=0x7fe9e80a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c420 tx=0x7fe9d800c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 shutdown_connections 2024-09-15T23:57:48.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fe9c80382a0 0x7fe9c803a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 --2- 172.21.15.121:0/4080481756 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9e80a4c20 0x7fe9e80a1d10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 >> 172.21.15.121:0/4080481756 conn(0x7fe9e80ac3e0 msgr2=0x7fe9e80a8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 shutdown_connections 2024-09-15T23:57:48.762 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.760+0000 7fe9ee61e640 1 -- 172.21.15.121:0/4080481756 wait complete. 2024-09-15T23:57:48.772 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:57:48.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.871+0000 7fd363911640 1 Processor -- start 2024-09-15T23:57:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.871+0000 7fd363911640 1 -- start start 2024-09-15T23:57:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.871+0000 7fd363911640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd35c13a280 0x7fd35c13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.871+0000 7fd363911640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd35c13a080 con 0x7fd35c0a4c20 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.871+0000 7fd363911640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd35c0a3d50 con 0x7fd35c13a280 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd35c13a280 0x7fd35c13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd35c13a280 0x7fd35c13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57800/0 (socket says 172.21.15.121:57800) 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd360eac640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fd35c0a4c20 0x7fd35c0a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45558/0 (socket says 172.21.15.121:45558) 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 -- 172.21.15.121:0/448016301 learned_addr learned my addr 172.21.15.121:0/448016301 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 -- 172.21.15.121:0/448016301 >> v1:172.21.15.121:6789/0 conn(0x7fd35c0a4c20 legacy=0x7fd35c0a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 -- 172.21.15.121:0/448016301 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c0a3f80 con 0x7fd35c13a280 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.872+0000 7fd3616ad640 1 --2- 172.21.15.121:0/448016301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c13a280 0x7fd35c13a660 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd3580097f0 tx=0x7fd35802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162171ca02e59abe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd353fff640 1 -- 172.21.15.121:0/448016301 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358037070 con 0x7fd35c13a280 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd353fff640 1 -- 172.21.15.121:0/448016301 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd358032440 con 0x7fd35c13a280 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd353fff640 1 -- 172.21.15.121:0/448016301 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35802ae60 con 0x7fd35c13a280 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 -- 172.21.15.121:0/448016301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c13a280 msgr2=0x7fd35c13a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 --2- 172.21.15.121:0/448016301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c13a280 0x7fd35c13a660 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd3580097f0 tx=0x7fd35802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 -- 172.21.15.121:0/448016301 shutdown_connections 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 --2- 172.21.15.121:0/448016301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c13a280 0x7fd35c13a660 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 -- 172.21.15.121:0/448016301 >> 172.21.15.121:0/448016301 conn(0x7fd35c0ac3e0 msgr2=0x7fd35c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 -- 172.21.15.121:0/448016301 shutdown_connections 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.873+0000 7fd363911640 1 -- 172.21.15.121:0/448016301 wait complete. 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.874+0000 7fd363911640 1 Processor -- start 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.874+0000 7fd363911640 1 -- start start 2024-09-15T23:57:48.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd363911640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd363911640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c139d40 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd3616ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd3616ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57810/0 (socket says 172.21.15.121:57810) 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd3616ad640 1 -- 172.21.15.121:0/2049818980 learned_addr learned my addr 172.21.15.121:0/2049818980 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd3616ad640 1 -- 172.21.15.121:0/2049818980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c09ef50 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.875+0000 7fd3616ad640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd358035040 tx=0x7fd3580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.876+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358041020 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.876+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3580307f0 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.876+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358037040 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.876+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c09fd40 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.876+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c0a2800 con 0x7fd35c0a4c20 2024-09-15T23:57:48.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c09e210 con 0x7fd35c0a4c20 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7fd358044020 con 0x7fd35c0a4c20 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd351ffb640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 0x7fd34003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7fd35806bc10 con 0x7fd35c0a4c20 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd360eac640 1 -- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 msgr2=0x7fd34003a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.877+0000 7fd360eac640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 0x7fd34003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:48.883 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:48.882+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd35804b030 con 0x7fd35c0a4c20 2024-09-15T23:57:49.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.078+0000 7fd360eac640 1 -- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 msgr2=0x7fd34003a760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:49.079 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.078+0000 7fd360eac640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 0x7fd34003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:57:49.091 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.090+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd35c06dab0 con 0x7fd35c0a4c20 2024-09-15T23:57:49.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.091+0000 7fd351ffb640 1 -- 172.21.15.121:0/2049818980 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7fd358031e80 con 0x7fd35c0a4c20 2024-09-15T23:57:49.092 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:49.092 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:49.093 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:49.094 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 msgr2=0x7fd34003a760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 0x7fd34003a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 msgr2=0x7fd35c0a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd358035040 tx=0x7fd3580046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 shutdown_connections 2024-09-15T23:57:49.095 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7fd3400382a0 0x7fd34003a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 --2- 172.21.15.121:0/2049818980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd35c0a4c20 0x7fd35c0a0a80 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 >> 172.21.15.121:0/2049818980 conn(0x7fd35c0ac3e0 msgr2=0x7fd35c0aa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 shutdown_connections 2024-09-15T23:57:49.096 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.093+0000 7fd363911640 1 -- 172.21.15.121:0/2049818980 wait complete. 2024-09-15T23:57:49.104 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:57:49.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.203+0000 7f59a1680640 1 Processor -- start 2024-09-15T23:57:49.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.203+0000 7f59a1680640 1 -- start start 2024-09-15T23:57:49.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f59a1680640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f599c0a4c20 0x7f599c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.205 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f59a1680640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c13a080 con 0x7f599c13a280 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f59a1680640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0a3d50 con 0x7f599c0a4c20 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599a7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f599c0a4c20 0x7f599c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599a7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f599c0a4c20 0x7f599c13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57812/0 (socket says 172.21.15.121:57812) 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599affd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f599c13a280 0x7f599c13a660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45568/0 (socket says 172.21.15.121:45568) 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599a7fc640 1 -- 172.21.15.121:0/4099419653 learned_addr learned my addr 172.21.15.121:0/4099419653 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599a7fc640 1 -- 172.21.15.121:0/4099419653 >> v1:172.21.15.121:6789/0 conn(0x7f599c13a280 legacy=0x7f599c13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.206 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.204+0000 7f599a7fc640 1 -- 172.21.15.121:0/4099419653 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0a3f80 con 0x7f599c0a4c20 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.205+0000 7f599a7fc640 1 --2- 172.21.15.121:0/4099419653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c13f060 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f598c0097f0 tx=0x7f598c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976a285d9759ea62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.205+0000 7f5999ffb640 1 -- 172.21.15.121:0/4099419653 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f598c037070 con 0x7f599c0a4c20 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.205+0000 7f5999ffb640 1 -- 172.21.15.121:0/4099419653 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c032440 con 0x7f599c0a4c20 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.205+0000 7f5999ffb640 1 -- 172.21.15.121:0/4099419653 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f598c02ae60 con 0x7f599c0a4c20 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 -- 172.21.15.121:0/4099419653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 msgr2=0x7f599c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 --2- 172.21.15.121:0/4099419653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c13f060 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f598c0097f0 tx=0x7f598c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 -- 172.21.15.121:0/4099419653 shutdown_connections 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 --2- 172.21.15.121:0/4099419653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c13f060 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 -- 172.21.15.121:0/4099419653 >> 172.21.15.121:0/4099419653 conn(0x7f599c0ac3e0 msgr2=0x7f599c0ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 -- 172.21.15.121:0/4099419653 shutdown_connections 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.206+0000 7f59a1680640 1 -- 172.21.15.121:0/4099419653 wait complete. 2024-09-15T23:57:49.208 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f59a1680640 1 Processor -- start 2024-09-15T23:57:49.209 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f59a1680640 1 -- start start 2024-09-15T23:57:49.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f59a1680640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f59a1680640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f599c0a7ec0 con 0x7f599c0a4c20 2024-09-15T23:57:49.213 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f599affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f599affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57822/0 (socket says 172.21.15.121:57822) 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.207+0000 7f599affd640 1 -- 172.21.15.121:0/872002415 learned_addr learned my addr 172.21.15.121:0/872002415 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f599affd640 1 -- 172.21.15.121:0/872002415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c125070 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f599affd640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f598400c450 tx=0x7f598400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984007410 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59840075b0 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c124780 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984004910 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.208+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c124470 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.209+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 35) ==== 45737+0+0 (secure 0 0 0) 0x7f598401a020 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.209+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c122c20 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.209+0000 7f59937fe640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 0x7f597c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.210+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 3439+0+0 (secure 0 0 0) 0x7f598404aa60 con 0x7f599c0a4c20 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.210+0000 7f599a7fc640 1 -- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 msgr2=0x7f597c03a710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.121:6828/229629035 2024-09-15T23:57:49.214 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.210+0000 7f599a7fc640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 0x7f597c03a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:57:49.215 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.214+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f598401b9b0 con 0x7f599c0a4c20 2024-09-15T23:57:49.220 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.220+0000 7fb358f26040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:57:49.225 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.225+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7f5984013920 con 0x7f599c0a4c20 2024-09-15T23:57:49.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.225+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 msgr2=0x7f597c03a710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:57:49.226 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.225+0000 7f59937fe640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 0x7f597c03a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.347 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.341+0000 7ff0cd51e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:57:49.384 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.384+0000 7ff0cd51e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:49.426 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.425+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f599c124950 con 0x7f599c0a4c20 2024-09-15T23:57:49.427 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.426+0000 7f59937fe640 1 -- 172.21.15.121:0/872002415 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3581 (secure 0 0 0) 0x7f5984021090 con 0x7f599c0a4c20 2024-09-15T23:57:49.427 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:49.427 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":36,"btime":"2024-09-15T23:57:39:660354+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:57:36.988513+0000","modified":"2024-09-15T23:57:38.982688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4990},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4990":{"gid":4990,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.121:6827/3145309006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3145309006},{"type":"v1","addr":"172.21.15.121:6827","nonce":3145309006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4990,"qdb_cluster":[4990]},"id":6}]} 2024-09-15T23:57:49.427 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 36 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 msgr2=0x7f599c0a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f598400c450 tx=0x7f598400c910 comp rx=0 tx=0).stop 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 shutdown_connections 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:6828/229629035,v1:172.21.15.121:6829/229629035] conn(0x7f597c038250 0x7f597c03a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 --2- 172.21.15.121:0/872002415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f599c0a4c20 0x7f599c0a0ff0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 >> 172.21.15.121:0/872002415 conn(0x7f599c0ac3e0 msgr2=0x7f599c0aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.429 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 shutdown_connections 2024-09-15T23:57:49.430 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.428+0000 7f59a1680640 1 -- 172.21.15.121:0/872002415 wait complete. 2024-09-15T23:57:49.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:49.523 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.522+0000 7ff0cd51e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:57:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.539+0000 7fc4a6311640 1 Processor -- start 2024-09-15T23:57:49.540 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.539+0000 7fc4a6311640 1 -- start start 2024-09-15T23:57:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc4a6311640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc4a013a280 0x7fc4a013a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.541 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc4a6311640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a013a080 con 0x7fc4a00a4c20 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc4a6311640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a00a3d50 con 0x7fc4a013a280 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc49ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc4a013a280 0x7fc4a013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc49f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fc4a00a4c20 0x7fc4a00a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45588/0 (socket says 172.21.15.121:45588) 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.540+0000 7fc49f7fe640 1 -- 172.21.15.121:0/1524798817 learned_addr learned my addr 172.21.15.121:0/1524798817 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.541+0000 7fc49ffff640 1 -- 172.21.15.121:0/1524798817 >> v1:172.21.15.121:6789/0 conn(0x7fc4a00a4c20 legacy=0x7fc4a00a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.541+0000 7fc49ffff640 1 -- 172.21.15.121:0/1524798817 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a00a3f80 con 0x7fc4a013a280 2024-09-15T23:57:49.542 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.541+0000 7fc49effd640 1 -- 172.21.15.121:0/1524798817 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063543050 0 0) 0x7fc4a013a080 con 0x7fc4a00a4c20 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.541+0000 7fc49ffff640 1 --2- 172.21.15.121:0/1524798817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a013a280 0x7fc4a013a660 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc490009720 tx=0x7fc49002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67abac81d0e7d484 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc49effd640 1 -- 172.21.15.121:0/1524798817 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc490037070 con 0x7fc4a013a280 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc49effd640 1 -- 172.21.15.121:0/1524798817 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49002ad90 con 0x7fc4a013a280 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc49effd640 1 -- 172.21.15.121:0/1524798817 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc490032590 con 0x7fc4a013a280 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc4a6311640 1 -- 172.21.15.121:0/1524798817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a013a280 msgr2=0x7fc4a013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc4a6311640 1 --2- 172.21.15.121:0/1524798817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a013a280 0x7fc4a013a660 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fc490009720 tx=0x7fc49002a110 comp rx=0 tx=0).stop 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc4a6311640 1 -- 172.21.15.121:0/1524798817 shutdown_connections 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc4a6311640 1 --2- 172.21.15.121:0/1524798817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a013a280 0x7fc4a013a660 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.542+0000 7fc4a6311640 1 -- 172.21.15.121:0/1524798817 >> 172.21.15.121:0/1524798817 conn(0x7fc4a00ac3e0 msgr2=0x7fc4a00ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.543+0000 7fc4a6311640 1 -- 172.21.15.121:0/1524798817 shutdown_connections 2024-09-15T23:57:49.544 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.543+0000 7fc4a6311640 1 -- 172.21.15.121:0/1524798817 wait complete. 2024-09-15T23:57:49.546 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.543+0000 7fc4a6311640 1 Processor -- start 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc4a6311640 1 -- start start 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc4a6311640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc4a6311640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0139d40 con 0x7fc4a00a4c20 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc49ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc49ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57856/0 (socket says 172.21.15.121:57856) 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc49ffff640 1 -- 172.21.15.121:0/1912720457 learned_addr learned my addr 172.21.15.121:0/1912720457 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.544+0000 7fc49ffff640 1 -- 172.21.15.121:0/1912720457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a0124fa0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc49ffff640 1 --2- 172.21.15.121:0/1912720457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc490009720 tx=0x7fc4900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc490041070 con 0x7fc4a00a4c20 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49003c460 con 0x7fc4a00a4c20 2024-09-15T23:57:49.547 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a0137fd0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc490037040 con 0x7fc4a00a4c20 2024-09-15T23:57:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.545+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01228e0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.546+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a006dab0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.546+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7fc490044070 con 0x7fc4a00a4c20 2024-09-15T23:57:49.548 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.546+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 3697+0+0 (secure 0 0 0) 0x7fc49006b8f0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.551 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.550+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc49003bdd0 con 0x7fc4a00a4c20 2024-09-15T23:57:49.575 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.574+0000 7ff0cd51e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:57:49.689 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.688+0000 7ff0cd51e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:49.726 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.725+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4a00a2f50 con 0x7fc4a00a4c20 2024-09-15T23:57:49.727 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.726+0000 7fc49cff9640 1 -- 172.21.15.121:0/1912720457 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+11057 (secure 0 0 0) 0x7fc49003a520 con 0x7fc4a00a4c20 2024-09-15T23:57:49.727 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:49.727 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":70,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:49.222240+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:57:35.603216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4099999666213989,"score_stable":1.4099999666213989,"optimal_score":1,"raw_score_acting":1.4099999666213989,"raw_score_stable":1.4099999666213989,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:57:35.960235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:0/3184065240":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/3825859734":"2024-09-16T23:57:49.222213+0000","172.21.15.121:6829/229629035":"2024-09-16T23:57:49.222213+0000","172.21.15.121:6828/229629035":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/135759422":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/537641779":"2024-09-16T23:57:49.222213+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 msgr2=0x7fc4a00a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 --2- 172.21.15.121:0/1912720457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fc490009720 tx=0x7fc4900046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 shutdown_connections 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 --2- 172.21.15.121:0/1912720457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4a00a4c20 0x7fc4a00a1020 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 >> 172.21.15.121:0/1912720457 conn(0x7fc4a00ac3e0 msgr2=0x7fc4a00aabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 shutdown_connections 2024-09-15T23:57:49.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.728+0000 7fc4a6311640 1 -- 172.21.15.121:0/1912720457 wait complete. 2024-09-15T23:57:49.740 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:57:49.789 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:49.788+0000 7ff0cd51e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:57:49.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.841+0000 7fae7faaf640 1 Processor -- start 2024-09-15T23:57:49.842 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.841+0000 7fae7faaf640 1 -- start start 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.841+0000 7fae7faaf640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fae7813a280 0x7fae7813a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.841+0000 7fae7faaf640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7813a080 con 0x7fae780a4c20 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.841+0000 7fae7faaf640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fae780a3d50 con 0x7fae7813a280 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7d84b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fae7813a280 0x7fae7813a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7d04a640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fae780a4c20 0x7fae780a6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45598/0 (socket says 172.21.15.121:45598) 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7d04a640 1 -- 172.21.15.121:0/2308119235 learned_addr learned my addr 172.21.15.121:0/2308119235 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:49.843 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7d84b640 1 -- 172.21.15.121:0/2308119235 >> v1:172.21.15.121:6789/0 conn(0x7fae780a4c20 legacy=0x7fae780a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7c849640 1 -- 172.21.15.121:0/2308119235 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927854608 0 0) 0x7fae7813a080 con 0x7fae780a4c20 2024-09-15T23:57:49.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.842+0000 7fae7d84b640 1 -- 172.21.15.121:0/2308119235 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780a3f80 con 0x7fae7813a280 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7d84b640 1 --2- 172.21.15.121:0/2308119235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae7813a280 0x7fae7813a660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fae74009720 tx=0x7fae7402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf70acad7ef18436 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7c849640 1 -- 172.21.15.121:0/2308119235 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74037070 con 0x7fae7813a280 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7c849640 1 -- 172.21.15.121:0/2308119235 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7402ad90 con 0x7fae7813a280 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7c849640 1 -- 172.21.15.121:0/2308119235 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74032590 con 0x7fae7813a280 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7faaf640 1 -- 172.21.15.121:0/2308119235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae7813a280 msgr2=0x7fae7813a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:49.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7faaf640 1 --2- 172.21.15.121:0/2308119235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae7813a280 0x7fae7813a660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fae74009720 tx=0x7fae7402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7faaf640 1 -- 172.21.15.121:0/2308119235 shutdown_connections 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.843+0000 7fae7faaf640 1 --2- 172.21.15.121:0/2308119235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae7813a280 0x7fae7813a660 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.844+0000 7fae7faaf640 1 -- 172.21.15.121:0/2308119235 >> 172.21.15.121:0/2308119235 conn(0x7fae780ac3e0 msgr2=0x7fae780ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.844+0000 7fae7faaf640 1 -- 172.21.15.121:0/2308119235 shutdown_connections 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.844+0000 7fae7faaf640 1 -- 172.21.15.121:0/2308119235 wait complete. 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.844+0000 7fae7faaf640 1 Processor -- start 2024-09-15T23:57:49.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7faaf640 1 -- start start 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7faaf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7faaf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae78139d40 con 0x7fae780a4c20 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7d84b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7d84b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57876/0 (socket says 172.21.15.121:57876) 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7d84b640 1 -- 172.21.15.121:0/3587748086 learned_addr learned my addr 172.21.15.121:0/3587748086 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.845+0000 7fae7d84b640 1 -- 172.21.15.121:0/3587748086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae78123410 con 0x7fae780a4c20 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae7d84b640 1 --2- 172.21.15.121:0/3587748086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fae74035040 tx=0x7fae740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74037040 con 0x7fae780a4c20 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae74004160 con 0x7fae780a4c20 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74004440 con 0x7fae780a4c20 2024-09-15T23:57:49.848 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae78124a30 con 0x7fae780a4c20 2024-09-15T23:57:49.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.846+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae78137dd0 con 0x7fae780a4c20 2024-09-15T23:57:49.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.847+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7fae74003610 con 0x7fae780a4c20 2024-09-15T23:57:49.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.847+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 3697+0+0 (secure 0 0 0) 0x7fae7406c170 con 0x7fae780a4c20 2024-09-15T23:57:49.849 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.847+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7806dab0 con 0x7fae780a4c20 2024-09-15T23:57:49.852 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:49.852+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae740475c0 con 0x7fae780a4c20 2024-09-15T23:57:50.066 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.065+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fae780a2f50 con 0x7fae780a4c20 2024-09-15T23:57:50.067 INFO:tasks.ceph.mon.a.smithi121.stderr:2024-09-15T23:57:50.066+0000 7ff819b0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:57:50.067 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.067+0000 7fae6e7fc640 1 -- 172.21.15.121:0/3587748086 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7fae74047820 con 0x7fae780a4c20 2024-09-15T23:57:50.067 INFO:teuthology.orchestra.run.smithi121.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:57:50.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.070+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 msgr2=0x7fae780a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:50.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.070+0000 7fae7faaf640 1 --2- 172.21.15.121:0/3587748086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fae74035040 tx=0x7fae740046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:50.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.070+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 shutdown_connections 2024-09-15T23:57:50.071 INFO:tasks.ceph.mds.b.smithi121.stderr: -981> 2024-09-15T23:57:38.933+0000 7f2524a90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:57:50.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.070+0000 7fae7faaf640 1 --2- 172.21.15.121:0/3587748086 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae780a4c20 0x7fae780a0f00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:50.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.070+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 >> 172.21.15.121:0/3587748086 conn(0x7fae780ac3e0 msgr2=0x7fae781395b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:50.072 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:50.071+0000 7ff0cd51e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:57:50.072 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.071+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 shutdown_connections 2024-09-15T23:57:50.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.071+0000 7fae7faaf640 1 -- 172.21.15.121:0/3587748086 wait complete. 2024-09-15T23:57:50.084 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:57:50.108 INFO:tasks.ceph.mds.b.smithi121.stdout:starting mds.b at 2024-09-15T23:57:50.131 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:50.131+0000 7ff0cd51e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:57:50.186 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f15661df640 1 Processor -- start 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f15661df640 1 -- start start 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f15661df640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f15600a4ab0 0x7f156013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f15661df640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15600a6d10 con 0x7f15600a7140 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f15661df640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f156006e230 con 0x7f15600a4ab0 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f155effd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f15600a4ab0 0x7f156013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.185+0000 7f155f7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f15600a7140 0x7f15600a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45612/0 (socket says 172.21.15.121:45612) 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.186+0000 7f155f7fe640 1 -- 172.21.15.121:0/1392780352 learned_addr learned my addr 172.21.15.121:0/1392780352 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.186+0000 7f155effd640 1 -- 172.21.15.121:0/1392780352 >> v1:172.21.15.121:6789/0 conn(0x7f15600a7140 legacy=0x7f15600a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.186+0000 7f155e7fc640 1 -- 172.21.15.121:0/1392780352 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405889139 0 0) 0x7f15600a6d10 con 0x7f15600a7140 2024-09-15T23:57:50.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.186+0000 7f155effd640 1 -- 172.21.15.121:0/1392780352 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15600a3ae0 con 0x7f15600a4ab0 2024-09-15T23:57:50.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.186+0000 7f155effd640 1 --2- 172.21.15.121:0/1392780352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f156013eef0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1554009720 tx=0x7f155402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56529cf8ba362a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:50.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f155e7fc640 1 -- 172.21.15.121:0/1392780352 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1554037070 con 0x7f15600a4ab0 2024-09-15T23:57:50.188 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f155e7fc640 1 -- 172.21.15.121:0/1392780352 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155402ad90 con 0x7f15600a4ab0 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f155e7fc640 1 -- 172.21.15.121:0/1392780352 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1554032590 con 0x7f15600a4ab0 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 -- 172.21.15.121:0/1392780352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 msgr2=0x7f156013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 --2- 172.21.15.121:0/1392780352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f156013eef0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1554009720 tx=0x7f155402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 -- 172.21.15.121:0/1392780352 shutdown_connections 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 --2- 172.21.15.121:0/1392780352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f156013eef0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 -- 172.21.15.121:0/1392780352 >> 172.21.15.121:0/1392780352 conn(0x7f15600ac370 msgr2=0x7f15600ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 -- 172.21.15.121:0/1392780352 shutdown_connections 2024-09-15T23:57:50.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.187+0000 7f15661df640 1 -- 172.21.15.121:0/1392780352 wait complete. 2024-09-15T23:57:50.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.188+0000 7f15661df640 1 Processor -- start 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.188+0000 7f15661df640 1 -- start start 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f15661df640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f15661df640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f15600a7fc0 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f155f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f155f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57904/0 (socket says 172.21.15.121:57904) 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f155f7fe640 1 -- 172.21.15.121:0/2332682333 learned_addr learned my addr 172.21.15.121:0/2332682333 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f155f7fe640 1 -- 172.21.15.121:0/2332682333 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15600a1140 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f155f7fe640 1 --2- 172.21.15.121:0/2332682333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f155000c420 tx=0x7f155000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1550018070 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15500074d0 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.189+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156009e7c0 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.190+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1550004950 con 0x7f15600a4ab0 2024-09-15T23:57:50.191 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.190+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15600a0010 con 0x7f15600a4ab0 2024-09-15T23:57:50.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.190+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7f155001b070 con 0x7f15600a4ab0 2024-09-15T23:57:50.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.190+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15600008d0 con 0x7f15600a4ab0 2024-09-15T23:57:50.192 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.191+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 3783+0+0 (secure 0 0 0) 0x7f155004a230 con 0x7f15600a4ab0 2024-09-15T23:57:50.200 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.199+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1550004d80 con 0x7f15600a4ab0 2024-09-15T23:57:50.257 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:50.256+0000 7ff0cd51e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:57:50.409 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:50.408+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f15600a2930 con 0x7f15600a4ab0 2024-09-15T23:57:50.962 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:50.961+0000 7ff0cd51e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:57:51.005 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.004+0000 7ff0cd51e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:57:51.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.068+0000 7f1547fff640 1 -- 172.21.15.121:0/2332682333 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f15500119b0 con 0x7f15600a4ab0 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 msgr2=0x7f1560135c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 --2- 172.21.15.121:0/2332682333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f155000c420 tx=0x7f155000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 shutdown_connections 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 --2- 172.21.15.121:0/2332682333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f15600a4ab0 0x7f1560135c60 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 >> 172.21.15.121:0/2332682333 conn(0x7f15600ac370 msgr2=0x7f15601370f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 shutdown_connections 2024-09-15T23:57:51.071 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.070+0000 7f15661df640 1 -- 172.21.15.121:0/2332682333 wait complete. 2024-09-15T23:57:51.082 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.227+0000 7fbfdd76f640 1 Processor -- start 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.227+0000 7fbfdd76f640 1 -- start start 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.227+0000 7fbfdd76f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbfd809fce0 0x7fbfd813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.227+0000 7fbfdd76f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd8131ce0 con 0x7fbfd809f900 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.227+0000 7fbfdd76f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd809deb0 con 0x7fbfd809fce0 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd67fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbfd809fce0 0x7fbfd813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:51.229 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd67fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbfd809fce0 0x7fbfd813cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57908/0 (socket says 172.21.15.121:57908) 2024-09-15T23:57:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd6ffd640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbfd809f900 0x7fbfd8134a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45622/0 (socket says 172.21.15.121:45622) 2024-09-15T23:57:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd67fc640 1 -- 172.21.15.121:0/1402157197 learned_addr learned my addr 172.21.15.121:0/1402157197 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd67fc640 1 -- 172.21.15.121:0/1402157197 >> v1:172.21.15.121:6789/0 conn(0x7fbfd809f900 legacy=0x7fbfd8134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd5ffb640 1 -- 172.21.15.121:0/1402157197 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305160708 0 0) 0x7fbfd8131ce0 con 0x7fbfd809f900 2024-09-15T23:57:51.230 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.228+0000 7fbfd67fc640 1 -- 172.21.15.121:0/1402157197 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd809d4a0 con 0x7fbfd809fce0 2024-09-15T23:57:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfd67fc640 1 --2- 172.21.15.121:0/1402157197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809fce0 0x7fbfd813cba0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80097f0 tx=0x7fbfc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3270ef766098e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfd5ffb640 1 -- 172.21.15.121:0/1402157197 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfc8037070 con 0x7fbfd809fce0 2024-09-15T23:57:51.231 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfd5ffb640 1 -- 172.21.15.121:0/1402157197 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc8032440 con 0x7fbfd809fce0 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfd5ffb640 1 -- 172.21.15.121:0/1402157197 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfc802ae60 con 0x7fbfd809fce0 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1402157197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809fce0 msgr2=0x7fbfd813cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfdd76f640 1 --2- 172.21.15.121:0/1402157197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809fce0 0x7fbfd813cba0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80097f0 tx=0x7fbfc802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1402157197 shutdown_connections 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfdd76f640 1 --2- 172.21.15.121:0/1402157197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809fce0 0x7fbfd813cba0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.229+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1402157197 >> 172.21.15.121:0/1402157197 conn(0x7fbfd8070cc0 msgr2=0x7fbfd80730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.230+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1402157197 shutdown_connections 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.230+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1402157197 wait complete. 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfdd76f640 1 Processor -- start 2024-09-15T23:57:51.232 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfdd76f640 1 -- start start 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfdd76f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfdd76f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8135180 con 0x7fbfd809f900 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfd6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfd6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:57914/0 (socket says 172.21.15.121:57914) 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.231+0000 7fbfd6ffd640 1 -- 172.21.15.121:0/1732636587 learned_addr learned my addr 172.21.15.121:0/1732636587 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfd6ffd640 1 -- 172.21.15.121:0/1732636587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd80a9380 con 0x7fbfd809f900 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfd6ffd640 1 --2- 172.21.15.121:0/1732636587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c420 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:51.235 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc018070 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0074d0 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd80a8580 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc004950 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.232+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd8134040 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.233+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7fbfcc01b070 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.233+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd8135620 con 0x7fbfd809f900 2024-09-15T23:57:51.236 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.233+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 3783+0+0 (secure 0 0 0) 0x7fbfcc04a200 con 0x7fbfd809f900 2024-09-15T23:57:51.238 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.237+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfd8135620 con 0x7fbfd809f900 2024-09-15T23:57:51.330 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.329+0000 7ff0cd51e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:57:51.412 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:51.411+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfd8134a70 con 0x7fbfd809f900 2024-09-15T23:57:51.416 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.415+0000 7ff0cd51e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:57:51.522 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.522+0000 7ff0cd51e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:57:51.565 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.564+0000 7ff0cd51e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:57:51.675 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.674+0000 7ff0cd51e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:57:51.727 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.726+0000 7ff0cd51e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:57:51.769 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.768+0000 7ff0cd51e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:57:51.881 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.880+0000 7ff0cd51e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:57:51.928 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.927+0000 7ff0cd51e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:57:51.975 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:51.974+0000 7ff0cd51e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:57:52.027 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:52.026+0000 7ff0cd51e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:57:52.068 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:52.067+0000 7ff0cd51e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:57:52.069 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.068+0000 7fbfbf7fe640 1 -- 172.21.15.121:0/1732636587 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7fbfcc0119b0 con 0x7fbfd809f900 2024-09-15T23:57:52.069 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:57:52.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.074+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 msgr2=0x7fbfd81ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.074+0000 7fbfdd76f640 1 --2- 172.21.15.121:0/1732636587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c420 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.075+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 shutdown_connections 2024-09-15T23:57:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.075+0000 7fbfdd76f640 1 --2- 172.21.15.121:0/1732636587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfd809f900 0x7fbfd81ce9a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.075+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 >> 172.21.15.121:0/1732636587 conn(0x7fbfd8070cc0 msgr2=0x7fbfd81320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.075+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 shutdown_connections 2024-09-15T23:57:52.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.075+0000 7fbfdd76f640 1 -- 172.21.15.121:0/1732636587 wait complete. 2024-09-15T23:57:52.092 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:57:52.120 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:52.119+0000 7ff0cd51e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:57:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.195+0000 7f16a105e640 1 Processor -- start 2024-09-15T23:57:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.195+0000 7f16a105e640 1 -- start start 2024-09-15T23:57:52.197 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f16a105e640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f169c0a4ab0 0x7f169c13eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f16a105e640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169c0a6d10 con 0x7f169c0a7140 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f16a105e640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f169c06e230 con 0x7f169c0a4ab0 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f169a59c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f169c0a4ab0 0x7f169c13eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f169ad9d640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f169c0a7140 0x7f169c0a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45918/0 (socket says 172.21.15.121:45918) 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f169ad9d640 1 -- 172.21.15.121:0/2368310787 learned_addr learned my addr 172.21.15.121:0/2368310787 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:52.198 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f169a59c640 1 -- 172.21.15.121:0/2368310787 >> v1:172.21.15.121:6789/0 conn(0x7f169c0a7140 legacy=0x7f169c0a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f169a59c640 1 -- 172.21.15.121:0/2368310787 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c0a3ae0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.199 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.196+0000 7f1699d9b640 1 -- 172.21.15.121:0/2368310787 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907166580 0 0) 0x7f169c0a6d10 con 0x7f169c0a7140 2024-09-15T23:57:52.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.197+0000 7f169a59c640 1 --2- 172.21.15.121:0/2368310787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c13eef0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f168c009720 tx=0x7f168c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637bc2751649c31c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.197+0000 7f1699d9b640 1 -- 172.21.15.121:0/2368310787 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f168c037070 con 0x7f169c0a4ab0 2024-09-15T23:57:52.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.197+0000 7f1699d9b640 1 -- 172.21.15.121:0/2368310787 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c02ad90 con 0x7f169c0a4ab0 2024-09-15T23:57:52.201 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.197+0000 7f1699d9b640 1 -- 172.21.15.121:0/2368310787 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f168c032590 con 0x7f169c0a4ab0 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 -- 172.21.15.121:0/2368310787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 msgr2=0x7f169c13eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 --2- 172.21.15.121:0/2368310787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c13eef0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f168c009720 tx=0x7f168c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 -- 172.21.15.121:0/2368310787 shutdown_connections 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 --2- 172.21.15.121:0/2368310787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c13eef0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 -- 172.21.15.121:0/2368310787 >> 172.21.15.121:0/2368310787 conn(0x7f169c0ac370 msgr2=0x7f169c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 -- 172.21.15.121:0/2368310787 shutdown_connections 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.198+0000 7f16a105e640 1 -- 172.21.15.121:0/2368310787 wait complete. 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.199+0000 7f16a105e640 1 Processor -- start 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.199+0000 7f16a105e640 1 -- start start 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.199+0000 7f16a105e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.202 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.199+0000 7f16a105e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f169c0a7fc0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f169ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f169ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43750/0 (socket says 172.21.15.121:43750) 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f169ad9d640 1 -- 172.21.15.121:0/3726905854 learned_addr learned my addr 172.21.15.121:0/3726905854 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f169ad9d640 1 -- 172.21.15.121:0/3726905854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c0a0350 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f169ad9d640 1 --2- 172.21.15.121:0/3726905854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f168400c420 tx=0x7f168400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684018070 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16840074d0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1684004950 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c09e7f0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.203 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.200+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c09e510 con 0x7f169c0a4ab0 2024-09-15T23:57:52.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.201+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 36) ==== 45448+0+0 (secure 0 0 0) 0x7f168401b070 con 0x7f169c0a4ab0 2024-09-15T23:57:52.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.201+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c0008d0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.202+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 3345+0+0 (secure 0 0 0) 0x7f168404a050 con 0x7f169c0a4ab0 2024-09-15T23:57:52.211 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.210+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16840119b0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.381 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.380+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f169c09f0d0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.697 INFO:tasks.ceph.mgr.x.smithi121.stderr:2024-09-15T23:57:52.697+0000 7ff0cd51e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:57:52.700 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.699+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7f1684011c10 con 0x7f169c0a4ab0 2024-09-15T23:57:52.700 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'cephfs_data' removed 2024-09-15T23:57:52.701 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.701+0000 7f16937fe640 1 -- 172.21.15.121:0/3726905854 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mgrmap(e 37) ==== 45448+0+0 (secure 0 0 0) 0x7f168401c8d0 con 0x7f169c0a4ab0 2024-09-15T23:57:52.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 msgr2=0x7f169c0a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 --2- 172.21.15.121:0/3726905854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f168400c420 tx=0x7f168400c8e0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 shutdown_connections 2024-09-15T23:57:52.704 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 --2- 172.21.15.121:0/3726905854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f169c0a4ab0 0x7f169c0a0da0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 >> 172.21.15.121:0/3726905854 conn(0x7f169c0ac370 msgr2=0x7f169c1374c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 shutdown_connections 2024-09-15T23:57:52.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.703+0000 7f16a105e640 1 -- 172.21.15.121:0/3726905854 wait complete. 2024-09-15T23:57:52.722 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe37096640 1 Processor -- start 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe37096640 1 -- start start 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe37096640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe300a3b90 0x7fbe300a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe37096640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe300a4560 con 0x7fbe300a37b0 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe37096640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3009b4f0 con 0x7fbe300a3b90 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe2ffff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbe300a3b90 0x7fbe300a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe34e32640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fbe300a37b0 0x7fbe3009acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45932/0 (socket says 172.21.15.121:45932) 2024-09-15T23:57:52.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.861+0000 7fbe34e32640 1 -- 172.21.15.121:0/3542195524 learned_addr learned my addr 172.21.15.121:0/3542195524 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.862+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/3542195524 <== mon.0 v1:172.21.15.121:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180161788 0 0) 0x7fbe300a4560 con 0x7fbe300a37b0 2024-09-15T23:57:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.862+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/3542195524 --> v1:172.21.15.121:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe20003520 con 0x7fbe300a37b0 2024-09-15T23:57:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.862+0000 7fbe2ffff640 1 -- 172.21.15.121:0/3542195524 >> v1:172.21.15.121:6789/0 conn(0x7fbe300a37b0 legacy=0x7fbe3009acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.862+0000 7fbe2ffff640 1 -- 172.21.15.121:0/3542195524 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe300a1c90 con 0x7fbe300a3b90 2024-09-15T23:57:52.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.862+0000 7fbe2ffff640 1 --2- 172.21.15.121:0/3542195524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a3b90 0x7fbe300a4020 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009720 tx=0x7fbe1c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d16f37007370aa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/3542195524 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe1c037070 con 0x7fbe300a3b90 2024-09-15T23:57:52.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/3542195524 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c02ad90 con 0x7fbe300a3b90 2024-09-15T23:57:52.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe2f7fe640 1 -- 172.21.15.121:0/3542195524 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe1c032570 con 0x7fbe300a3b90 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 -- 172.21.15.121:0/3542195524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a3b90 msgr2=0x7fbe300a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 --2- 172.21.15.121:0/3542195524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a3b90 0x7fbe300a4020 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009720 tx=0x7fbe1c02a110 comp rx=0 tx=0).stop 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 -- 172.21.15.121:0/3542195524 shutdown_connections 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 --2- 172.21.15.121:0/3542195524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a3b90 0x7fbe300a4020 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 -- 172.21.15.121:0/3542195524 >> 172.21.15.121:0/3542195524 conn(0x7fbe300a8430 msgr2=0x7fbe300a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 -- 172.21.15.121:0/3542195524 shutdown_connections 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.863+0000 7fbe37096640 1 -- 172.21.15.121:0/3542195524 wait complete. 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.864+0000 7fbe37096640 1 Processor -- start 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.864+0000 7fbe37096640 1 -- start start 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe37096640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:52.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe37096640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe300a5220 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe34e32640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe34e32640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43828/0 (socket says 172.21.15.121:43828) 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe34e32640 1 -- 172.21.15.121:0/3985181441 learned_addr learned my addr 172.21.15.121:0/3985181441 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe34e32640 1 -- 172.21.15.121:0/3985181441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe300730e0 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe34e32640 1 --2- 172.21.15.121:0/3985181441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c3b0 tx=0x7fbe2400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe24017070 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe24005c10 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe30072a70 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe240070d0 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.865+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe300733a0 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.866+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) ==== 45448+0+0 (secure 0 0 0) 0x7fbe2401a070 con 0x7fbe300a37b0 2024-09-15T23:57:52.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.866+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe300a4020 con 0x7fbe300a37b0 2024-09-15T23:57:52.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.866+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7fbe24049ff0 con 0x7fbe300a37b0 2024-09-15T23:57:52.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:52.871+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe24010910 con 0x7fbe300a37b0 2024-09-15T23:57:53.037 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.036+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbe300a1f00 con 0x7fbe300a37b0 2024-09-15T23:57:53.039 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.038+0000 7fbe2d7fa640 1 -- 172.21.15.121:0/3985181441 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) ==== 104+0+0 (secure 0 0 0) 0x7fbe2401b730 con 0x7fbe300a37b0 2024-09-15T23:57:53.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 msgr2=0x7fbe3011e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 --2- 172.21.15.121:0/3985181441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c3b0 tx=0x7fbe2400c870 comp rx=0 tx=0).stop 2024-09-15T23:57:53.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 shutdown_connections 2024-09-15T23:57:53.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 --2- 172.21.15.121:0/3985181441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe300a37b0 0x7fbe3011e660 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 >> 172.21.15.121:0/3985181441 conn(0x7fbe300a8430 msgr2=0x7fbe30133d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 shutdown_connections 2024-09-15T23:57:53.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.040+0000 7fbe37096640 1 -- 172.21.15.121:0/3985181441 wait complete. 2024-09-15T23:57:53.052 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster' 2024-09-15T23:57:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.149+0000 7f125c682640 1 Processor -- start 2024-09-15T23:57:53.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.149+0000 7f125c682640 1 -- start start 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f125c682640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1254135f30 0x7f125413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f125c682640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12540a08c0 con 0x7f1254135b50 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f125c682640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f125409b310 con 0x7f1254135f30 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f1259c1d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f1254135f30 0x7f125413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f125a41e640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f1254135b50 0x7f125409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45948/0 (socket says 172.21.15.121:45948) 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f125a41e640 1 -- 172.21.15.121:0/1595187132 learned_addr learned my addr 172.21.15.121:0/1595187132 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f1259c1d640 1 -- 172.21.15.121:0/1595187132 >> v1:172.21.15.121:6789/0 conn(0x7f1254135b50 legacy=0x7f125409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.150+0000 7f1259c1d640 1 -- 172.21.15.121:0/1595187132 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12540a2270 con 0x7f1254135f30 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f1259c1d640 1 --2- 172.21.15.121:0/1595187132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135f30 0x7f125413bb80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1244009720 tx=0x7f124402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bc2cafab468353 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f125941c640 1 -- 172.21.15.121:0/1595187132 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1244037070 con 0x7f1254135f30 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f125941c640 1 -- 172.21.15.121:0/1595187132 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124402ae20 con 0x7f1254135f30 2024-09-15T23:57:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f125941c640 1 -- 172.21.15.121:0/1595187132 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1244032590 con 0x7f1254135f30 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f125c682640 1 -- 172.21.15.121:0/1595187132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135f30 msgr2=0x7f125413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.151+0000 7f125c682640 1 --2- 172.21.15.121:0/1595187132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135f30 0x7f125413bb80 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1244009720 tx=0x7f124402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 -- 172.21.15.121:0/1595187132 shutdown_connections 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 --2- 172.21.15.121:0/1595187132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135f30 0x7f125413bb80 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 -- 172.21.15.121:0/1595187132 >> 172.21.15.121:0/1595187132 conn(0x7f12540a85e0 msgr2=0x7f12540a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 -- 172.21.15.121:0/1595187132 shutdown_connections 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 -- 172.21.15.121:0/1595187132 wait complete. 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 Processor -- start 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.152+0000 7f125c682640 1 -- start start 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125c682640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125c682640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1254136350 con 0x7f1254135b50 2024-09-15T23:57:53.155 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125a41e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125a41e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43840/0 (socket says 172.21.15.121:43840) 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125a41e640 1 -- 172.21.15.121:0/2701011496 learned_addr learned my addr 172.21.15.121:0/2701011496 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125a41e640 1 -- 172.21.15.121:0/2701011496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1254124460 con 0x7f1254135b50 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f125a41e640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f125000c4a0 tx=0x7f125000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.153+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250017070 con 0x7f1254135b50 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1250005c10 con 0x7f1254135b50 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1254123710 con 0x7f1254135b50 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250007070 con 0x7f1254135b50 2024-09-15T23:57:53.156 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12541218d0 con 0x7f1254135b50 2024-09-15T23:57:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 37) ==== 45448+0+0 (secure 0 0 0) 0x7f125001a070 con 0x7f1254135b50 2024-09-15T23:57:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.154+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12540a1f10 con 0x7f1254135b50 2024-09-15T23:57:53.157 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.155+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f1250049df0 con 0x7f1254135b50 2024-09-15T23:57:53.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.159+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f125001a760 con 0x7f1254135b50 2024-09-15T23:57:53.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.388+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]} v 0) -- 0x7f125409aac0 con 0x7f1254135b50 2024-09-15T23:57:53.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.707+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mgrmap(e 38) ==== 45575+0+0 (secure 0 0 0) 0x7f125001b3b0 con 0x7f1254135b50 2024-09-15T23:57:53.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.708+0000 7f124affd640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 0x7f123803c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:53.709 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.708+0000 7f1259c1d640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 0x7f123803c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:53.713 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:53.711+0000 7f1259c1d640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 0x7f123803c6a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1244034000 tx=0x7f124402e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.073 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.072+0000 7f124affd640 1 -- 172.21.15.121:0/2701011496 <== mon.0 v2:172.21.15.121:3300/0 8 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fstop.TestFSTop.test_fstop_non_existent_cluster"]}]=0 v168) ==== 144+0+0 (secure 0 0 0) 0x7f125001dd10 con 0x7f1254135b50 2024-09-15T23:57:54.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 msgr2=0x7f123803c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 0x7f123803c6a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1244034000 tx=0x7f124402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:54.075 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 msgr2=0x7f1254123e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f125000c4a0 tx=0x7f125000c960 comp rx=0 tx=0).stop 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 shutdown_connections 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f123803a2b0 0x7f123803c6a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 --2- 172.21.15.121:0/2701011496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1254135b50 0x7f1254123e60 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 >> 172.21.15.121:0/2701011496 conn(0x7f12540a85e0 msgr2=0x7f12540a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 shutdown_connections 2024-09-15T23:57:54.076 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.074+0000 7f125c682640 1 -- 172.21.15.121:0/2701011496 wait complete. 2024-09-15T23:57:54.087 INFO:tasks.cephfs_test_runner:test_fstop_non_existent_cluster (tasks.cephfs.test_fstop.TestFSTop) ... ok 2024-09-15T23:57:54.087 INFO:tasks.cephfs_test_runner: 2024-09-15T23:57:54.088 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:57:54.088 INFO:tasks.cephfs_test_runner:Ran 4 tests in 147.442s 2024-09-15T23:57:54.088 INFO:tasks.cephfs_test_runner: 2024-09-15T23:57:54.088 INFO:tasks.cephfs_test_runner:OK 2024-09-15T23:57:54.088 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T23:57:54.098 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-15T23:57:54.105 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-15T23:57:54.105 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:54.105 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:54.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:54.122 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-15T23:57:54.122 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:57:54.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055985,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16137 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248696k,nr_inodes=812174,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497396k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-09-15T23:57:54.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.179 DEBUG:teuthology.orchestra.run.smithi121:> ip netns list 2024-09-15T23:57:54.235 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 1) 2024-09-15T23:57:54.235 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:57:54.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:57:54.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.301 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:57:54.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:57:54.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo ip link delete ceph-brx 2024-09-15T23:57:54.460 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T23:57:54.471 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:57:54.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:54.570 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff167653640 1 Processor -- start 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff167653640 1 -- start start 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff167653640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1600a39c0 0x7ff160132f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff167653640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1600a16c0 con 0x7ff160133470 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff167653640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7ff1600a1490 con 0x7ff1600a39c0 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff1653ef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1600a39c0 0x7ff160132f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff164bee640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7ff160133470 0x7ff160135f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45960/0 (socket says 172.21.15.121:45960) 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff1653ef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7ff1600a39c0 0x7ff160132f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43852/0 (socket says 172.21.15.121:43852) 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.569+0000 7ff164bee640 1 -- 172.21.15.121:0/2159638886 learned_addr learned my addr 172.21.15.121:0/2159638886 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.570+0000 7ff1653ef640 1 -- 172.21.15.121:0/2159638886 >> v1:172.21.15.121:6789/0 conn(0x7ff160133470 legacy=0x7ff160135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.571 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.570+0000 7ff1653ef640 1 -- 172.21.15.121:0/2159638886 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1600a4010 con 0x7ff1600a39c0 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.570+0000 7ff1653ef640 1 --2- 172.21.15.121:0/2159638886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160132f30 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff15802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec48213935dd89fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff15ffff640 1 -- 172.21.15.121:0/2159638886 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158007670 con 0x7ff1600a39c0 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff15ffff640 1 -- 172.21.15.121:0/2159638886 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158007810 con 0x7ff1600a39c0 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff15ffff640 1 -- 172.21.15.121:0/2159638886 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158007b10 con 0x7ff1600a39c0 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 -- 172.21.15.121:0/2159638886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 msgr2=0x7ff160132f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 --2- 172.21.15.121:0/2159638886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160132f30 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff15802a660 comp rx=0 tx=0).stop 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 -- 172.21.15.121:0/2159638886 shutdown_connections 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 --2- 172.21.15.121:0/2159638886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160132f30 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 -- 172.21.15.121:0/2159638886 >> 172.21.15.121:0/2159638886 conn(0x7ff1600a85e0 msgr2=0x7ff1600a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.573 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 -- 172.21.15.121:0/2159638886 shutdown_connections 2024-09-15T23:57:54.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.571+0000 7ff167653640 1 -- 172.21.15.121:0/2159638886 wait complete. 2024-09-15T23:57:54.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.572+0000 7ff167653640 1 Processor -- start 2024-09-15T23:57:54.574 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.572+0000 7ff167653640 1 -- start start 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff167653640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff167653640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1601329c0 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff1653ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff1653ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43858/0 (socket says 172.21.15.121:43858) 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff1653ef640 1 -- 172.21.15.121:0/30358266 learned_addr learned my addr 172.21.15.121:0/30358266 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff1653ef640 1 -- 172.21.15.121:0/30358266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16009cd60 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff1653ef640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff15803f070 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158031a90 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff160073470 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.573+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff158031d70 con 0x7ff1600a39c0 2024-09-15T23:57:54.576 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.574+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16006fbb0 con 0x7ff1600a39c0 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.574+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 38) ==== 45575+0+0 (secure 0 0 0) 0x7ff158044460 con 0x7ff1600a39c0 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.575+0000 7ff15dffb640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 0x7ff14c03a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.575+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7ff15802ae00 con 0x7ff1600a39c0 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.575+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1600a23d0 con 0x7ff1600a39c0 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.575+0000 7ff164bee640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 0x7ff14c03a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.577 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.575+0000 7ff164bee640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 0x7ff14c03a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff154007fd0 tx=0x7ff154007ac0 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.580 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.579+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff158052020 con 0x7ff1600a39c0 2024-09-15T23:57:54.750 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.750+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff160073640 con 0x7ff14c0380f0 2024-09-15T23:57:54.751 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.750+0000 7ff15dffb640 1 -- 172.21.15.121:0/30358266 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9691 (secure 0 0 0) 0x7ff160073640 con 0x7ff14c0380f0 2024-09-15T23:57:54.751 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:54.752 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:54.753 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.752+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 msgr2=0x7ff14c03a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.752+0000 7ff167653640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 0x7ff14c03a5b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff154007fd0 tx=0x7ff154007ac0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.752+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 msgr2=0x7ff160070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.752+0000 7ff167653640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff158004a40 comp rx=0 tx=0).stop 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 shutdown_connections 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7ff14c0380f0 0x7ff14c03a5b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 --2- 172.21.15.121:0/30358266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1600a39c0 0x7ff160070910 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 >> 172.21.15.121:0/30358266 conn(0x7ff1600a85e0 msgr2=0x7ff1600a0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 shutdown_connections 2024-09-15T23:57:54.754 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.753+0000 7ff167653640 1 -- 172.21.15.121:0/30358266 wait complete. 2024-09-15T23:57:54.765 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T23:57:54.710794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":96708,"kb_used_data":3140,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018812,"statfs":{"total":289910292480,"available":289811263488,"internally_reserved":0,"allocated":3215360,"data_stored":1982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.995575"},"pg_stats":[{"pgid":"1.0","version":"61'152","reported_seq":449,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T23:57:53.710561+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:53.710561+0000","last_peered":"2024-09-15T23:57:53.710561+0000","last_clean":"2024-09-15T23:57:53.710561+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:53.710561+0000","last_undegraded":"2024-09-15T23:57:53.710561+0000","last_fullsized":"2024-09-15T23:57:53.710561+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":271054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":854072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1265664,"data_stored":857869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:54.766 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.862+0000 7f939019f640 1 Processor -- start 2024-09-15T23:57:54.863 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.862+0000 7f939019f640 1 -- start start 2024-09-15T23:57:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f939019f640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f938806fb70 0x7f938806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.864 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f939019f640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9388072fc0 con 0x7f93880738f0 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f939019f640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9388072510 con 0x7f938806fb70 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938df3b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f938806fb70 0x7f938806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938df3b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f938806fb70 0x7f938806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43900/0 (socket says 172.21.15.121:43900) 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938df3b640 1 -- 172.21.15.121:0/2802405678 learned_addr learned my addr 172.21.15.121:0/2802405678 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938d73a640 1 --1- 172.21.15.121:0/2802405678 >> v1:172.21.15.121:6789/0 conn(0x7f93880738f0 0x7f9388139d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45962/0 (socket says 172.21.15.121:45962) 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938df3b640 1 -- 172.21.15.121:0/2802405678 >> v1:172.21.15.121:6789/0 conn(0x7f93880738f0 legacy=0x7f9388139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.865 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.863+0000 7f938df3b640 1 -- 172.21.15.121:0/2802405678 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388071dc0 con 0x7f938806fb70 2024-09-15T23:57:54.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.864+0000 7f938df3b640 1 --2- 172.21.15.121:0/2802405678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f938806ff50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f93780097f0 tx=0x7f937802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f386ac00cef60739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.866 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.864+0000 7f938cf39640 1 -- 172.21.15.121:0/2802405678 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378037070 con 0x7f938806fb70 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.864+0000 7f938cf39640 1 -- 172.21.15.121:0/2802405678 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378032440 con 0x7f938806fb70 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.864+0000 7f938cf39640 1 -- 172.21.15.121:0/2802405678 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f937802ae60 con 0x7f938806fb70 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 -- 172.21.15.121:0/2802405678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 msgr2=0x7f938806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 --2- 172.21.15.121:0/2802405678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f938806ff50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f93780097f0 tx=0x7f937802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 -- 172.21.15.121:0/2802405678 shutdown_connections 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 --2- 172.21.15.121:0/2802405678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f938806ff50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 -- 172.21.15.121:0/2802405678 >> 172.21.15.121:0/2802405678 conn(0x7f938809aa70 msgr2=0x7f938809ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 -- 172.21.15.121:0/2802405678 shutdown_connections 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.865+0000 7f939019f640 1 -- 172.21.15.121:0/2802405678 wait complete. 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f939019f640 1 Processor -- start 2024-09-15T23:57:54.867 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f939019f640 1 -- start start 2024-09-15T23:57:54.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f939019f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f939019f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9388071840 con 0x7f938806fb70 2024-09-15T23:57:54.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f938df3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.869 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f938df3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43914/0 (socket says 172.21.15.121:43914) 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.866+0000 7f938df3b640 1 -- 172.21.15.121:0/1530615986 learned_addr learned my addr 172.21.15.121:0/1530615986 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f938df3b640 1 -- 172.21.15.121:0/1530615986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388123370 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f938df3b640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9378035040 tx=0x7f93780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378041020 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93780307f0 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938813a350 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378037040 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.867+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9388123060 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.868+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 38) ==== 45575+0+0 (secure 0 0 0) 0x7f9378044020 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.868+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9388121810 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.868+0000 7f937e7fc640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 0x7f936c03a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.868+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f937806b6f0 con 0x7f938806fb70 2024-09-15T23:57:54.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.868+0000 7f938d73a640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 0x7f936c03a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:54.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.869+0000 7f938d73a640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 0x7f936c03a5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93840015f0 tx=0x7f9384007a40 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:54.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:54.873+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f937804b030 con 0x7f938806fb70 2024-09-15T23:57:55.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.034+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f938809db30 con 0x7f936c0380f0 2024-09-15T23:57:55.036 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.035+0000 7f937e7fc640 1 -- 172.21.15.121:0/1530615986 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9691 (secure 0 0 0) 0x7f938809db30 con 0x7f936c0380f0 2024-09-15T23:57:55.036 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:55.036 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 msgr2=0x7f936c03a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 0x7f936c03a5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93840015f0 tx=0x7f9384007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 msgr2=0x7f9388123d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f9378035040 tx=0x7f93780046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 shutdown_connections 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f936c0380f0 0x7f936c03a5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 --2- 172.21.15.121:0/1530615986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f938806fb70 0x7f9388123d30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 >> 172.21.15.121:0/1530615986 conn(0x7f938809aa70 msgr2=0x7f93880a4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 shutdown_connections 2024-09-15T23:57:55.038 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.037+0000 7f939019f640 1 -- 172.21.15.121:0/1530615986 wait complete. 2024-09-15T23:57:55.049 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T23:57:54.710794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":96708,"kb_used_data":3140,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018812,"statfs":{"total":289910292480,"available":289811263488,"internally_reserved":0,"allocated":3215360,"data_stored":1982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.995575"},"pg_stats":[{"pgid":"1.0","version":"61'152","reported_seq":449,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T23:57:53.710561+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:53.710561+0000","last_peered":"2024-09-15T23:57:53.710561+0000","last_clean":"2024-09-15T23:57:53.710561+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:53.710561+0000","last_undegraded":"2024-09-15T23:57:53.710561+0000","last_fullsized":"2024-09-15T23:57:53.710561+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":271054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":854072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1265664,"data_stored":857869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:55.049 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:57:55.049 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:55.150 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.146+0000 7f2438b03640 1 Processor -- start 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f2438b03640 1 -- start start 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f2438b03640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2434135f30 0x7f243413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f2438b03640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24340a08c0 con 0x7f2434135b50 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f2438b03640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f243409b310 con 0x7f2434135f30 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f243259c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f2434135b50 0x7f243409aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45976/0 (socket says 172.21.15.121:45976) 2024-09-15T23:57:55.151 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f243259c640 1 -- 172.21.15.121:0/3646586365 learned_addr learned my addr 172.21.15.121:0/3646586365 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.147+0000 7f2431d9b640 1 --2- 172.21.15.121:0/3646586365 >> v2:172.21.15.121:3300/0 conn(0x7f2434135f30 0x7f243413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f2431d9b640 1 -- 172.21.15.121:0/3646586365 >> v1:172.21.15.121:6789/0 conn(0x7f2434135b50 legacy=0x7f243409aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f2431d9b640 1 -- 172.21.15.121:0/3646586365 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24340a2270 con 0x7f2434135f30 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f2431d9b640 1 --2- 172.21.15.121:0/3646586365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135f30 0x7f243413bb80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2424009720 tx=0x7f242402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb484c1821da5c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f243159a640 1 -- 172.21.15.121:0/3646586365 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2424037070 con 0x7f2434135f30 2024-09-15T23:57:55.152 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f243159a640 1 -- 172.21.15.121:0/3646586365 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242402ae20 con 0x7f2434135f30 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.148+0000 7f243159a640 1 -- 172.21.15.121:0/3646586365 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2424032590 con 0x7f2434135f30 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 -- 172.21.15.121:0/3646586365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135f30 msgr2=0x7f243413bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 --2- 172.21.15.121:0/3646586365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135f30 0x7f243413bb80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f2424009720 tx=0x7f242402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 -- 172.21.15.121:0/3646586365 shutdown_connections 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 --2- 172.21.15.121:0/3646586365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135f30 0x7f243413bb80 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.153 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 -- 172.21.15.121:0/3646586365 >> 172.21.15.121:0/3646586365 conn(0x7f24340a85e0 msgr2=0x7f24340a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 -- 172.21.15.121:0/3646586365 shutdown_connections 2024-09-15T23:57:55.154 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.149+0000 7f2438b03640 1 -- 172.21.15.121:0/3646586365 wait complete. 2024-09-15T23:57:55.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.150+0000 7f2438b03640 1 Processor -- start 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.150+0000 7f2438b03640 1 -- start start 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2438b03640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2438b03640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2434136350 con 0x7f2434135b50 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f243259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f243259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43932/0 (socket says 172.21.15.121:43932) 2024-09-15T23:57:55.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f243259c640 1 -- 172.21.15.121:0/4232741970 learned_addr learned my addr 172.21.15.121:0/4232741970 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f243259c640 1 -- 172.21.15.121:0/4232741970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24341237c0 con 0x7f2434135b50 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f243259c640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f242800c4a0 tx=0x7f242800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2428017070 con 0x7f2434135b50 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428005c10 con 0x7f2434135b50 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341242b0 con 0x7f2434135b50 2024-09-15T23:57:55.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2428007070 con 0x7f2434135b50 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.151+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341230e0 con 0x7f2434135b50 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.152+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 39) ==== 45681+0+0 (secure 0 0 0) 0x7f242801a070 con 0x7f2434135b50 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.152+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243409aae0 con 0x7f2434135b50 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.152+0000 7f2422ffd640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 0x7f241403a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.152+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f242804a1c0 con 0x7f2434135b50 2024-09-15T23:57:55.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.152+0000 7f2431d9b640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 0x7f241403a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.153+0000 7f2431d9b640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 0x7f241403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2424034000 tx=0x7f242402e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.157+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f242801b3b0 con 0x7f2434135b50 2024-09-15T23:57:55.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.319+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24340a1f10 con 0x7f2414038210 2024-09-15T23:57:55.320 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.319+0000 7f2422ffd640 1 -- 172.21.15.121:0/4232741970 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9691 (secure 0 0 0) 0x7f24340a1f10 con 0x7f2414038210 2024-09-15T23:57:55.320 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:55.321 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:55.322 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 msgr2=0x7f241403a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 0x7f241403a6d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2424034000 tx=0x7f242402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 msgr2=0x7f243411fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f242800c4a0 tx=0x7f242800c960 comp rx=0 tx=0).stop 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 shutdown_connections 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2414038210 0x7f241403a6d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 --2- 172.21.15.121:0/4232741970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2434135b50 0x7f243411fce0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 >> 172.21.15.121:0/4232741970 conn(0x7f24340a85e0 msgr2=0x7f243409f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 shutdown_connections 2024-09-15T23:57:55.323 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.321+0000 7f2438b03640 1 -- 172.21.15.121:0/4232741970 wait complete. 2024-09-15T23:57:55.333 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-15T23:57:54.710794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":96708,"kb_used_data":3140,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018812,"statfs":{"total":289910292480,"available":289811263488,"internally_reserved":0,"allocated":3215360,"data_stored":1982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.995575"},"pg_stats":[{"pgid":"1.0","version":"61'152","reported_seq":449,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T23:57:53.710561+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:53.710561+0000","last_peered":"2024-09-15T23:57:53.710561+0000","last_clean":"2024-09-15T23:57:53.710561+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:53.710561+0000","last_undegraded":"2024-09-15T23:57:53.710561+0000","last_fullsized":"2024-09-15T23:57:53.710561+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":271054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":854072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1265664,"data_stored":857869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:55.334 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:57:55.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c4c1a6640 1 Processor -- start 2024-09-15T23:57:55.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c4c1a6640 1 -- start start 2024-09-15T23:57:55.439 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c4c1a6640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c44135b50 0x7f2c4409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c4c1a6640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4409b020 con 0x7f2c44135f30 2024-09-15T23:57:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c4c1a6640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4409b310 con 0x7f2c44135b50 2024-09-15T23:57:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c49f42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c44135b50 0x7f2c4409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c49f42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f2c44135b50 0x7f2c4409aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43938/0 (socket says 172.21.15.121:43938) 2024-09-15T23:57:55.440 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.431+0000 7f2c49f42640 1 -- 172.21.15.121:0/3776878367 learned_addr learned my addr 172.21.15.121:0/3776878367 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.432+0000 7f2c49f42640 1 -- 172.21.15.121:0/3776878367 >> v1:172.21.15.121:6789/0 conn(0x7f2c44135f30 legacy=0x7f2c440a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.432+0000 7f2c49f42640 1 -- 172.21.15.121:0/3776878367 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c440a08c0 con 0x7f2c44135b50 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.432+0000 7f2c49f42640 1 --2- 172.21.15.121:0/3776878367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c4409aae0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000ba90 tx=0x7f2c4002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef45a3c74cf435bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c48f40640 1 -- 172.21.15.121:0/3776878367 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c40036020 con 0x7f2c44135b50 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c48f40640 1 -- 172.21.15.121:0/3776878367 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40032770 con 0x7f2c44135b50 2024-09-15T23:57:55.441 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c48f40640 1 -- 172.21.15.121:0/3776878367 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c40032a70 con 0x7f2c44135b50 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/3776878367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 msgr2=0x7f2c4409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/3776878367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c4409aae0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000ba90 tx=0x7f2c4002c940 comp rx=0 tx=0).stop 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/3776878367 shutdown_connections 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/3776878367 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c4409aae0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/3776878367 >> 172.21.15.121:0/3776878367 conn(0x7f2c440a85e0 msgr2=0x7f2c440a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.442 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/3776878367 shutdown_connections 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.433+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/3776878367 wait complete. 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.434+0000 7f2c4c1a6640 1 Processor -- start 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.434+0000 7f2c4c1a6640 1 -- start start 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.434+0000 7f2c4c1a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c4c1a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440a5430 con 0x7f2c44135b50 2024-09-15T23:57:55.443 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c49f42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c49f42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43944/0 (socket says 172.21.15.121:43944) 2024-09-15T23:57:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c49f42640 1 -- 172.21.15.121:0/1098644525 learned_addr learned my addr 172.21.15.121:0/1098644525 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c49f42640 1 -- 172.21.15.121:0/1098644525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441263a0 con 0x7f2c44135b50 2024-09-15T23:57:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c49f42640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b2c0 tx=0x7f2c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.444 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c40036040 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40031ba0 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c44125960 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4003b420 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.435+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c440a7470 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.436+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 39) ==== 45681+0+0 (secure 0 0 0) 0x7f2c40043020 con 0x7f2c44135b50 2024-09-15T23:57:55.445 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.436+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c44123d90 con 0x7f2c44135b50 2024-09-15T23:57:55.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.436+0000 7f2c367fc640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 0x7f2c2803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:55.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.436+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f2c4002f070 con 0x7f2c44135b50 2024-09-15T23:57:55.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.436+0000 7f2c49741640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 0x7f2c2803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:55.446 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.437+0000 7f2c49741640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 0x7f2c2803a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000f60 tx=0x7f2c38007a30 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:55.447 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.441+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c4003bdc0 con 0x7f2c44135b50 2024-09-15T23:57:55.608 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.607+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c44136350 con 0x7f2c44135b50 2024-09-15T23:57:55.609 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.608+0000 7f2c367fc640 1 -- 172.21.15.121:0/1098644525 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+7305 (secure 0 0 0) 0x7f2c40044530 con 0x7f2c44135b50 2024-09-15T23:57:55.609 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:55.610 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":73,"fsid":"822f5905-71ec-4c9e-8017-14fcc3976ad1","created":"2024-09-15T23:54:51.800022+0000","modified":"2024-09-15T23:57:52.698971+0000","last_up_change":"2024-09-15T23:55:02.371862+0000","last_in_change":"2024-09-15T23:54:52.650884+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:55:04.051077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"39561d8c-cc1b-4bfc-9d5f-d5cb4747937b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":871193},{"type":"v1","addr":"172.21.15.121:6801","nonce":871193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":871193},{"type":"v1","addr":"172.21.15.121:6803","nonce":871193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":871193},{"type":"v1","addr":"172.21.15.121:6807","nonce":871193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":871193},{"type":"v1","addr":"172.21.15.121:6805","nonce":871193}]},"public_addr":"172.21.15.121:6801/871193","cluster_addr":"172.21.15.121:6803/871193","heartbeat_back_addr":"172.21.15.121:6807/871193","heartbeat_front_addr":"172.21.15.121:6805/871193","state":["exists","up"]},{"osd":1,"uuid":"ab46d9cd-4a8c-4ce8-bb26-22df0f5fd44d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6809","nonce":4042695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6811","nonce":4042695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6817","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6819","nonce":4042695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6813","nonce":4042695749},{"type":"v1","addr":"172.21.15.121:6815","nonce":4042695749}]},"public_addr":"172.21.15.121:6809/4042695749","cluster_addr":"172.21.15.121:6811/4042695749","heartbeat_back_addr":"172.21.15.121:6819/4042695749","heartbeat_front_addr":"172.21.15.121:6815/4042695749","state":["exists","up"]},{"osd":2,"uuid":"78d985e1-bd6a-4bcb-851b-1537c4898a3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6814","nonce":1644151022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6818","nonce":1644151022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6823","nonce":1644151022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":1644151022},{"type":"v1","addr":"172.21.15.121:6821","nonce":1644151022}]},"public_addr":"172.21.15.121:6814/1644151022","cluster_addr":"172.21.15.121:6818/1644151022","heartbeat_back_addr":"172.21.15.121:6823/1644151022","heartbeat_front_addr":"172.21.15.121:6821/1644151022","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.419404+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:54:59.831591+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:55:00.195552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.121:6827/3145309006":"2024-09-16T23:57:50.067055+0000","172.21.15.121:6826/3145309006":"2024-09-16T23:57:50.067055+0000","172.21.15.121:0/3184065240":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/3825859734":"2024-09-16T23:57:49.222213+0000","172.21.15.121:6829/229629035":"2024-09-16T23:57:49.222213+0000","172.21.15.121:6828/229629035":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/135759422":"2024-09-16T23:57:49.222213+0000","172.21.15.121:0/537641779":"2024-09-16T23:57:49.222213+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:57:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 msgr2=0x7f2c2803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 0x7f2c2803a6d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2c38000f60 tx=0x7f2c38007a30 comp rx=0 tx=0).stop 2024-09-15T23:57:55.611 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 msgr2=0x7f2c44122a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b2c0 tx=0x7f2c400046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 shutdown_connections 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f2c28038210 0x7f2c2803a6d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 --2- 172.21.15.121:0/1098644525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c44135b50 0x7f2c44122a10 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 >> 172.21.15.121:0/1098644525 conn(0x7f2c440a85e0 msgr2=0x7f2c440a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 shutdown_connections 2024-09-15T23:57:55.612 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:55.610+0000 7f2c4c1a6640 1 -- 172.21.15.121:0/1098644525 wait complete. 2024-09-15T23:57:56.622 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T23:57:56.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:57:56.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.737+0000 7fa8049fd640 1 Processor -- start 2024-09-15T23:57:56.738 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.737+0000 7fa8049fd640 1 -- start start 2024-09-15T23:57:56.741 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa8049fd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fa8000a4ab0 0x7fa80013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa8049fd640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8000a6d10 con 0x7fa8000a7140 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa8049fd640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fa80006e230 con 0x7fa8000a4ab0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa7fe59c640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7fa8000a7140 0x7fa8000a7520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:45990/0 (socket says 172.21.15.121:45990) 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa7fe59c640 1 -- 172.21.15.121:0/1049702977 learned_addr learned my addr 172.21.15.121:0/1049702977 (peer_addr_for_me v1:172.21.15.121:0/0) 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa7fdd9b640 1 --2- 172.21.15.121:0/1049702977 >> v2:172.21.15.121:3300/0 conn(0x7fa8000a4ab0 0x7fa80013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa7fdd9b640 1 -- 172.21.15.121:0/1049702977 >> v1:172.21.15.121:6789/0 conn(0x7fa8000a7140 legacy=0x7fa8000a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.738+0000 7fa7fdd9b640 1 -- 172.21.15.121:0/1049702977 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8000a3ae0 con 0x7fa8000a4ab0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.739+0000 7fa7fdd9b640 1 --2- 172.21.15.121:0/1049702977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa80013eef0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009720 tx=0x7fa7f402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a93ec05608b7431 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.739+0000 7fa7fd59a640 1 -- 172.21.15.121:0/1049702977 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4037070 con 0x7fa8000a4ab0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.739+0000 7fa7fd59a640 1 -- 172.21.15.121:0/1049702977 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f402ad90 con 0x7fa8000a4ab0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.739+0000 7fa7fd59a640 1 -- 172.21.15.121:0/1049702977 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f4032590 con 0x7fa8000a4ab0 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 -- 172.21.15.121:0/1049702977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 msgr2=0x7fa80013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.742 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1049702977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa80013eef0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009720 tx=0x7fa7f402a110 comp rx=0 tx=0).stop 2024-09-15T23:57:56.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 -- 172.21.15.121:0/1049702977 shutdown_connections 2024-09-15T23:57:56.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1049702977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa80013eef0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 -- 172.21.15.121:0/1049702977 >> 172.21.15.121:0/1049702977 conn(0x7fa8000ac370 msgr2=0x7fa8000ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 -- 172.21.15.121:0/1049702977 shutdown_connections 2024-09-15T23:57:56.743 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.740+0000 7fa8049fd640 1 -- 172.21.15.121:0/1049702977 wait complete. 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.741+0000 7fa8049fd640 1 Processor -- start 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.741+0000 7fa8049fd640 1 -- start start 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa8049fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa8049fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa8000a7fc0 con 0x7fa8000a4ab0 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7fe59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7fe59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43956/0 (socket says 172.21.15.121:43956) 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7fe59c640 1 -- 172.21.15.121:0/1361418539 learned_addr learned my addr 172.21.15.121:0/1361418539 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7fe59c640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa800125000 con 0x7fa8000a4ab0 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7fe59c640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cb20 tx=0x7fa7f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f0017070 con 0x7fa8000a4ab0 2024-09-15T23:57:56.746 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f000abf0 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f0012400 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa800124710 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.742+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa800123490 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.743+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa80013a300 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.743+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 39) ==== 45681+0+0 (secure 0 0 0) 0x7fa7f001a070 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7eeffd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 0x7fa7e003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7fa7f004ac30 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7eeffd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 0x7fa7e003f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7fdd9b640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 0x7fa7e003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7e003fac0 con 0x7fa7e003cfb0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fa7f004d290 con 0x7fa8000a4ab0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7fed9d640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 0x7fa7e003f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7fdd9b640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 0x7fa7e003a6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034000 tx=0x7fa7f402e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.747 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.744+0000 7fa7fed9d640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 0x7fa7e003f3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.748 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.745+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== osd.0 v2:172.21.15.121:6800/871193 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7e003fac0 con 0x7fa7e003cfb0 2024-09-15T23:57:56.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.757+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 --> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa800124930 con 0x7fa7e003cfb0 2024-09-15T23:57:56.758 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa7eeffd640 1 -- 172.21.15.121:0/1361418539 <== osd.0 v2:172.21.15.121:6800/871193 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa7f80097a0 con 0x7fa7e003cfb0 2024-09-15T23:57:56.759 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:56.759 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:57:56.759 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:56.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 msgr2=0x7fa7e003f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 0x7fa7e003f3f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 msgr2=0x7fa7e003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 0x7fa7e003a6d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034000 tx=0x7fa7f402e000 comp rx=0 tx=0).stop 2024-09-15T23:57:56.760 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 msgr2=0x7fa8000a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cb20 tx=0x7fa7f000a060 comp rx=0 tx=0).stop 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 shutdown_connections 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6800/871193,v1:172.21.15.121:6801/871193] conn(0x7fa7e003cfb0 0x7fa7e003f3f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fa7e0038210 0x7fa7e003a6d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 --2- 172.21.15.121:0/1361418539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8000a4ab0 0x7fa8000a1040 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 >> 172.21.15.121:0/1361418539 conn(0x7fa8000ac370 msgr2=0x7fa8000aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 shutdown_connections 2024-09-15T23:57:56.761 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.758+0000 7fa8049fd640 1 -- 172.21.15.121:0/1361418539 wait complete. 2024-09-15T23:57:56.769 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T23:57:56.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.867+0000 7f4403c42640 1 Processor -- start 2024-09-15T23:57:56.868 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.867+0000 7f4403c42640 1 -- start start 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f4403c42640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43fc135f30 0x7f43fc13bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f4403c42640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0a08c0 con 0x7f43fc135b50 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f4403c42640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f43fc09b310 con 0x7f43fc135f30 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f44011dd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43fc135f30 0x7f43fc13bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f44011dd640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f43fc135f30 0x7f43fc13bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43960/0 (socket says 172.21.15.121:43960) 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f44011dd640 1 -- 172.21.15.121:0/1661289027 learned_addr learned my addr 172.21.15.121:0/1661289027 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f44011dd640 1 -- 172.21.15.121:0/1661289027 >> v1:172.21.15.121:6789/0 conn(0x7f43fc135b50 legacy=0x7f43fc09aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.868+0000 7f44011dd640 1 -- 172.21.15.121:0/1661289027 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0a2270 con 0x7f43fc135f30 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.869+0000 7f44011dd640 1 --2- 172.21.15.121:0/1661289027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135f30 0x7f43fc13bb80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097f0 tx=0x7f43ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c884b29de11dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.870 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.869+0000 7f44009dc640 1 -- 172.21.15.121:0/1661289027 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec037070 con 0x7f43fc135f30 2024-09-15T23:57:56.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.869+0000 7f44009dc640 1 -- 172.21.15.121:0/1661289027 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec032440 con 0x7f43fc135f30 2024-09-15T23:57:56.871 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.869+0000 7f44009dc640 1 -- 172.21.15.121:0/1661289027 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43ec032740 con 0x7f43fc135f30 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 -- 172.21.15.121:0/1661289027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135f30 msgr2=0x7f43fc13bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 --2- 172.21.15.121:0/1661289027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135f30 0x7f43fc13bb80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097f0 tx=0x7f43ec02a270 comp rx=0 tx=0).stop 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 -- 172.21.15.121:0/1661289027 shutdown_connections 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 --2- 172.21.15.121:0/1661289027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135f30 0x7f43fc13bb80 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 -- 172.21.15.121:0/1661289027 >> 172.21.15.121:0/1661289027 conn(0x7f43fc0a85e0 msgr2=0x7f43fc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 -- 172.21.15.121:0/1661289027 shutdown_connections 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.870+0000 7f4403c42640 1 -- 172.21.15.121:0/1661289027 wait complete. 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f4403c42640 1 Processor -- start 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f4403c42640 1 -- start start 2024-09-15T23:57:56.873 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f4403c42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f4403c42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc136350 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f44019de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f44019de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43962/0 (socket says 172.21.15.121:43962) 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f44019de640 1 -- 172.21.15.121:0/464223699 learned_addr learned my addr 172.21.15.121:0/464223699 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.871+0000 7f44019de640 1 -- 172.21.15.121:0/464223699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc1237c0 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f44019de640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c450 tx=0x7f43f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f8017070 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8005220 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc1242b0 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f80035f0 con 0x7f43fc135b50 2024-09-15T23:57:56.874 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.872+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1230e0 con 0x7f43fc135b50 2024-09-15T23:57:56.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 39) ==== 45681+0+0 (secure 0 0 0) 0x7f43f801a070 con 0x7f43fc135b50 2024-09-15T23:57:56.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc09aae0 con 0x7f43fc135b50 2024-09-15T23:57:56.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f43f27fc640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 0x7f43e003a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:56.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f43f804a1e0 con 0x7f43fc135b50 2024-09-15T23:57:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f44011dd640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 0x7f43e003a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:56.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.873+0000 7f44011dd640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 0x7f43e003a6d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f43ec034000 tx=0x7f43ec02e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:56.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:56.877+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43f8011590 con 0x7f43fc135b50 2024-09-15T23:57:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.043+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f43fc0a1f10 con 0x7f43e0038210 2024-09-15T23:57:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.044+0000 7f43f27fc640 1 -- 172.21.15.121:0/464223699 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f43fc0a1f10 con 0x7f43e0038210 2024-09-15T23:57:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T23:57:57.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 msgr2=0x7f43e003a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 0x7f43e003a6d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f43ec034000 tx=0x7f43ec02e000 comp rx=0 tx=0).stop 2024-09-15T23:57:57.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 msgr2=0x7f43fc11fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f43f800c450 tx=0x7f43f800c910 comp rx=0 tx=0).stop 2024-09-15T23:57:57.047 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 shutdown_connections 2024-09-15T23:57:57.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f43e0038210 0x7f43e003a6d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 --2- 172.21.15.121:0/464223699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43fc135b50 0x7f43fc11fce0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 >> 172.21.15.121:0/464223699 conn(0x7f43fc0a85e0 msgr2=0x7f43fc09f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 shutdown_connections 2024-09-15T23:57:57.048 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.046+0000 7f4403c42640 1 -- 172.21.15.121:0/464223699 wait complete. 2024-09-15T23:57:57.057 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T23:57:57.058 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:57:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.159+0000 7fc0a9303640 1 Processor -- start 2024-09-15T23:57:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a9303640 1 -- start start 2024-09-15T23:57:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a9303640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0a406fc80 0x7fc0a413ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a9303640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a406f810 con 0x7fc0a4134b30 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a9303640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a409ff90 con 0x7fc0a406fc80 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0a406fc80 0x7fc0a413ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a27fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fc0a406fc80 0x7fc0a413ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43966/0 (socket says 172.21.15.121:43966) 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a27fc640 1 -- 172.21.15.121:0/3809522836 learned_addr learned my addr 172.21.15.121:0/3809522836 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.160+0000 7fc0a27fc640 1 -- 172.21.15.121:0/3809522836 >> v1:172.21.15.121:6789/0 conn(0x7fc0a4134b30 legacy=0x7fc0a4134f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.161+0000 7fc0a27fc640 1 -- 172.21.15.121:0/3809522836 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a406c9e0 con 0x7fc0a406fc80 2024-09-15T23:57:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.161+0000 7fc0a27fc640 1 --2- 172.21.15.121:0/3809522836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a413ce70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097f0 tx=0x7fc09802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65abd608525d739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.161+0000 7fc0a1ffb640 1 -- 172.21.15.121:0/3809522836 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc098037070 con 0x7fc0a406fc80 2024-09-15T23:57:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.161+0000 7fc0a1ffb640 1 -- 172.21.15.121:0/3809522836 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc098032440 con 0x7fc0a406fc80 2024-09-15T23:57:57.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.161+0000 7fc0a1ffb640 1 -- 172.21.15.121:0/3809522836 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc098032740 con 0x7fc0a406fc80 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 -- 172.21.15.121:0/3809522836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 msgr2=0x7fc0a413ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3809522836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a413ce70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc0980097f0 tx=0x7fc09802a270 comp rx=0 tx=0).stop 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 -- 172.21.15.121:0/3809522836 shutdown_connections 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3809522836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a413ce70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 -- 172.21.15.121:0/3809522836 >> 172.21.15.121:0/3809522836 conn(0x7fc0a40a94e0 msgr2=0x7fc0a40a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 -- 172.21.15.121:0/3809522836 shutdown_connections 2024-09-15T23:57:57.164 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.162+0000 7fc0a9303640 1 -- 172.21.15.121:0/3809522836 wait complete. 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.163+0000 7fc0a9303640 1 Processor -- start 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.163+0000 7fc0a9303640 1 -- start start 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a9303640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a9303640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a40700d0 con 0x7fc0a406fc80 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43980/0 (socket says 172.21.15.121:43980) 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a2ffd640 1 -- 172.21.15.121:0/3389921645 learned_addr learned my addr 172.21.15.121:0/3389921645 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a2ffd640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a40a3cd0 con 0x7fc0a406fc80 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a2ffd640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c450 tx=0x7fc09400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc094017070 con 0x7fc0a406fc80 2024-09-15T23:57:57.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc094005220 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a40a2010 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0940035f0 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.164+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a409e270 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0a40a4220 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7fc09401a070 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 0x7fc09003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7fc09404a2b0 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 0x7fc09003f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc09401ae50 con 0x7fc09003d040 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc0a27fc640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 0x7fc09003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.165+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fc094051050 con 0x7fc0a406fc80 2024-09-15T23:57:57.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.166+0000 7fc0a37fe640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 0x7fc09003f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.166+0000 7fc0a27fc640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 0x7fc09003a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc098034000 tx=0x7fc09802e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.166+0000 7fc0a37fe640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 0x7fc09003f480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.166+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== osd.1 v2:172.21.15.121:6808/4042695749 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc09401ae50 con 0x7fc09003d040 2024-09-15T23:57:57.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 --> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0a4134b30 con 0x7fc09003d040 2024-09-15T23:57:57.180 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc08b7fe640 1 -- 172.21.15.121:0/3389921645 <== osd.1 v2:172.21.15.121:6808/4042695749 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0a4134b30 con 0x7fc09003d040 2024-09-15T23:57:57.180 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:57.180 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:57:57.180 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 msgr2=0x7fc09003f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 0x7fc09003f480 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.181 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 msgr2=0x7fc09003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 0x7fc09003a760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc098034000 tx=0x7fc09802e000 comp rx=0 tx=0).stop 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 msgr2=0x7fc0a41cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c450 tx=0x7fc09400c910 comp rx=0 tx=0).stop 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 shutdown_connections 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6808/4042695749,v1:172.21.15.121:6809/4042695749] conn(0x7fc09003d040 0x7fc09003f480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fc0900382a0 0x7fc09003a760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 --2- 172.21.15.121:0/3389921645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0a406fc80 0x7fc0a41cec70 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 >> 172.21.15.121:0/3389921645 conn(0x7fc0a40a94e0 msgr2=0x7fc0a4136c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 shutdown_connections 2024-09-15T23:57:57.182 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.179+0000 7fc0a9303640 1 -- 172.21.15.121:0/3389921645 wait complete. 2024-09-15T23:57:57.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T23:57:57.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.289+0000 7fd09b2f8640 1 Processor -- start 2024-09-15T23:57:57.290 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd09b2f8640 1 -- start start 2024-09-15T23:57:57.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd09b2f8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd0940a4c20 0x7fd09413f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.291 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd09b2f8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd09413a080 con 0x7fd09413a280 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd09b2f8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fd0940a3d50 con 0x7fd0940a4c20 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd098893640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd0940a4c20 0x7fd09413f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd098893640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fd0940a4c20 0x7fd09413f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43984/0 (socket says 172.21.15.121:43984) 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd098893640 1 -- 172.21.15.121:0/3980753083 learned_addr learned my addr 172.21.15.121:0/3980753083 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd098893640 1 -- 172.21.15.121:0/3980753083 >> v1:172.21.15.121:6789/0 conn(0x7fd09413a280 legacy=0x7fd09413a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.292 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.290+0000 7fd098893640 1 -- 172.21.15.121:0/3980753083 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0940a3f80 con 0x7fd0940a4c20 2024-09-15T23:57:57.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.291+0000 7fd098893640 1 --2- 172.21.15.121:0/3980753083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd09413f060 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd0900097f0 tx=0x7fd09002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296997eb81441a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.293 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.291+0000 7fd087fff640 1 -- 172.21.15.121:0/3980753083 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd090037070 con 0x7fd0940a4c20 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.291+0000 7fd087fff640 1 -- 172.21.15.121:0/3980753083 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd090032440 con 0x7fd0940a4c20 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.291+0000 7fd087fff640 1 -- 172.21.15.121:0/3980753083 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd09002ae60 con 0x7fd0940a4c20 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3980753083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 msgr2=0x7fd09413f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3980753083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd09413f060 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd0900097f0 tx=0x7fd09002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3980753083 shutdown_connections 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3980753083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd09413f060 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3980753083 >> 172.21.15.121:0/3980753083 conn(0x7fd0940ac3e0 msgr2=0x7fd0940ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3980753083 shutdown_connections 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.292+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3980753083 wait complete. 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd09b2f8640 1 Processor -- start 2024-09-15T23:57:57.294 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd09b2f8640 1 -- start start 2024-09-15T23:57:57.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd09b2f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd09b2f8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0940a7ec0 con 0x7fd0940a4c20 2024-09-15T23:57:57.296 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd099094640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd099094640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43990/0 (socket says 172.21.15.121:43990) 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.293+0000 7fd099094640 1 -- 172.21.15.121:0/3847910558 learned_addr learned my addr 172.21.15.121:0/3847910558 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd099094640 1 -- 172.21.15.121:0/3847910558 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd094125070 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd099094640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd08800c450 tx=0x7fd08800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd088017070 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd088005220 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0880035f0 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd094124780 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.294+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd094124470 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.295+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7fd08801a070 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.295+0000 7fd085ffb640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 0x7fd07803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.295+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd094122c20 con 0x7fd0940a4c20 2024-09-15T23:57:57.297 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.295+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7fd08804a2b0 con 0x7fd0940a4c20 2024-09-15T23:57:57.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.295+0000 7fd098893640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 0x7fd07803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.298 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.296+0000 7fd098893640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 0x7fd07803a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd090034000 tx=0x7fd09002e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.300 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.300+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd08801ac60 con 0x7fd0940a4c20 2024-09-15T23:57:57.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.465+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd094138670 con 0x7fd0780382a0 2024-09-15T23:57:57.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.466+0000 7fd085ffb640 1 -- 172.21.15.121:0/3847910558 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd090032710 con 0x7fd0780382a0 2024-09-15T23:57:57.467 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 msgr2=0x7fd07803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 0x7fd07803a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd090034000 tx=0x7fd09002e000 comp rx=0 tx=0).stop 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 msgr2=0x7fd0940a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd08800c450 tx=0x7fd08800c910 comp rx=0 tx=0).stop 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 shutdown_connections 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fd0780382a0 0x7fd07803a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 --2- 172.21.15.121:0/3847910558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0940a4c20 0x7fd0940a0ff0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 >> 172.21.15.121:0/3847910558 conn(0x7fd0940ac3e0 msgr2=0x7fd0940aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 shutdown_connections 2024-09-15T23:57:57.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.468+0000 7fd09b2f8640 1 -- 172.21.15.121:0/3847910558 wait complete. 2024-09-15T23:57:57.479 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T23:57:57.480 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:57:57.581 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcc4b2a640 1 Processor -- start 2024-09-15T23:57:57.582 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcc4b2a640 1 -- start start 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcc4b2a640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbcc00a3b90 0x7fbcc00a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcc4b2a640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc00a4560 con 0x7fbcc00a37b0 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcc4b2a640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc009b4f0 con 0x7fbcc00a3b90 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcbdd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbcc00a3b90 0x7fbcc00a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcbdd9b640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7fbcc00a3b90 0x7fbcc00a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43996/0 (socket says 172.21.15.121:43996) 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.581+0000 7fbcbdd9b640 1 -- 172.21.15.121:0/4113125631 learned_addr learned my addr 172.21.15.121:0/4113125631 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbdd9b640 1 -- 172.21.15.121:0/4113125631 >> v1:172.21.15.121:6789/0 conn(0x7fbcc00a37b0 legacy=0x7fbcc009acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.583 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbdd9b640 1 -- 172.21.15.121:0/4113125631 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc00a1c90 con 0x7fbcc00a3b90 2024-09-15T23:57:57.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbdd9b640 1 --2- 172.21.15.121:0/4113125631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a3b90 0x7fbcc00a4020 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ba90 tx=0x7fbcb402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac76900a860eef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.584 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbd59a640 1 -- 172.21.15.121:0/4113125631 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4033570 con 0x7fbcc00a3b90 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbd59a640 1 -- 172.21.15.121:0/4113125631 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb4038070 con 0x7fbcc00a3b90 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.582+0000 7fbcbd59a640 1 -- 172.21.15.121:0/4113125631 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb4033860 con 0x7fbcc00a3b90 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/4113125631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a3b90 msgr2=0x7fbcc00a4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/4113125631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a3b90 0x7fbcc00a4020 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ba90 tx=0x7fbcb402c8b0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/4113125631 shutdown_connections 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/4113125631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a3b90 0x7fbcc00a4020 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/4113125631 >> 172.21.15.121:0/4113125631 conn(0x7fbcc00a8430 msgr2=0x7fbcc00a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/4113125631 shutdown_connections 2024-09-15T23:57:57.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.583+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/4113125631 wait complete. 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.584+0000 7fbcc4b2a640 1 Processor -- start 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.584+0000 7fbcc4b2a640 1 -- start start 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcc4b2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcc4b2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc00a5220 con 0x7fbcc00a37b0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcbe59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcbe59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44000/0 (socket says 172.21.15.121:44000) 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcbe59c640 1 -- 172.21.15.121:0/657826892 learned_addr learned my addr 172.21.15.121:0/657826892 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcbe59c640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc0122d80 con 0x7fbcc00a37b0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcbe59c640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000c450 tx=0x7fbcb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb0017070 con 0x7fbcc00a37b0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0005220 con 0x7fbcc00a37b0 2024-09-15T23:57:57.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc0124100 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcb00035f0 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.585+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc0124410 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcc00a4020 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7fbcb001a070 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 0x7fbca003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7fbcb004a3c0 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcbdd9b640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 0x7fbca003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 0x7fbca003f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcb0015e70 con 0x7fbca003d040 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.586+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbcb0051050 con 0x7fbcc00a37b0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.587+0000 7fbcbed9d640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 0x7fbca003f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.587+0000 7fbcbdd9b640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 0x7fbca003a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ba90 tx=0x7fbcb4008040 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.587+0000 7fbcbed9d640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 0x7fbca003f480 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.588+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== osd.2 v2:172.21.15.121:6812/1644151022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcb0015e70 con 0x7fbca003d040 2024-09-15T23:57:57.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.600+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 --> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcc00a1f00 con 0x7fbca003d040 2024-09-15T23:57:57.601 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.600+0000 7fbcaeffd640 1 -- 172.21.15.121:0/657826892 <== osd.2 v2:172.21.15.121:6812/1644151022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcc00a1f00 con 0x7fbca003d040 2024-09-15T23:57:57.601 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-15T23:57:57.601 INFO:teuthology.orchestra.run.smithi121.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:57:57.601 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-15T23:57:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.600+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 msgr2=0x7fbca003f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.600+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 0x7fbca003f480 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 msgr2=0x7fbca003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 0x7fbca003a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400ba90 tx=0x7fbcb4008040 comp rx=0 tx=0).stop 2024-09-15T23:57:57.602 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 msgr2=0x7fbcc0071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000c450 tx=0x7fbcb000c910 comp rx=0 tx=0).stop 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 shutdown_connections 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6812/1644151022,v1:172.21.15.121:6814/1644151022] conn(0x7fbca003d040 0x7fbca003f480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7fbca00382a0 0x7fbca003a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 --2- 172.21.15.121:0/657826892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc00a37b0 0x7fbcc0071a20 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 >> 172.21.15.121:0/657826892 conn(0x7fbcc00a8430 msgr2=0x7fbcc0136eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 shutdown_connections 2024-09-15T23:57:57.603 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.601+0000 7fbcc4b2a640 1 -- 172.21.15.121:0/657826892 wait complete. 2024-09-15T23:57:57.611 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84e27e8640 1 Processor -- start 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84e27e8640 1 -- start start 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84e27e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84dc0a51c0 0x7f84dc136ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84e27e8640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84dc136890 con 0x7f84dc0a0ba0 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84e27e8640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f84dc0a55a0 con 0x7f84dc0a51c0 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.710+0000 7f84dbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84dc0a51c0 0x7f84dc136ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84dbfff640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f84dc0a51c0 0x7f84dc136ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44010/0 (socket says 172.21.15.121:44010) 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84db7fe640 1 --1- >> v1:172.21.15.121:6789/0 conn(0x7f84dc0a0ba0 0x7f84dc1370e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46034/0 (socket says 172.21.15.121:46034) 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84dbfff640 1 -- 172.21.15.121:0/2680926382 learned_addr learned my addr 172.21.15.121:0/2680926382 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84dbfff640 1 -- 172.21.15.121:0/2680926382 >> v1:172.21.15.121:6789/0 conn(0x7f84dc0a0ba0 legacy=0x7f84dc1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.712 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84dbfff640 1 -- 172.21.15.121:0/2680926382 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc06df80 con 0x7f84dc0a51c0 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.711+0000 7f84dbfff640 1 --2- 172.21.15.121:0/2680926382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc136ba0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0097f0 tx=0x7f84cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf9408ab6173d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84daffd640 1 -- 172.21.15.121:0/2680926382 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc037070 con 0x7f84dc0a51c0 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84daffd640 1 -- 172.21.15.121:0/2680926382 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc032440 con 0x7f84dc0a51c0 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84daffd640 1 -- 172.21.15.121:0/2680926382 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc02ae60 con 0x7f84dc0a51c0 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 -- 172.21.15.121:0/2680926382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 msgr2=0x7f84dc136ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 --2- 172.21.15.121:0/2680926382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc136ba0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0097f0 tx=0x7f84cc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 -- 172.21.15.121:0/2680926382 shutdown_connections 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 --2- 172.21.15.121:0/2680926382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc136ba0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 -- 172.21.15.121:0/2680926382 >> 172.21.15.121:0/2680926382 conn(0x7f84dc0a85e0 msgr2=0x7f84dc0a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 -- 172.21.15.121:0/2680926382 shutdown_connections 2024-09-15T23:57:57.714 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.712+0000 7f84e27e8640 1 -- 172.21.15.121:0/2680926382 wait complete. 2024-09-15T23:57:57.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.713+0000 7f84e27e8640 1 Processor -- start 2024-09-15T23:57:57.715 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.713+0000 7f84e27e8640 1 -- start start 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84e27e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84e27e8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc13bb10 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84dbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44026/0 (socket says 172.21.15.121:44026) 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84dbfff640 1 -- 172.21.15.121:0/206634112 learned_addr learned my addr 172.21.15.121:0/206634112 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84dbfff640 1 -- 172.21.15.121:0/206634112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc1cc4a0 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84dbfff640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f84cc035040 tx=0x7f84cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc041070 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84cc03c7a0 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc070af0 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84cc037040 con 0x7f84dc0a51c0 2024-09-15T23:57:57.717 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.714+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc072910 con 0x7f84dc0a51c0 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.715+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7f84cc044070 con 0x7f84dc0a51c0 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.715+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84dc136ba0 con 0x7f84dc0a51c0 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.715+0000 7f84d8ff9640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 0x7f84c803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.715+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f84cc06bc70 con 0x7f84dc0a51c0 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.716+0000 7f84db7fe640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 0x7f84c803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:57.718 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.716+0000 7f84db7fe640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 0x7f84c803a790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001550 tx=0x7f84d0007a40 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:57.721 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.721+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84cc03a760 con 0x7f84dc0a51c0 2024-09-15T23:57:57.889 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.888+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f84dc071440 con 0x7f84c80382d0 2024-09-15T23:57:57.890 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.889+0000 7f84d8ff9640 1 -- 172.21.15.121:0/206634112 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f84d00070d0 con 0x7f84c80382d0 2024-09-15T23:57:57.890 INFO:teuthology.orchestra.run.smithi121.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 msgr2=0x7f84c803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 0x7f84c803a790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f84d0001550 tx=0x7f84d0007a40 comp rx=0 tx=0).stop 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 msgr2=0x7f84dc1cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f84cc035040 tx=0x7f84cc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 shutdown_connections 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f84c80382d0 0x7f84c803a790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 --2- 172.21.15.121:0/206634112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84dc0a51c0 0x7f84dc1cc9f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 >> 172.21.15.121:0/206634112 conn(0x7f84dc0a85e0 msgr2=0x7f84dc135ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 shutdown_connections 2024-09-15T23:57:57.892 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.891+0000 7f84e27e8640 1 -- 172.21.15.121:0/206634112 wait complete. 2024-09-15T23:57:57.902 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:57:58.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.999+0000 7f3058926640 1 Processor -- start 2024-09-15T23:57:58.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:57.999+0000 7f3058926640 1 -- start start 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f3058926640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3054135b50 0x7f305409aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f3058926640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305409b020 con 0x7f3054135f30 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f3058926640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f305409b310 con 0x7f3054135b50 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f305259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3054135b50 0x7f305409aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f305259c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f3054135b50 0x7f305409aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44028/0 (socket says 172.21.15.121:44028) 2024-09-15T23:57:58.001 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f305259c640 1 -- 172.21.15.121:0/53957252 learned_addr learned my addr 172.21.15.121:0/53957252 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:58.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f305259c640 1 -- 172.21.15.121:0/53957252 >> v1:172.21.15.121:6789/0 conn(0x7f3054135f30 legacy=0x7f30540a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.002 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.000+0000 7f305259c640 1 -- 172.21.15.121:0/53957252 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30540a08c0 con 0x7f3054135b50 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.001+0000 7f305259c640 1 --2- 172.21.15.121:0/53957252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f305409aae0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f30440097f0 tx=0x7f304402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edadb33a96fbcce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.001+0000 7f305159a640 1 -- 172.21.15.121:0/53957252 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044037070 con 0x7f3054135b50 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.001+0000 7f305159a640 1 -- 172.21.15.121:0/53957252 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3044032440 con 0x7f3054135b50 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.001+0000 7f305159a640 1 -- 172.21.15.121:0/53957252 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044032740 con 0x7f3054135b50 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.001+0000 7f3058926640 1 -- 172.21.15.121:0/53957252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 msgr2=0x7f305409aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 --2- 172.21.15.121:0/53957252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f305409aae0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f30440097f0 tx=0x7f304402a270 comp rx=0 tx=0).stop 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 -- 172.21.15.121:0/53957252 shutdown_connections 2024-09-15T23:57:58.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 --2- 172.21.15.121:0/53957252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f305409aae0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 -- 172.21.15.121:0/53957252 >> 172.21.15.121:0/53957252 conn(0x7f30540a85e0 msgr2=0x7f30540a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 -- 172.21.15.121:0/53957252 shutdown_connections 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.002+0000 7f3058926640 1 -- 172.21.15.121:0/53957252 wait complete. 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f3058926640 1 Processor -- start 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f3058926640 1 -- start start 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f3058926640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f3058926640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30540a5430 con 0x7f3054135b50 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f305259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f305259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:44044/0 (socket says 172.21.15.121:44044) 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f305259c640 1 -- 172.21.15.121:0/57151590 learned_addr learned my addr 172.21.15.121:0/57151590 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.003+0000 7f305259c640 1 -- 172.21.15.121:0/57151590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305411fe30 con 0x7f3054135b50 2024-09-15T23:57:58.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f305259c640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f3044035040 tx=0x7f30440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044041020 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30440306c0 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30540a0270 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044037040 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.004+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305409ff90 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7f3044044020 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054136350 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3042ffd640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 0x7f303403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f304406b960 con 0x7f3054135b50 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3051d9b640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 0x7f303403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:57:58.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.005+0000 7f3051d9b640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 0x7f303403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3048000f60 tx=0x7f3048007a30 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:57:58.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.009+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f304404b030 con 0x7f3054135b50 2024-09-15T23:57:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.172+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30540a1f10 con 0x7f30340382a0 2024-09-15T23:57:58.173 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.172+0000 7f3042ffd640 1 -- 172.21.15.121:0/57151590 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9691 (secure 0 0 0) 0x7f30540a1f10 con 0x7f30340382a0 2024-09-15T23:57:58.173 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:57:58.174 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:57:58.175 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 msgr2=0x7f303403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 0x7f303403a760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3048000f60 tx=0x7f3048007a30 comp rx=0 tx=0).stop 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 msgr2=0x7f30541ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f3044035040 tx=0x7f30440046c0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 shutdown_connections 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f30340382a0 0x7f303403a760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 --2- 172.21.15.121:0/57151590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3054135b50 0x7f30541ce990 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 >> 172.21.15.121:0/57151590 conn(0x7f30540a85e0 msgr2=0x7f305409d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.174+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 shutdown_connections 2024-09-15T23:57:58.176 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:57:58.175+0000 7f3058926640 1 -- 172.21.15.121:0/57151590 wait complete. 2024-09-15T23:57:58.186 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-15T23:57:56.711103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":96708,"kb_used_data":3140,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018812,"statfs":{"total":289910292480,"available":289811263488,"internally_reserved":0,"allocated":3215360,"data_stored":1982995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.995884"},"pg_stats":[{"pgid":"1.0","version":"61'152","reported_seq":449,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T23:57:53.710561+0000","last_change":"2024-09-15T23:55:05.790111+0000","last_active":"2024-09-15T23:57:53.710561+0000","last_peered":"2024-09-15T23:57:53.710561+0000","last_clean":"2024-09-15T23:57:53.710561+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:53.710561+0000","last_undegraded":"2024-09-15T23:57:53.710561+0000","last_fullsized":"2024-09-15T23:57:53.710561+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:55:04.373545+0000","last_clean_scrub_stamp":"2024-09-15T23:55:04.373545+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:21.662578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":586,"num_read_kb":1121,"num_write":237,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705698,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":271054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705698,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":854072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1265664,"data_stored":857869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:57:58.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T23:55:04.373545+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=23, tm_min=55, tm_sec=4, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=23, tm_min=57, tm_sec=55, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T23:57:58.189 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T23:58:04.824 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:18.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:58:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9fa19ef640 1 Processor -- start 2024-09-15T23:58:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9fa19ef640 1 -- start start 2024-09-15T23:58:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9fa19ef640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9fa19ef640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f9c134520 con 0x7f9f9c134720 2024-09-15T23:58:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9fa19ef640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f9f9c0a97d0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9f9a7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9f9a7fc640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36080/0 (socket says 172.21.15.121:36080) 2024-09-15T23:58:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9f9a7fc640 1 -- 172.21.15.121:0/2558327096 learned_addr learned my addr 172.21.15.121:0/2558327096 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.300+0000 7f9f9affd640 1 --1- 172.21.15.121:0/2558327096 >> v1:172.21.15.121:6789/0 conn(0x7f9f9c134720 0x7f9f9c134b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.121:6789/0 says I am v1:172.21.15.121:46832/0 (socket says 172.21.15.121:46832) 2024-09-15T23:58:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.301+0000 7f9f9a7fc640 1 -- 172.21.15.121:0/2558327096 >> v1:172.21.15.121:6789/0 conn(0x7f9f9c134720 legacy=0x7f9f9c134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.301+0000 7f9f9a7fc640 1 -- 172.21.15.121:0/2558327096 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c070a20 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.301+0000 7f9f9a7fc640 1 --2- 172.21.15.121:0/2558327096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c070bf0 tx=0x7f9f9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92000cd43ace385 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9f99ffb640 1 -- 172.21.15.121:0/2558327096 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90037070 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9f99ffb640 1 -- 172.21.15.121:0/2558327096 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f90032440 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9f99ffb640 1 -- 172.21.15.121:0/2558327096 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f9002ae60 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 -- 172.21.15.121:0/2558327096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 msgr2=0x7f9f9c13cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/2558327096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c070bf0 tx=0x7f9f9002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 -- 172.21.15.121:0/2558327096 shutdown_connections 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/2558327096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c13cb20 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 -- 172.21.15.121:0/2558327096 >> 172.21.15.121:0/2558327096 conn(0x7f9f9c09ac50 msgr2=0x7f9f9c09d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 -- 172.21.15.121:0/2558327096 shutdown_connections 2024-09-15T23:58:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.302+0000 7f9fa19ef640 1 -- 172.21.15.121:0/2558327096 wait complete. 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.303+0000 7f9fa19ef640 1 Processor -- start 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.303+0000 7f9fa19ef640 1 -- start start 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9fa19ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9fa19ef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9c070140 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f9affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36094/0 (socket says 172.21.15.121:36094) 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f9affd640 1 -- 172.21.15.121:0/160823323 learned_addr learned my addr 172.21.15.121:0/160823323 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f9affd640 1 -- 172.21.15.121:0/160823323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c0a7cf0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f9affd640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00c450 tx=0x7f9f8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.304+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f8c007410 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.305+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0075b0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.305+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f8c004910 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.305+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9c11f8b0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.305+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9c09cbe0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.305+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7f9f8c01a020 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.306+0000 7f9f83fff640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 0x7f9f8803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.306+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f9f8c04a8f0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.306+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c067bc0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.306+0000 7f9f9a7fc640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 0x7f9f8803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.306+0000 7f9f9a7fc640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 0x7f9f8803a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f9002e000 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.310+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f8c01b9c0 con 0x7f9f9c0a0b70 2024-09-15T23:58:18.476 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.474+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 --> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f9c09fe10 con 0x7f9f880382a0 2024-09-15T23:58:18.477 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.475+0000 7f9f83fff640 1 -- 172.21.15.121:0/160823323 <== mgr.5088 v2:172.21.15.121:6828/3272336370 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9658 (secure 0 0 0) 0x7f9f9c09fe10 con 0x7f9f880382a0 2024-09-15T23:58:18.477 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:58:18.477 INFO:teuthology.orchestra.run.smithi121.stderr:dumped all 2024-09-15T23:58:18.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 msgr2=0x7f9f8803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 0x7f9f8803a760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f9002e000 comp rx=0 tx=0).stop 2024-09-15T23:58:18.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 msgr2=0x7f9f9c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00c450 tx=0x7f9f8c00c910 comp rx=0 tx=0).stop 2024-09-15T23:58:18.479 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 shutdown_connections 2024-09-15T23:58:18.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f9f880382a0 0x7f9f8803a760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 --2- 172.21.15.121:0/160823323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f9c0a0b70 0x7f9f9c0a5990 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 >> 172.21.15.121:0/160823323 conn(0x7f9f9c09ac50 msgr2=0x7f9f9c1321f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 shutdown_connections 2024-09-15T23:58:18.480 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.477+0000 7f9fa19ef640 1 -- 172.21.15.121:0/160823323 wait complete. 2024-09-15T23:58:18.490 INFO:teuthology.orchestra.run.smithi121.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-15T23:58:16.715279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":1327,"num_write":257,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":2,"kb":283115520,"kb_used":96720,"kb_used_data":3164,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283018800,"statfs":{"total":289910292480,"available":289811251200,"internally_reserved":0,"allocated":3239936,"data_stored":1993898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002738"},"pg_stats":[{"pgid":"1.0","version":"73'164","reported_seq":498,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T23:57:57.723912+0000","last_change":"2024-09-15T23:57:57.723963+0000","last_active":"2024-09-15T23:57:57.723912+0000","last_peered":"2024-09-15T23:57:57.723912+0000","last_clean":"2024-09-15T23:57:57.723912+0000","last_became_active":"2024-09-15T23:55:05.789079+0000","last_became_peered":"2024-09-15T23:55:05.789079+0000","last_unstale":"2024-09-15T23:57:57.723912+0000","last_undegraded":"2024-09-15T23:57:57.723912+0000","last_fullsized":"2024-09-15T23:57:57.723912+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"73'164","last_scrub_stamp":"2024-09-15T23:57:57.723810+0000","last_deep_scrub":"73'164","last_deep_scrub_stamp":"2024-09-15T23:57:57.723810+0000","last_clean_scrub_stamp":"2024-09-15T23:57:57.723810+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:51.570577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":1327,"num_write":257,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":1327,"num_write":257,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705702,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":271054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":861422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1277952,"data_stored":861422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:58:18.491 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T23:58:18.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.586+0000 7f0c3b56d640 1 Processor -- start 2024-09-15T23:58:18.588 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.586+0000 7f0c3b56d640 1 -- start start 2024-09-15T23:58:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c3b56d640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c340a7140 0x7f0c340a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c3b56d640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c340a6d10 con 0x7f0c340a4ab0 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c3b56d640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3406e230 con 0x7f0c340a7140 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c39309640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c340a7140 0x7f0c340a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c39309640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f0c340a7140 0x7f0c340a7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36100/0 (socket says 172.21.15.121:36100) 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c39309640 1 -- 172.21.15.121:0/2517562942 learned_addr learned my addr 172.21.15.121:0/2517562942 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c39309640 1 -- 172.21.15.121:0/2517562942 >> v1:172.21.15.121:6789/0 conn(0x7f0c340a4ab0 legacy=0x7f0c34139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.587+0000 7f0c39309640 1 -- 172.21.15.121:0/2517562942 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340a3ae0 con 0x7f0c340a7140 2024-09-15T23:58:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.588+0000 7f0c39309640 1 --2- 172.21.15.121:0/2517562942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a7140 0x7f0c340a7520 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0c300097f0 tx=0x7f0c3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235f95ac2338ef4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.588+0000 7f0c2bfff640 1 -- 172.21.15.121:0/2517562942 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c30037070 con 0x7f0c340a7140 2024-09-15T23:58:18.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.588+0000 7f0c2bfff640 1 -- 172.21.15.121:0/2517562942 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c30032440 con 0x7f0c340a7140 2024-09-15T23:58:18.591 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.588+0000 7f0c2bfff640 1 -- 172.21.15.121:0/2517562942 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3002ae60 con 0x7f0c340a7140 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 -- 172.21.15.121:0/2517562942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a7140 msgr2=0x7f0c340a7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/2517562942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a7140 0x7f0c340a7520 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0c300097f0 tx=0x7f0c3002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 -- 172.21.15.121:0/2517562942 shutdown_connections 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/2517562942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a7140 0x7f0c340a7520 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 -- 172.21.15.121:0/2517562942 >> 172.21.15.121:0/2517562942 conn(0x7f0c340ac370 msgr2=0x7f0c340ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 -- 172.21.15.121:0/2517562942 shutdown_connections 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.589+0000 7f0c3b56d640 1 -- 172.21.15.121:0/2517562942 wait complete. 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c3b56d640 1 Processor -- start 2024-09-15T23:58:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c3b56d640 1 -- start start 2024-09-15T23:58:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c3b56d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c3b56d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340a7fc0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c39309640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c39309640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36106/0 (socket says 172.21.15.121:36106) 2024-09-15T23:58:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c39309640 1 -- 172.21.15.121:0/912627090 learned_addr learned my addr 172.21.15.121:0/912627090 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c39309640 1 -- 172.21.15.121:0/912627090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c34122b90 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.590+0000 7f0c39309640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0c30035040 tx=0x7f0c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.591+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c30041070 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.591+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3003c7a0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.591+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c34124ae0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.591+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c30037040 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.591+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c34123450 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7f0c30044070 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c29ffb640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 0x7f0c1803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34124f20 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f0c3006bb80 con 0x7f0c340a4ab0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c38b08640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 0x7f0c1803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.595 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.592+0000 7f0c38b08640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 0x7f0c1803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c24000f60 tx=0x7f0c24007a30 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.597+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c3003a760 con 0x7f0c340a4ab0 2024-09-15T23:58:18.766 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.765+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0c340732e0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.768 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.767+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f0c3003d3f0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.769 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.767+0000 7f0c29ffb640 1 -- 172.21.15.121:0/912627090 <== mon.0 v2:172.21.15.121:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0c3003caa0 con 0x7f0c340a4ab0 2024-09-15T23:58:18.771 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 msgr2=0x7f0c1803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 0x7f0c1803a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c24000f60 tx=0x7f0c24007a30 comp rx=0 tx=0).stop 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 msgr2=0x7f0c340a10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0c30035040 tx=0x7f0c300046c0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 shutdown_connections 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f0c180382a0 0x7f0c1803a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 --2- 172.21.15.121:0/912627090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c340a4ab0 0x7f0c340a10f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 >> 172.21.15.121:0/912627090 conn(0x7f0c340ac370 msgr2=0x7f0c341395a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 shutdown_connections 2024-09-15T23:58:18.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.769+0000 7f0c3b56d640 1 -- 172.21.15.121:0/912627090 wait complete. 2024-09-15T23:58:18.782 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:58:18.783 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:58:18.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.879+0000 7f879784c640 1 Processor -- start 2024-09-15T23:58:18.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.879+0000 7f879784c640 1 -- start start 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.879+0000 7f879784c640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8790135b50 0x7f879009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.879+0000 7f879784c640 1 -- --> v1:172.21.15.121:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879009b020 con 0x7f8790135f30 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.879+0000 7f879784c640 1 -- --> v2:172.21.15.121:3300/0 -- mon_getmap magic: 0 -- 0x7f879009b310 con 0x7f8790135b50 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.880+0000 7f87955e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8790135b50 0x7f879009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.880+0000 7f87955e8640 1 --2- >> v2:172.21.15.121:3300/0 conn(0x7f8790135b50 0x7f879009aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36116/0 (socket says 172.21.15.121:36116) 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.880+0000 7f87955e8640 1 -- 172.21.15.121:0/204207623 learned_addr learned my addr 172.21.15.121:0/204207623 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.880+0000 7f87955e8640 1 -- 172.21.15.121:0/204207623 >> v1:172.21.15.121:6789/0 conn(0x7f8790135f30 legacy=0x7f87900a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.880+0000 7f87955e8640 1 -- 172.21.15.121:0/204207623 --> v2:172.21.15.121:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87900a08c0 con 0x7f8790135b50 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f87955e8640 1 --2- 172.21.15.121:0/204207623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879009aae0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f878c0097f0 tx=0x7f878c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe0bac4f68a975c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f8787fff640 1 -- 172.21.15.121:0/204207623 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c037070 con 0x7f8790135b50 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f8787fff640 1 -- 172.21.15.121:0/204207623 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f878c032440 con 0x7f8790135b50 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f8787fff640 1 -- 172.21.15.121:0/204207623 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c032760 con 0x7f8790135b50 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 -- 172.21.15.121:0/204207623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 msgr2=0x7f879009aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 --2- 172.21.15.121:0/204207623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879009aae0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f878c0097f0 tx=0x7f878c02a270 comp rx=0 tx=0).stop 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 -- 172.21.15.121:0/204207623 shutdown_connections 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 --2- 172.21.15.121:0/204207623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879009aae0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 -- 172.21.15.121:0/204207623 >> 172.21.15.121:0/204207623 conn(0x7f87900a85e0 msgr2=0x7f87900a4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 -- 172.21.15.121:0/204207623 shutdown_connections 2024-09-15T23:58:18.884 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.881+0000 7f879784c640 1 -- 172.21.15.121:0/204207623 wait complete. 2024-09-15T23:58:18.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.882+0000 7f879784c640 1 Processor -- start 2024-09-15T23:58:18.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.882+0000 7f879784c640 1 -- start start 2024-09-15T23:58:18.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f879784c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.886 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f879784c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87900a5430 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f87955e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f87955e8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36124/0 (socket says 172.21.15.121:36124) 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f87955e8640 1 -- 172.21.15.121:0/414727127 learned_addr learned my addr 172.21.15.121:0/414727127 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f87955e8640 1 -- 172.21.15.121:0/414727127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87901241f0 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f87955e8640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f878c02a2b0 tx=0x7f878c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c041020 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f878c030840 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8790123660 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.883+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f878c037040 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.884+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8790134fb0 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.884+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 40) ==== 45737+0+0 (secure 0 0 0) 0x7f878c044020 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.884+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8790136350 con 0x7f8790135b50 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.885+0000 7f8785ffb640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 0x7f877403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:58:18.887 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.885+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 2931+0+0 (secure 0 0 0) 0x7f878c06ba90 con 0x7f8790135b50 2024-09-15T23:58:18.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.885+0000 7f8794de7640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 0x7f877403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:58:18.888 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.885+0000 7f8794de7640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 0x7f877403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8780001560 tx=0x7f8780007a50 comp rx=0 tx=0).ready entity=mgr.5088 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:58:18.891 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:18.889+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f878c04b030 con 0x7f8790135b50 2024-09-15T23:58:19.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.087+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87900a1f10 con 0x7f8790135b50 2024-09-15T23:58:19.089 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.088+0000 7f8785ffb640 1 -- 172.21.15.121:0/414727127 <== mon.0 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+2267 (secure 0 0 0) 0x7f878c031e80 con 0x7f8790135b50 2024-09-15T23:58:19.090 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-15T23:58:19.090 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":38,"btime":"2024-09-15T23:57:51:067865+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4989,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6825/1416349469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1416349469},{"type":"v1","addr":"172.21.15.121:6825","nonce":1416349469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6827/1545000266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1545000266},{"type":"v1","addr":"172.21.15.121:6827","nonce":1545000266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-09-15T23:58:19.090 INFO:teuthology.orchestra.run.smithi121.stderr:dumped fsmap epoch 38 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 msgr2=0x7f877403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 0x7f877403a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8780001560 tx=0x7f8780007a50 comp rx=0 tx=0).stop 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 msgr2=0x7f879011fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f878c02a2b0 tx=0x7f878c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 shutdown_connections 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:6828/3272336370,v1:172.21.15.121:6829/3272336370] conn(0x7f87740382a0 0x7f877403a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:19.092 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 --2- 172.21.15.121:0/414727127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8790135b50 0x7f879011fb80 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:58:19.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 >> 172.21.15.121:0/414727127 conn(0x7f87900a85e0 msgr2=0x7f87900a2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:58:19.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 shutdown_connections 2024-09-15T23:58:19.093 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-15T23:58:19.090+0000 7f879784c640 1 -- 172.21.15.121:0/414727127 wait complete. 2024-09-15T23:58:19.103 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T23:58:19.103 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T23:58:19.103 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:58:19.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.112 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:58:19.112 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:58:19.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.162 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:58:19.163 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T23:58:19.163 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T23:58:19.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.228 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T23:58:19.228 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T23:58:19.228 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.298 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T23:58:19.298 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T23:58:19.298 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.367 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T23:58:19.367 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T23:58:19.367 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T23:58:19.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.439 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T23:58:19.439 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T23:58:19.439 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T23:58:19.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:58:19.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-15T23:58:19.491 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T23:58:19.492 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T23:58:19.492 DEBUG:teuthology.orchestra.run.smithi121:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T23:58:19.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:58:19.566 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T23:58:19.838 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:58:19.838 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T23:58:19.912 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:58:19.913 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T23:58:19.977 INFO:tasks.ceph:Archiving mon data... 2024-09-15T23:58:19.979 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362/data/mon.a.tgz 2024-09-15T23:58:19.979 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2024-09-15T23:58:19.994 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.fpFD3H57B2 2024-09-15T23:58:19.994 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fpFD3H57B2 2024-09-15T23:58:20.251 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.fpFD3H57B2 2024-09-15T23:58:20.334 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.fpFD3H57B2 is 1MB 2024-09-15T23:58:20.418 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.fpFD3H57B2 2024-09-15T23:58:20.433 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T23:58:20.434 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T23:58:20.558 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T23:58:20.558 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T23:58:20.559 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362/remote/smithi121/crash 2024-09-15T23:58:20.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T23:58:20.621 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T23:58:20.622 DEBUG:teuthology.orchestra.run.smithi121:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:20.708 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T23:58:20.732 INFO:tasks.ceph:Compressing logs... 2024-09-15T23:58:20.733 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:58:20.796 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T23:58:20.797 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2024-09-15T23:58:20.942 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40390.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56533.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.51257.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40390.log: /var/log/ceph/ceph-client.admin.56533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40266.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40390.log.gz 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.56533.log.gz 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.51257.log: /var/log/ceph/ceph-client.admin.40266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2024-09-15T23:58:20.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47437.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40266.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.1.51257.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58919.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47351.log: /var/log/ceph/ceph-client.admin.47914.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46370.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58919.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.58919.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46370.log.gz 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2024-09-15T23:58:20.944 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58157.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44068.log: /var/log/ceph/ceph-client.admin.49072.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53614.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58038.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53614.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.58157.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.53614.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39833.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.58038.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39833.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40812.log 2024-09-15T23:58:20.945 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.39833.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30143.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39483.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.40812.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.tmp-client.admin.30143.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.50279.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.30143.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59087.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39483.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40224.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50279.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50279.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.59087.log.gz 2024-09-15T23:58:20.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59045.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.40224.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54720.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53848.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54720.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59045.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53848.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54720.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48699.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.53848.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53135.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.48699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46884.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49623.log 2024-09-15T23:58:20.947 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53135.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.1.48699.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.46884.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49623.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49623.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55395.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50772.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52566.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.55395.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50772.log.gz 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58241.log 2024-09-15T23:58:20.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52566.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49500.log: /var/log/ceph/ceph-client.admin.58241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46842.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.58241.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50492.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46793.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46842.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.46842.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50492.log.gz 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46793.log: /var/log/ceph/ceph-client.admin.47481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-09-15T23:58:20.949 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46793.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56268.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48022.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56268.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50997.log: /var/log/ceph/ceph-client.admin.48022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48022.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50861.log 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2024-09-15T23:58:20.950 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41125.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43938.log: /var/log/ceph/ceph-client.admin.50861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50861.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56831.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.41125.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40652.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58547.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40652.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.56831.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44152.log 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40652.log.gz 2024-09-15T23:58:20.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44416.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.58547.log.gz 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.44152.log.gz 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44416.log: /var/log/ceph/ceph-client.admin.45438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57199.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.44416.log.gz 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49167.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41565.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46001.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.57199.log: /var/log/ceph/ceph-client.0.41565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48995.log 2024-09-15T23:58:20.952 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46001.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52379.log: 89.0% -- replaced with /var/log/ceph/ceph-client.0.57199.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58711.log 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.0.41565.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55783.log 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.48995.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47052.log 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58711.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.58711.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52009.log 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.55783.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40388.log/var/log/ceph/ceph-client.admin.47052.log: 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47052.log.gz 2024-09-15T23:58:20.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47616.log 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52009.log.gz 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56491.log 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40388.log: /var/log/ceph/ceph-client.admin.47616.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40388.log.gz 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47616.log.gz 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46454.log 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56491.log: /var/log/ceph/ceph-client.admin.43896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.56491.log.gz 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46454.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2024-09-15T23:58:20.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40476.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46454.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56939.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40476.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51865.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.40476.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43589.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56939.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39884.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.51865.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.43589.log.gz 2024-09-15T23:58:20.955 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39884.log: /var/log/ceph/ceph-client.admin.45733.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.39884.log.gz 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47574.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.47574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47574.log.gz 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58115.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-09-15T23:58:20.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58349.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.58115.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47662.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56873.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43547.log: /var/log/ceph/ceph-client.admin.47662.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56310.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47662.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56747.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56310.log: 89.6%/var/log/ceph/ceph-client.admin.56747.log: -- replaced with /var/log/ceph/ceph-client.admin.56873.log.gz 2024-09-15T23:58:20.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56310.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.39968.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.56747.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55741.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53740.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55741.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45891.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.55741.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59439.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 86.2% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53740.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.49416.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45891.log: /var/log/ceph/ceph-client.admin.59439.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.45891.log.gz 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2024-09-15T23:58:20.958 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59439.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46328.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49416.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59003.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46328.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46328.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59003.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44236.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2024-09-15T23:58:20.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44236.log: /var/log/ceph/ceph-client.admin.56663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44983.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.44236.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph.audit.log: gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46747.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44983.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.44983.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49125.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49211.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.46747.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49750.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49125.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49211.log.gz 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58866.log 2024-09-15T23:58:20.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51516.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49750.log.gz 2024-09-15T23:58:20.961 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40182.log 2024-09-15T23:58:20.961 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-09-15T23:58:20.961 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55497.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58866.log: /var/log/ceph/ceph-client.admin.40182.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.58866.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50702.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40182.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50702.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.55497.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52337.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.50702.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39703.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52337.log.gz 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59397.log 2024-09-15T23:58:20.962 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59397.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.39703.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43845.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59397.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58391.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58669.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59171.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58391.log: /var/log/ceph/ceph-client.admin.58669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37779.log 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.58391.log.gz 2024-09-15T23:58:20.963 INFO:teuthology.orchestra.run.smithi121.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.58669.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45663.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.37779.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.59171.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53400.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37779.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53530.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53400.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45663.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43801.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53400.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40896.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53530.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53530.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56046.log 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43801.log.gz 2024-09-15T23:58:20.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40938.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40896.log: /var/log/ceph/ceph-client.admin.56046.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40896.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54900.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56046.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56705.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.40938.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54900.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54900.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59255.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.56705.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58283.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2024-09-15T23:58:20.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58283.log: gzip 86.1% -- replaced with /var/log/ceph/ceph-client.admin.59255.log.gz -5 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58505.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.58283.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51686.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58505.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52295.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.58505.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51781.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.51686.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43505.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51781.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52295.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41023.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51781.log.gz 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40980.log 2024-09-15T23:58:20.966 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43505.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.41023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44194.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40980.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.41023.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47788.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46968.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.44194.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47788.log: /var/log/ceph/ceph-client.admin.46968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.47788.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40056.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.46968.log.gz 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57855.log 2024-09-15T23:58:20.967 INFO:teuthology.orchestra.run.smithi121.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55097.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40056.log: /var/log/ceph/ceph-client.admin.57855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52836.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: 87.0% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40056.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56208.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57855.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.55097.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52836.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43673.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56208.log: /var/log/ceph/ceph-client.admin.47309.log: gzip -5 --verbose 86.5% -- replaced with /var/log/ceph/ceph-client.admin.56208.log.gz 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.admin.47010.log 2024-09-15T23:58:20.968 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34894.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43673.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47010.log: /var/log/ceph/ceph-client.admin.58199.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34894.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.47010.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44500.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45399.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.58199.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.45399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40770.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40389.log 2024-09-15T23:58:20.969 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.45399.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz/var/log/ceph/ceph-client.admin.40770.log: 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52608.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.40770.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40389.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40728.log: /var/log/ceph/ceph-client.admin.52608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52608.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39745.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43715.log: -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 86.4% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr: -5/var/log/ceph/ceph-client.admin.40516.log: --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-09-15T23:58:20.970 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39745.log: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.39745.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55269.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.50421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51609.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.55269.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55825.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51609.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55825.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.51609.log.gz 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2024-09-15T23:58:20.971 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mon.a.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.55825.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45243.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44826.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.45243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53307.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.44826.log: 89.6%/var/log/ceph/ceph-client.admin.53307.log: -- replaced with /var/log/ceph/ceph-client.1.45243.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53307.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48937.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.48937.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-09-15T23:58:20.972 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.44826.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.48937.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57945.log 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43259.log: /var/log/ceph/ceph-client.admin.57945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42046.log 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42844.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.57945.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 86.5% 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56126.log 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.42046.log: gzip/var/log/ceph/ceph-client.admin.56621.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55003.log 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1%/var/log/ceph/ceph-client.admin.56126.log: -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56126.log.gz 2024-09-15T23:58:20.973 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47872.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.1.42046.log.gz/var/log/ceph/ceph-client.admin.55003.log: 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.55003.log.gz 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58449.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47872.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39579.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.58449.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47872.log.gz 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.58449.log.gz 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51949.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39579.log: /var/log/ceph/ceph-client.admin.51949.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.39579.log.gz 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.51949.log.gz 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54108.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40098.log 2024-09-15T23:58:20.974 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.54108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34736.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40098.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40098.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.54108.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.34736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53572.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49458.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48439.log 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49458.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53572.log.gz 2024-09-15T23:58:20.975 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53656.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53656.log: /var/log/ceph/ceph-client.admin.48439.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48439.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.53656.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42236.log: /var/log/ceph/ceph-client.admin.44458.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47532.log: /var/log/ceph/ceph.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T23:58:20.976 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55699.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48282.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.47227.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.55699.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39789.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43096.log: /var/log/ceph/ceph-client.0.48282.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59297.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39789.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.39789.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.48282.log.gz 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-09-15T23:58:20.977 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51907.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.59297.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.51907.log: 90.0% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51907.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.50053.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40140.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43156.log: /var/log/ceph/ceph-client.1.50053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40140.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40140.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.1.50053.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- 90.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-mgr.x.log 2024-09-15T23:58:20.978 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35141.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52201.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52421.log 85.0% -- replaced with /var/log/ceph/ceph-client.admin.35141.log.gz 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53782.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.52201.log.gz 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39661.log 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52421.log.gz 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39661.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53782.log.gzgzip 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40014.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.39661.log.gz 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44374.log 2024-09-15T23:58:20.979 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40602.log: /var/log/ceph/ceph-client.admin.40014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.40014.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44374.log: gzip -5 --verbose -- 86.0% -- replaced with /var/log/ceph/ceph-client.admin.44374.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.46538.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.46538.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42599.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49707.log: /var/log/ceph/ceph-client.admin.43339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55909.log 2024-09-15T23:58:20.980 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42599.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 86.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42599.log.gz -- 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.admin.46412.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55909.log: /var/log/ceph/ceph-client.admin.46412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.55909.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40622.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46412.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46496.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47704.log: -- /var/log/ceph/ceph-client.admin.43421.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46496.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51823.log 2024-09-15T23:58:20.981 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46496.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43421.log: /var/log/ceph/ceph-client.admin.51823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53053.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6%/var/log/ceph/ceph-client.admin.55646.log: -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 86.3% -- replaced with /var/log/ceph/ceph-client.admin.51823.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46198.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52973.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53053.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52776.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.46198.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52253.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52973.log.gz 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57772.log 2024-09-15T23:58:20.982 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52776.log: /var/log/ceph/ceph-client.admin.52253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.57616.log 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57772.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.52776.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.52253.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55951.log 86.4% 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57772.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55437.log 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.57616.log: /var/log/ceph/ceph-client.admin.55951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55867.log 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55437.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.55951.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.55437.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.1.57616.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40515.log 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3%/var/log/ceph/ceph-client.admin.53177.log: -- replaced with /var/log/ceph/ceph-client.admin.55867.log.gz 2024-09-15T23:58:20.983 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55311.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44321.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40515.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55311.log: /var/log/ceph/ceph-client.admin.42970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53219.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4%/var/log/ceph/ceph-client.admin.44321.log: -- replaced with /var/log/ceph/ceph-client.admin.55311.log.gz 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.44321.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53219.log: -- /var/log/ceph/ceph-client.admin.56789.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52158.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.53219.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53442.log 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2024-09-15T23:58:20.984 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54265.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56789.log: /var/log/ceph/ceph-client.admin.53442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52463.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54265.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53442.log.gz 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55227.log 86.5% 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54265.log.gz 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45803.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52463.log: /var/log/ceph/ceph-client.admin.55227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55353.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.52463.log.gz 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.55227.log.gz/var/log/ceph/ceph-client.admin.45803.log: 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose 86.1% -- /var/log/ceph/ceph-client.admin.52692.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45803.log.gz 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2024-09-15T23:58:20.985 INFO:teuthology.orchestra.run.smithi121.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.55353.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49364.log 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.54525.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59357.log 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.49364.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.1.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35073.log 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.1.54525.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.59357.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.35073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40854.log 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.35073.log.gz 2024-09-15T23:58:20.986 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56354.log: /var/log/ceph/ceph-client.admin.39926.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.40854.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34974.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.40854.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52878.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.39926.log: /var/log/ceph/ceph-client.admin.34974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53263.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.52878.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.34974.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.39926.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 86.0% -- replaced with /var/log/ceph/ceph-client.admin.52878.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.53263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 86.3% -- replaced with /var/log/ceph/ceph-client.admin.53263.log.gz 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.42886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54681.log 2024-09-15T23:58:20.987 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.43463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.54681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.54681.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46926.log 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49549.log: gzip -5 --verbose -- 86.2% /var/log/ceph/ceph-client.admin.55174.log 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.46926.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58961.log 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.55174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59213.log 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.55174.log.gz 2024-09-15T23:58:20.988 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.57356.log: /var/log/ceph/ceph-client.admin.58961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56398.log 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.59213.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.58961.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59213.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.56398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56449.log 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56398.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49792.log 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.46104.log: /var/log/ceph/ceph-client.admin.56449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.49792.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.56449.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49792.log.gz 2024-09-15T23:58:20.989 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.44026.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2024-09-15T23:58:20.990 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T23:58:21.108 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T23:58:21.296 INFO:teuthology.orchestra.run.smithi121.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T23:58:21.296 INFO:teuthology.orchestra.run.smithi121.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T23:58:21.345 INFO:teuthology.orchestra.run.smithi121.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m0.560s 2024-09-15T23:58:21.347 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m1.957s 2024-09-15T23:58:21.348 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.267s 2024-09-15T23:58:21.348 INFO:tasks.ceph:Archiving logs... 2024-09-15T23:58:21.348 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362/remote/smithi121/log 2024-09-15T23:58:21.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:58:21.894 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T23:58:21.906 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T23:58:21.906 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:58:21.960 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T23:58:21.969 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T23:58:21.969 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:58:21.987 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:58:21.993 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:58:21.993 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-15T23:58:21.993 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +303us[ +315us] +/- 36ms 2024-09-15T23:58:21.993 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -1095us[-1095us] +/- 50ms 2024-09-15T23:58:21.993 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +1075us[+1075us] +/- 78ms 2024-09-15T23:58:21.994 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:58:21.994 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T23:58:22.003 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T23:58:22.003 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T23:58:22.012 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:58:22.108 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:58:22.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:58:22.136 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T23:58:22.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T23:58:22.152 INFO:teuthology.task.internal:Duration was 545.932589 seconds 2024-09-15T23:58:22.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T23:58:22.162 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T23:58:22.162 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:58:22.214 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:58:22.556 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T23:58:22.556 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-15T23:58:22.556 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:58:22.616 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T23:58:22.617 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:58:22.683 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T23:58:22.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:58:22.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T23:58:22.848 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T23:58:22.849 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:58:22.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T23:58:22.882 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:58:22.937 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-15T23:58:22.950 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:58:23.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:58:23.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T23:58:23.014 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T23:58:23.015 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906362/remote/smithi121 2024-09-15T23:58:23.015 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:58:23.079 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T23:58:23.080 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:58:23.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T23:58:23.143 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T23:58:23.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T23:58:23.152 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T23:58:23.152 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:58:23.184 INFO:teuthology.orchestra.run.smithi121.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:58 /home/ubuntu/cephtest 2024-09-15T23:58:23.185 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T23:58:23.195 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T23:58:23.216 INFO:teuthology.run:Summary data: description: fs/top/{begin/{0-install 1-ceph 2-logrotate 3-modules} cluster/{1-node} conf/{client mds mgr mon osd} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distros$/{centos_latest} tasks/fstop} duration: 545.9325885772705 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T23:58:23.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:58:23.292 INFO:teuthology.run:pass